IndoClip : Pre Training Clip for Indonesian dataset
CLIP like contrastive vision-language models for Indonesian with pre-trained text and vision modelsFor this project, a pre-trained image model likeViTand a pre-trained text model likeBERTcan be used as an image encoder and text encoder respectively.ModelPre-trained ViT, BERT models can be found on the model hub. We could also use multi-lingual BERT/RoBERTa models for the Indonesian language.DatasetsTheWITdataset can be used for this task.TheGEMdataset can also be used for the taskAvailable training scriptsA training script for this will be provided soon. (seePR)(Optional) Desired project outcomeThe desired outcome is to train a CLIP-like model for Indonesian language. This can be showcased with a streamlit or gradio app.(Optional) ChallengesThis model will require some modifications to the existing models. Specifically, we will need to add projection layers in both the text and image encoder models.
2021-06-29T17:36:51Z
Hello@munggok.Are you still looking for team members for this project? I’m very interested with this project
2021-06-30T12:39:55Z
Perfect, 2 is enough - let’s finalize the project
2021-06-30T13:01:51Z
hi@gkuwantosure, come join@patrickvonplatenthanks patrick