# LAION COCO translated into 200 languages

This dataset contains the samples of the [LAION-COCO](https://huggingface.co/datasets/laion/laion-coco) dataset translated to 200 languages using 
the largest [NLLB-200 model](https://huggingface.co/facebook/nllb-200-3.3B) (3.3B parameters).

## Fields description

1. `id` - unique ID of the image.
2. `url` - original URL of the image from the LAION-COCO dataset.
3. `eng_caption` - original English caption from the LAION-COCO dataset.
4. `captions` - a list of captions translated to the languages from the Flores 200 dataset. Every item in the list is a list where the first element is a BCP-47 language code, and the second one is a caption in this language. The list of all language codes for the Flores 200 dataset can be found [here](https://github.com/facebookresearch/flores/blob/main/flores200/README.md#languages-in-flores-200).
5. `score` - aesthetic score generated using [LAION aesthetic predictor](https://github.com/christophschuhmann/improved-aesthetic-predictor/). The images in the dataset have the score of 4.5+.

## Images

The dataset was filtered to contain only working image URLs. However, the availability may change in the future. Because of that, all images from this dataset are available at [https://nllb-data.com/](https://nllb-data.com/).
To get the image, use the following format:

```
https://nllb-data.com/{id}.jpg
```

## Paper

The dataset was used to train the models in the paper: "[NLLB-CLIP - train performant multilingual image retrieval model on a budget](https://arxiv.org/abs/2309.01859)".
task_categories:image-to-text task_categories:translation size_categories:100K<n<1M language:ace language:acm language:acq language:aeb language:af language:ajp language:ak language:als language:am language:apc language:ar language:ars language:ary language:arz language:as language:ast language:awa language:ayr language:azb language:azj language:ba language:bm language:ban language:be language:bem language:bn language:bho language:bjn language:bo language:bs language:bug language:bg language:ca language:ceb language:cs language:cjk language:ckb language:crh language:cy language:da language:de language:dik language:dyu language:dz language:el language:en language:eo language:et language:eu language:ee language:fo language:fj language:fi language:fon language:fr language:fur language:fuv language:gaz language:gd language:ga language:gl language:gn language:gu language:ht language:ha language:he language:hi language:hne language:hr language:hu language:hy language:ig language:ilo language:id language:is language:it language:jv language:ja language:kab language:kac language:kam language:kn language:ks language:ka language:kk language:kbp language:kea language:khk language:km language:ki language:rw language:ky language:kmb language:kmr language:knc language:kg language:ko language:lo language:lij language:li language:ln language:lt language:lmo language:ltg language:lb language:lua language:lg language:luo language:lus language:lvs language:mag language:mai language:ml language:mar language:min language:mk language:mt language:mni language:mos language:mi language:my language:nl language:nn language:nb language:npi language:nso language:nus language:ny language:oc language:ory language:pag language:pa language:pap language:pbt language:pes language:plt language:pl language:pt language:prs language:quy language:ro language:rn language:ru language:sg language:sa language:sat language:scn language:shn language:si language:sk language:sl language:sm language:sn language:sd language:so language:st language:es language:sc language:sr language:ss language:su language:sv language:swh language:szl language:ta language:taq language:tt language:te language:tg language:tl language:th language:ti language:tpi language:tn language:ts language:tk language:tum language:tr language:tw language:tzm language:ug language:uk language:umb language:ur language:uzn language:vec language:vi language:war language:wo language:xh language:ydd language:yo language:yue language:zh language:zsm language:zu license:cc-by-nc-4.0 arxiv:2309.01859 doi:10.57967/hf/1006 region:us
{"language": ["ace", "acm", "acq", "aeb", "af", "ajp", "ak", "als", "am", "apc", "ar", "ars", "ary", "arz", "as", "ast", "awa", "ayr", "azb", "azj", "ba", "bm", "ban", "be", "bem", "bn", "bho", "bjn", "bo", "bs", "bug", "bg", "ca", "ceb", "cs", "cjk", "ckb", "crh", "cy", "da", "de", "dik", "dyu", "dz", "el", "en", "eo", "et", "eu", "ee", "fo", "fj", "fi", "fon", "fr", "fur", "fuv", "gaz", "gd", "ga", "gl", "gn", "gu", "ht", "ha", "he", "hi", "hne", "hr", "hu", "hy", "ig", "ilo", "id", "is", "it", "jv", "ja", "kab", "kac", "kam", "kn", "ks", "ka", "kk", "kbp", "kea", "khk", "km", "ki", "rw", "ky", "kmb", "kmr", "knc", "kg", "ko", "lo", "lij", "li", "ln", "lt", "lmo", "ltg", "lb", "lua", "lg", "luo", "lus", "lvs", "mag", "mai", "ml", "mar", "min", "mk", "mt", "mni", "mos", "mi", "my", "nl", "nn", "nb", "npi", "nso", "nus", "ny", "oc", "ory", "pag", "pa", "pap", "pbt", "pes", "plt", "pl", "pt", "prs", "quy", "ro", "rn", "ru", "sg", "sa", "sat", "scn", "shn", "si", "sk", "sl", "sm", "sn", "sd", "so", "st", "es", "sc", "sr", "ss", "su", "sv", "swh", "szl", "ta", "taq", "tt", "te", "tg", "tl", "th", "ti", "tpi", "tn", "ts", "tk", "tum", "tr", "tw", "tzm", "ug", "uk", "umb", "ur", "uzn", "vec", "vi", "war", "wo", "xh", "ydd", "yo", "yue", "zh", "zsm", "zu"], "license": "cc-by-nc-4.0", "size_categories": ["100K<n<1M"], "task_categories": ["image-to-text", "translation"], "pretty_name": "LAION-COCO translated to 200 languages", "dataset_info": {"features": [{"name": "id", "dtype": "string"}, {"name": "url", "dtype": "string"}, {"name": "eng_caption", "dtype": "string"}, {"name": "captions", "sequence": {"sequence": "string"}}, {"name": "score", "dtype": "float64"}], "splits": [{"name": "test", "num_bytes": 271360114, "num_examples": 14906}, {"name": "train", "num_bytes": 13371094087, "num_examples": 735097}], "download_size": 8682991817, "dataset_size": 13642454201}, "language_details": "ace_Arab, ace_Latn, acm_Arab, acq_Arab, aeb_Arab, afr_Latn, ajp_Arab, aka_Latn, amh_Ethi, apc_Arab, arb_Arab, ars_Arab, ary_Arab, arz_Arab, asm_Beng, ast_Latn, awa_Deva, ayr_Latn, azb_Arab, azj_Latn, bak_Cyrl, bam_Latn, ban_Latn,bel_Cyrl, bem_Latn, ben_Beng, bho_Deva, bjn_Arab, bjn_Latn, bod_Tibt, bos_Latn, bug_Latn, bul_Cyrl, cat_Latn, ceb_Latn, ces_Latn, cjk_Latn, ckb_Arab, crh_Latn, cym_Latn, dan_Latn, deu_Latn, dik_Latn, dyu_Latn, dzo_Tibt, ell_Grek, eng_Latn, epo_Latn, est_Latn, eus_Latn, ewe_Latn, fao_Latn, pes_Arab, fij_Latn, fin_Latn, fon_Latn, fra_Latn, fur_Latn, fuv_Latn, gla_Latn, gle_Latn, glg_Latn, grn_Latn, guj_Gujr, hat_Latn, hau_Latn, heb_Hebr, hin_Deva, hne_Deva, hrv_Latn, hun_Latn, hye_Armn, ibo_Latn, ilo_Latn, ind_Latn, isl_Latn, ita_Latn, jav_Latn, jpn_Jpan, kab_Latn, kac_Latn, kam_Latn, kan_Knda, kas_Arab, kas_Deva, kat_Geor, knc_Arab, knc_Latn, kaz_Cyrl, kbp_Latn, kea_Latn, khm_Khmr, kik_Latn, kin_Latn, kir_Cyrl, kmb_Latn, kon_Latn, kor_Hang, kmr_Latn, lao_Laoo, lvs_Latn, lij_Latn, lim_Latn, lin_Latn, lit_Latn, lmo_Latn, ltg_Latn, ltz_Latn, lua_Latn, lug_Latn, luo_Latn, lus_Latn, mag_Deva, mai_Deva, mal_Mlym, mar_Deva, min_Latn, mkd_Cyrl, plt_Latn, mlt_Latn, mni_Beng, khk_Cyrl, mos_Latn, mri_Latn, zsm_Latn, mya_Mymr, nld_Latn, nno_Latn, nob_Latn, npi_Deva, nso_Latn, nus_Latn, nya_Latn, oci_Latn, gaz_Latn, ory_Orya, pag_Latn, pan_Guru, pap_Latn, pol_Latn, por_Latn, prs_Arab, pbt_Arab, quy_Latn, ron_Latn, run_Latn, rus_Cyrl, sag_Latn, san_Deva, sat_Beng, scn_Latn, shn_Mymr, sin_Sinh, slk_Latn, slv_Latn, smo_Latn, sna_Latn, snd_Arab, som_Latn, sot_Latn, spa_Latn, als_Latn, srd_Latn, srp_Cyrl, ssw_Latn, sun_Latn, swe_Latn, swh_Latn, szl_Latn, tam_Taml, tat_Cyrl, tel_Telu, tgk_Cyrl, tgl_Latn, tha_Thai, tir_Ethi, taq_Latn, taq_Tfng, tpi_Latn, tsn_Latn, tso_Latn, tuk_Latn, tum_Latn, tur_Latn, twi_Latn, tzm_Tfng, uig_Arab, ukr_Cyrl, umb_Latn, urd_Arab, uzn_Latn, vec_Latn, vie_Latn, war_Latn, wol_Latn, xho_Latn, ydd_Hebr, yor_Latn, yue_Hant, zho_Hans, zho_Hant, zul_Latn", "configs": [{"config_name": "default", "data_files": [{"split": "test", "path": "data/test-*"}, {"split": "train", "path": "data/train-*"}]}]}
TAGS
#task_categories-image-to-text #task_categories-translation #size_categories-100K<n<1M #language-Achinese #language-Mesopotamian Arabic #language-Ta'izzi-Adeni Arabic #language-Tunisian Arabic #language-Afrikaans #language-South Levantine Arabic #language-Akan #language-Tosk Albanian #language-Amharic #language-Levantine Arabic #language-Arabic #language-Najdi Arabic #language-Moroccan Arabic #language-Egyptian Arabic #language-Assamese #language-Asturian #language-Awadhi #language-Central Aymara #language-South Azerbaijani #language-North Azerbaijani #language-Bashkir #language-Bambara #language-Balinese #language-Belarusian #language-Bemba (Zambia) #language-Bengali #language-Bhojpuri #language-Banjar #language-Tibetan #language-Bosnian #language-Buginese #language-Bulgarian #language-Catalan #language-Cebuano #language-Czech #language-Chokwe #language-Central Kurdish #language-Crimean Tatar #language-Welsh #language-Danish #language-German #language-Southwestern Dinka #language-Dyula #language-Dzongkha #language-Modern Greek (1453-) #language-English #language-Esperanto #language-Estonian #language-Basque #language-Ewe #language-Faroese #language-Fijian #language-Finnish #language-Fon #language-French #language-Friulian #language-Nigerian Fulfulde #language-West Central Oromo #language-Scottish Gaelic #language-Irish #language-Galician #language-Guarani #language-Gujarati #language-Haitian #language-Hausa #language-Hebrew #language-Hindi #language-Chhattisgarhi #language-Croatian #language-Hungarian #language-Armenian #language-Igbo #language-Iloko #language-Indonesian #language-Icelandic #language-Italian #language-Javanese #language-Japanese #language-Kabyle #language-Kachin #language-Kamba (Kenya) #language-Kannada #language-Kashmiri #language-Georgian #language-Kazakh #language-Kabiyè #language-Kabuverdianu #language-Halh Mongolian #language-Khmer #language-Kikuyu #language-Kinyarwanda #language-Kirghiz #language-Kimbundu #language-Northern Kurdish #language-Central Kanuri #language-Kongo #language-Korean #language-Lao #language-Ligurian #language-Limburgan #language-Lingala #language-Lithuanian #language-Lombard #language-Latgalian #language-Luxembourgish #language-Luba-Lulua #language-Ganda #language-Luo (Kenya and Tanzania) #language-Lushai #language-Standard Latvian #language-Magahi #language-Maithili #language-Malayalam #language-Marathi #language-Minangkabau #language-Macedonian #language-Maltese #language-Manipuri #language-Mossi #language-Maori #language-Burmese #language-Dutch #language-Norwegian Nynorsk #language-Norwegian Bokmål #language-Nepali (individual language) #language-Pedi #language-Nuer #language-Nyanja #language-Occitan (post 1500) #language-Odia #language-Pangasinan #language-Panjabi #language-Papiamento #language-Southern Pashto #language-Iranian Persian #language-Plateau Malagasy #language-Polish #language-Portuguese #language-Dari #language-Ayacucho Quechua #language-Romanian #language-Rundi #language-Russian #language-Sango #language-Sanskrit #language-Santali #language-Sicilian #language-Shan #language-Sinhala #language-Slovak #language-Slovenian #language-Samoan #language-Shona #language-Sindhi #language-Somali #language-Southern Sotho #language-Spanish #language-Sardinian #language-Serbian #language-Swati #language-Sundanese #language-Swedish #language-Swahili (individual language) #language-Silesian #language-Tamil #language-Tamasheq #language-Tatar #language-Telugu #language-Tajik #language-Tagalog #language-Thai #language-Tigrinya #language-Tok Pisin #language-Tswana #language-Tsonga #language-Turkmen #language-Tumbuka #language-Turkish #language-Twi #language-Central Atlas Tamazight #language-Uighur #language-Ukrainian #language-Umbundu #language-Urdu #language-Northern Uzbek #language-Venetian #language-Vietnamese #language-Waray (Philippines) #language-Wolof #language-Xhosa #language-Eastern Yiddish #language-Yoruba #language-Yue Chinese #language-Chinese #language-Standard Malay #language-Zulu #license-cc-by-nc-4.0 #arxiv-2309.01859 #doi-10.57967/hf/1006 #region-us 

# LAION COCO translated into 200 languages

This dataset contains the samples of the LAION-COCO dataset translated to 200 languages using 
the largest NLLB-200 model (3.3B parameters).

## Fields description

1. 'id' - unique ID of the image.
2. 'url' - original URL of the image from the LAION-COCO dataset.
3. 'eng_caption' - original English caption from the LAION-COCO dataset.
4. 'captions' - a list of captions translated to the languages from the Flores 200 dataset. Every item in the list is a list where the first element is a BCP-47 language code, and the second one is a caption in this language. The list of all language codes for the Flores 200 dataset can be found here.
5. 'score' - aesthetic score generated using LAION aesthetic predictor. The images in the dataset have the score of 4.5+.

## Images

The dataset was filtered to contain only working image URLs. However, the availability may change in the future. Because of that, all images from this dataset are available at URL
To get the image, use the following format:



## Paper

The dataset was used to train the models in the paper: "NLLB-CLIP - train performant multilingual image retrieval model on a budget".
# LAION COCO translated into 200 languages

This dataset contains the samples of the LAION-COCO dataset translated to 200 languages using 
the largest NLLB-200 model (3.3B parameters). ## Fields description

1. 'id' - unique ID of the image.
2. 'url' - original URL of the image from the LAION-COCO dataset.
3. 'eng_caption' - original English caption from the LAION-COCO dataset.
4. 'captions' - a list of captions translated to the languages from the Flores 200 dataset. Every item in the list is a list where the first element is a BCP-47 language code, and the second one is a caption in this language. The list of all language codes for the Flores 200 dataset can be found here.
5. 'score' - aesthetic score generated using LAION aesthetic predictor. The images in the dataset have the score of 4.5+. ## Images

The dataset was filtered to contain only working image URLs. However, the availability may change in the future. Because of that, all images from this dataset are available at URL
To get the image, use the following format: ## Paper

The dataset was used to train the models in the paper: "NLLB-CLIP - train performant multilingual image retrieval model on a budget".
TAGS
#task_categories-image-to-text #task_categories-translation #size_categories-100K<n<1M #language-Achinese #language-Mesopotamian Arabic #language-Ta'izzi-Adeni Arabic #language-Tunisian Arabic #language-Afrikaans #language-South Levantine Arabic #language-Akan #language-Tosk Albanian #language-Amharic #language-Levantine Arabic #language-Arabic #language-Najdi Arabic #language-Moroccan Arabic #language-Egyptian Arabic #language-Assamese #language-Asturian #language-Awadhi #language-Central Aymara #language-South Azerbaijani #language-North Azerbaijani #language-Bashkir #language-Bambara #language-Balinese #language-Belarusian #language-Bemba (Zambia) #language-Bengali #language-Bhojpuri #language-Banjar #language-Tibetan #language-Bosnian #language-Buginese #language-Bulgarian #language-Catalan #language-Cebuano #language-Czech #language-Chokwe #language-Central Kurdish #language-Crimean Tatar #language-Welsh #language-Danish #language-German #language-Southwestern Dinka #language-Dyula #language-Dzongkha #language-Modern Greek (1453-) #language-English #language-Esperanto #language-Estonian #language-Basque #language-Ewe #language-Faroese #language-Fijian #language-Finnish #language-Fon #language-French #language-Friulian #language-Nigerian Fulfulde #language-West Central Oromo #language-Scottish Gaelic #language-Irish #language-Galician #language-Guarani #language-Gujarati #language-Haitian #language-Hausa #language-Hebrew #language-Hindi #language-Chhattisgarhi #language-Croatian #language-Hungarian #language-Armenian #language-Igbo #language-Iloko #language-Indonesian #language-Icelandic #language-Italian #language-Javanese #language-Japanese #language-Kabyle #language-Kachin #language-Kamba (Kenya) #language-Kannada #language-Kashmiri #language-Georgian #language-Kazakh #language-Kabiyè #language-Kabuverdianu #language-Halh Mongolian #language-Khmer #language-Kikuyu #language-Kinyarwanda #language-Kirghiz #language-Kimbundu #language-Northern Kurdish #language-Central Kanuri #language-Kongo #language-Korean #language-Lao #language-Ligurian #language-Limburgan #language-Lingala #language-Lithuanian #language-Lombard #language-Latgalian #language-Luxembourgish #language-Luba-Lulua #language-Ganda #language-Luo (Kenya and Tanzania) #language-Lushai #language-Standard Latvian #language-Magahi #language-Maithili #language-Malayalam #language-Marathi #language-Minangkabau #language-Macedonian #language-Maltese #language-Manipuri #language-Mossi #language-Maori #language-Burmese #language-Dutch #language-Norwegian Nynorsk #language-Norwegian Bokmål #language-Nepali (individual language) #language-Pedi #language-Nuer #language-Nyanja #language-Occitan (post 1500) #language-Odia #language-Pangasinan #language-Panjabi #language-Papiamento #language-Southern Pashto #language-Iranian Persian #language-Plateau Malagasy #language-Polish #language-Portuguese #language-Dari #language-Ayacucho Quechua #language-Romanian #language-Rundi #language-Russian #language-Sango #language-Sanskrit #language-Santali #language-Sicilian #language-Shan #language-Sinhala #language-Slovak #language-Slovenian #language-Samoan #language-Shona #language-Sindhi #language-Somali #language-Southern Sotho #language-Spanish #language-Sardinian #language-Serbian #language-Swati #language-Sundanese #language-Swedish #language-Swahili (individual language) #language-Silesian #language-Tamil #language-Tamasheq #language-Tatar #language-Telugu #language-Tajik #language-Tagalog #language-Thai #language-Tigrinya #language-Tok Pisin #language-Tswana #language-Tsonga #language-Turkmen #language-Tumbuka #language-Turkish #language-Twi #language-Central Atlas Tamazight #language-Uighur #language-Ukrainian #language-Umbundu #language-Urdu #language-Northern Uzbek #language-Venetian #language-Vietnamese #language-Waray (Philippines) #language-Wolof #language-Xhosa #language-Eastern Yiddish #language-Yoruba #language-Yue Chinese #language-Chinese #language-Standard Malay #language-Zulu #license-cc-by-nc-4.0 #arxiv-2309.01859 #doi-10.57967/hf/1006 #region-us 
 # LAION COCO translated into 200 languages

This dataset contains the samples of the LAION-COCO dataset translated to 200 languages using 
the largest NLLB-200 model (3.3B parameters). ## Fields description

1. 'id' - unique ID of the image.
2. 'url' - original URL of the image from the LAION-COCO dataset.
3. 'eng_caption' - original English caption from the LAION-COCO dataset.
4. 'captions' - a list of captions translated to the languages from the Flores 200 dataset. Every item in the list is a list where the first element is a BCP-47 language code, and the second one is a caption in this language. The list of all language codes for the Flores 200 dataset can be found here.
5. 'score' - aesthetic score generated using LAION aesthetic predictor. The images in the dataset have the score of 4.5+. ## Images

The dataset was filtered to contain only working image URLs. However, the availability may change in the future. Because of that, all images from this dataset are available at URL
To get the image, use the following format: ## Paper

The dataset was used to train the models in the paper: "NLLB-CLIP - train performant multilingual image retrieval model on a budget".