text
🚀 Release of open-source Korean LLM: GECKO-7B
🚀 Release of open-source Korean LLM: GECKO-7B
new_line
new_line
text
I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.
I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.
new_line
new_line
mention
@donggyukimc
donggyukimc
text
  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.
  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.
new_line
new_line
text
I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.
I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.
new_line
new_line
text
🤗 Model: 
🤗 Model: 
resource
https://huggingface.co/kifai/GECKO-7B
model
kifai/GECKO-7B
https://huggingface.co/kifai/GECKO-7B
new_line
text
📄 Technical Report: 
📄 Technical Report: 
link
https://arxiv.org/pdf/2405.15640
https://arxiv.org/pdf/2405.15640
🚀 Release of open-source Korean LLM: GECKO-7B

I am delighted to share my recent project, GECKO, a bilingual large language model for Korean and English 🇰🇷🇺🇸. This initiative was inspired by the lack of resources for Korean large language models.

@donggyukimc  and I wrote the technical report to share our insights and experiences of developing our model. While our model may not achieve sate-of-the-art performance on all benchmarks, it shows modest results with a relatively small amount of pretrained tokens.

I hope GECKO contribute to the open-source community, offering resources that can built upon and improved. I believe that through collaboration and shared knowledge, we can advance the capabilities and accessibility of large language models for Korean and other low-resource languages.

🤗 Model: https://huggingface.co/kifai/GECKO-7B
📄 Technical Report: https://arxiv.org/pdf/2405.15640
👍
nicolay-r osanseviero
/avatars/4d3dea3779ce9bc67482e0fe0eca4b41.svg
zerodimension
danish1121
user