Ba2han's picture
Update README.md
468f7b1 verified
---
license: mit
language:
- tr
library_name: transformers
---
Pretrained on 1B (mostly Turkish) tokens from HF and "high quality" scraped data using 1 RTX 3090. The training will continue. The model already can produce sensible sentences in Turkish.
___________________________
HF kaynaklı ve scrape edilen 1 Milyar (çoğunlukla Türkçe) token ile 1 RTX 3090 kullanılarak eğitilmiştir. Eğitim devam edecek. Model şimdiden düzgün Türkçe cümleler kurabiliyor:
![image/png](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F6324eabf05bd8a54c6eb1650%2Fzq9urjpOOLRyLzDiyLCXw.png%3C%2Fspan%3E)%3C%2Fspan%3E%3C!-- HTML_TAG_END -->
(top_k=24, repetition_penalty=1.1, temperature=0.12, seed=1022)