Update README.md
Browse files
README.md
CHANGED
@@ -2,7 +2,7 @@
|
|
2 |
tags:
|
3 |
- generated_from_trainer
|
4 |
model-index:
|
5 |
-
- name: gpt-
|
6 |
results: []
|
7 |
|
8 |
widget:
|
@@ -13,11 +13,11 @@ widget:
|
|
13 |
|
14 |
---
|
15 |
|
16 |
-
# gpt-
|
17 |
|
18 |
-
This is
|
19 |
|
20 |
-
[
|
21 |
|
22 |
### Format
|
23 |
|
|
|
2 |
tags:
|
3 |
- generated_from_trainer
|
4 |
model-index:
|
5 |
+
- name: gpt-est-base
|
6 |
results: []
|
7 |
|
8 |
widget:
|
|
|
13 |
|
14 |
---
|
15 |
|
16 |
+
# gpt-est-base
|
17 |
|
18 |
+
This is the base-size [GPT2](https://huggingface.co/docs/transformers/model_doc/gpt2) model, trained from scratch on 2.2 billion words (Estonian National Corpus + News Crawl + Common Crawl) for 3 epochs. Previously named "gpt-4-est-base", renamed to avoid click-baiting.
|
19 |
|
20 |
+
[Reference](https://doi.org/10.22364/bjmc.2022.10.3.19)
|
21 |
|
22 |
### Format
|
23 |
|