
# cloned transfomer

created with stacking layers, trained on Habr+Rulm

|   dataset |rugpt 760m large|AlexWortega/ruClonedGPT_1.4B|
| --------- | -------- |------  |
| xnliru    | 0.34     |0.36  |
| xwinograd | 0.65     |0.68  |
| danetqa   | 0.62     |0.65  |
| muserc    | 0.72     |0.74  |
| parus     | 0.584    |0.61  |
| rcb       | 0.417    |0.45  |
| rucos     | 0.21     |0.25  |
| russe     | 0.647    |0.66  |
| ruterra   | 0.654    |0.67  |  
| rwsd      | 0.636    | 0.339   |
{"language": ["ru"], "datasets": ["IlyaGusev/habr", "IlyaGusev/rulm"]}
transformers pytorch gpt2 text-generation ru dataset:IlyaGusev/habr dataset:IlyaGusev/rulm autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #gpt2 #text-generation #ru #dataset-IlyaGusev/habr #dataset-IlyaGusev/rulm #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

cloned transfomer
=================


created with stacking layers, trained on Habr+Rulm


dataset: xnliru, rugpt 760m large: 0.34, AlexWortega/ruClonedGPT\_1.4B: 0.36
dataset: xwinograd, rugpt 760m large: 0.65, AlexWortega/ruClonedGPT\_1.4B: 0.68
dataset: danetqa, rugpt 760m large: 0.62, AlexWortega/ruClonedGPT\_1.4B: 0.65
dataset: muserc, rugpt 760m large: 0.72, AlexWortega/ruClonedGPT\_1.4B: 0.74
dataset: parus, rugpt 760m large: 0.584, AlexWortega/ruClonedGPT\_1.4B: 0.61
dataset: rcb, rugpt 760m large: 0.417, AlexWortega/ruClonedGPT\_1.4B: 0.45
dataset: rucos, rugpt 760m large: 0.21, AlexWortega/ruClonedGPT\_1.4B: 0.25
dataset: russe, rugpt 760m large: 0.647, AlexWortega/ruClonedGPT\_1.4B: 0.66
dataset: ruterra, rugpt 760m large: 0.654, AlexWortega/ruClonedGPT\_1.4B: 0.67
dataset: rwsd, rugpt 760m large: 0.636, AlexWortega/ruClonedGPT\_1.4B: 0.339



TAGS
#transformers #pytorch #gpt2 #text-generation #ru #dataset-IlyaGusev/habr #dataset-IlyaGusev/rulm #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #pytorch #gpt2 #text-generation #ru #dataset-IlyaGusev/habr #dataset-IlyaGusev/rulm #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
