
# GPT2 Ukrainian

A generative language model for the Ukrainian language follows the [GPT-2 architecture](https://huggingface.co/gpt2) (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167

## Training data

- OSCAR
- Wikimedia dumps

## License

MIT


{"language": ["uk"], "license": "mit", "library_name": "transformers", "datasets": ["oscar"], "pipeline_tag": "text-generation"}
transformers pytorch safetensors gpt2 text-generation uk dataset:oscar license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #uk #dataset-oscar #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


# GPT2 Ukrainian

A generative language model for the Ukrainian language follows the GPT-2 architecture (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167

## Training data

- OSCAR
- Wikimedia dumps

## License

MIT


# GPT2 Ukrainian

A generative language model for the Ukrainian language follows the GPT-2 architecture (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167 ## Training data

- OSCAR
- Wikimedia dumps ## License

MIT
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #uk #dataset-oscar #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
 # GPT2 Ukrainian

A generative language model for the Ukrainian language follows the GPT-2 architecture (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167 ## Training data

- OSCAR
- Wikimedia dumps ## License

MIT
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #uk #dataset-oscar #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
# GPT2 Ukrainian

A generative language model for the Ukrainian language follows the GPT-2 architecture (124M parameters).

- hidden size: 768
- number of heads: 12
- number of layers: 12
- seq length: 1024
- tokens: 11238113280 (3 epochs)
- steps: 57167## Training data

- OSCAR
- Wikimedia dumps## License

MIT