# MinGPT

Normal GPT 2 Architecture with below config trained on subset of openwebtext 

```
    n_ctx=256,
    n_positions = 256,
    n_layer = 6,
    n_embd = 384,
    n_head = 6,

```
{"license": "mit", "datasets": ["Skylion007/openwebtext"]}
transformers pytorch gpt2 text-generation dataset:Skylion007/openwebtext license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us