
# ProofGPT-v0.1

# Model Description
ProofGPT-v0.1 is a 6.7B parameter language model based on the GPT-NeoX architecture and trained on the [proof-pile](https://huggingface.co/datasets/hoskinson-center/proof-pile) (v1.1). 
We initiailized training with pythia-6.7b weights, a precursor to the [pythia-6.9b](https://huggingface.co/EleutherAI/pythia-6.9b) model that has roughly equivalent performance. 

Detailed evaluations coming soon :) 
{"language": ["en"], "license": "mit", "tags": ["text generation", "pytorch", "causal-lm", "gpt_neox"], "datasets": ["hoskinson-center/proof-pile"]}
transformers pytorch gpt_neox text-generation text generation causal-lm en dataset:hoskinson-center/proof-pile license:mit autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #gpt_neox #text-generation #text generation #causal-lm #en #dataset-hoskinson-center/proof-pile #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 


# ProofGPT-v0.1

# Model Description
ProofGPT-v0.1 is a 6.7B parameter language model based on the GPT-NeoX architecture and trained on the proof-pile (v1.1). 
We initiailized training with pythia-6.7b weights, a precursor to the pythia-6.9b model that has roughly equivalent performance. 

Detailed evaluations coming soon :) 
# ProofGPT-v0.1 # Model Description
ProofGPT-v0.1 is a 6.7B parameter language model based on the GPT-NeoX architecture and trained on the proof-pile (v1.1). 
We initiailized training with pythia-6.7b weights, a precursor to the pythia-6.9b model that has roughly equivalent performance. 

Detailed evaluations coming soon :)
TAGS
#transformers #pytorch #gpt_neox #text-generation #text generation #causal-lm #en #dataset-hoskinson-center/proof-pile #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
 # ProofGPT-v0.1 # Model Description
ProofGPT-v0.1 is a 6.7B parameter language model based on the GPT-NeoX architecture and trained on the proof-pile (v1.1). 
We initiailized training with pythia-6.7b weights, a precursor to the pythia-6.9b model that has roughly equivalent performance. 

Detailed evaluations coming soon :)
TAGS
#transformers #pytorch #gpt_neox #text-generation #text generation #causal-lm #en #dataset-hoskinson-center/proof-pile #license-mit #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
# ProofGPT-v0.1# Model Description
ProofGPT-v0.1 is a 6.7B parameter language model based on the GPT-NeoX architecture and trained on the proof-pile (v1.1). 
We initiailized training with pythia-6.7b weights, a precursor to the pythia-6.9b model that has roughly equivalent performance. 

Detailed evaluations coming soon :)