Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
alon-albalak
/
ODM_1Bparams_50Btokens_seqlen2048
like
0
Feature Extraction
Transformers
PyTorch
Safetensors
English
gpt_neox
text-generation-inference
Inference Endpoints
License:
openrail
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
alon-albalak
commited on
Oct 26, 2023
Commit
2b2d5ed
·
1 Parent(s):
ba23359
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+3
-1
README.md
CHANGED
Viewed
@@ -2,4 +2,6 @@
2
license: openrail
3
language:
4
- en
5
-
---
2
license: openrail
3
language:
4
- en
5
+
---
6
+
7
+
This is a GPT-NeoX model trained on 50 billion tokens from The Pile, using the Online Data Mixing method.