Hugging Face's logo

Marcus2112
/
pythia-160m-minipile_k440_density-proportioned

Safetensors
English
gpt_neox
Model card Files Community
Benchmark Measure 160M MiniPile 160M k440 Density
ARC-Challenge acc ↑ 0.2125 ± 0.0120 0.1928 ± 0.0115
MMLU acc ↑ 0.2699 ± 0.0037 0.2295 ± 0.0035
HellaSwag acc ↑ 0.2560 ± 0.0044 0.2603 ± 0.0044
WinoGrande acc ↑ 0.4720 ± 0.0140 0.4941 ± 0.0141
Lambada (OpenAI) acc ↑ 0.0000 ± 0.0000 0.0000 ± 0.0000
Lambada (OpenAI) perplexity ↓ 3033175.2693 ± 288926.5827 2025523.7766 ± 164221.8893
Lambada (Std) acc ↑ 0.0000 ± 0.0000 0.0000 ± 0.0000
Lambada (Std) perplexity ↓ 27067951.3460 ± 2710040.191 12959844.9407 ± 1160155.0647
BLiMP acc ↑ 0.5194 ± 0.0018 0.5520 ± 0.0017
Downloads last month
6
Safetensors
Model size
162M params
Tensor type
F32
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for Marcus2112/pythia-160m-minipile_k440_density-proportioned

Base model

EleutherAI/pythia-160m-deduped
Finetuned
(123)
this model

Dataset used to train Marcus2112/pythia-160m-minipile_k440_density-proportioned

Collection including Marcus2112/pythia-160m-minipile_k440_density-proportioned