metadata
license: apache-2.0
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| arc_challenge | 1 | none | 0 | acc | ↑ | 0.2304 | ± | 0.0123 |
| none | 0 | acc_norm | ↑ | 0.2551 | ± | 0.0127 | ||
| arc_easy | 1 | none | 0 | acc | ↑ | 0.2559 | ± | 0.0090 |
| none | 0 | acc_norm | ↑ | 0.2572 | ± | 0.0090 | ||
| boolq | 2 | none | 0 | acc | ↑ | 0.4599 | ± | 0.0087 |
| hellaswag | 1 | none | 0 | acc | ↑ | 0.2538 | ± | 0.0043 |
| none | 0 | acc_norm | ↑ | 0.2601 | ± | 0.0044 | ||
| openbookqa | 1 | none | 0 | acc | ↑ | 0.1580 | ± | 0.0163 |
| none | 0 | acc_norm | ↑ | 0.2720 | ± | 0.0199 | ||
| piqa | 1 | none | 0 | acc | ↑ | 0.5424 | ± | 0.0116 |
| none | 0 | acc_norm | ↑ | 0.5180 | ± | 0.0117 | ||
| winogrande | 1 | none | 0 | acc | ↑ | 0.4980 | ± | 0.0141 |