File size: 1,029 Bytes
84fc451 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: apache-2.0
---
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge| 1|none | 0|acc |↑ |0.2304|± |0.0123|
| | |none | 0|acc_norm|↑ |0.2551|± |0.0127|
|arc_easy | 1|none | 0|acc |↑ |0.2559|± |0.0090|
| | |none | 0|acc_norm|↑ |0.2572|± |0.0090|
|boolq | 2|none | 0|acc |↑ |0.4599|± |0.0087|
|hellaswag | 1|none | 0|acc |↑ |0.2538|± |0.0043|
| | |none | 0|acc_norm|↑ |0.2601|± |0.0044|
|openbookqa | 1|none | 0|acc |↑ |0.1580|± |0.0163|
| | |none | 0|acc_norm|↑ |0.2720|± |0.0199|
|piqa | 1|none | 0|acc |↑ |0.5424|± |0.0116|
| | |none | 0|acc_norm|↑ |0.5180|± |0.0117|
|winogrande | 1|none | 0|acc |↑ |0.4980|± |0.0141| |