---
license: apache-2.0
---
|    Tasks    |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge|      1|none  |     0|acc     |↑  |0.2304|±  |0.0123|
|             |       |none  |     0|acc_norm|↑  |0.2551|±  |0.0127|
|arc_easy     |      1|none  |     0|acc     |↑  |0.2559|±  |0.0090|
|             |       |none  |     0|acc_norm|↑  |0.2572|±  |0.0090|
|boolq        |      2|none  |     0|acc     |↑  |0.4599|±  |0.0087|
|hellaswag    |      1|none  |     0|acc     |↑  |0.2538|±  |0.0043|
|             |       |none  |     0|acc_norm|↑  |0.2601|±  |0.0044|
|openbookqa   |      1|none  |     0|acc     |↑  |0.1580|±  |0.0163|
|             |       |none  |     0|acc_norm|↑  |0.2720|±  |0.0199|
|piqa         |      1|none  |     0|acc     |↑  |0.5424|±  |0.0116|
|             |       |none  |     0|acc_norm|↑  |0.5180|±  |0.0117|
|winogrande   |      1|none  |     0|acc     |↑  |0.4980|±  |0.0141|