## Dataset Summary

Contains 15 Harry Potter trivia questions in Squadv2 format, 3 of which are unanswerable.

## Model Performance

[Test Notebook](https://colab.research.google.com/drive/1VFUJKV7eun68XgQDAHSHsbvoM_CGHzWA?usp=sharing)

| Model      | exact | f1 |
| ----------- | ----------- | ----------- |
| Albert Base ([twmkn9/albert-base-v2-squad2](https://huggingface.co/twmkn9/albert-base-v2-squad2)) | 46.6667       | 46.6667 |
| Albert XXLarge ([ahotrod/albert_xxlargev1_squad2_512](https://huggingface.co/ahotrod/albert_xxlargev1_squad2_512))  | 66.6667  | 66.6667  |


region:us
{}
TAGS
#region-us 

Dataset Summary
---------------


Contains 15 Harry Potter trivia questions in Squadv2 format, 3 of which are unanswerable.


Model Performance
-----------------


Test Notebook


Model: Albert Base (twmkn9/albert-base-v2-squad2), exact: 46.6667, f1: 46.6667
Model: Albert XXLarge (ahotrod/albert\_xxlargev1\_squad2\_512), exact: 66.6667, f1: 66.6667



TAGS
#region-us 

passage: TAGS
#region-us 
