license:cc-by-nc-sa-4.0 arxiv:2304.06364 region:us
---
dataset_info:
  features:
  - name: query
    dtype: string
  - name: choices
    sequence: string
  - name: gold
    sequence: int64
  splits:
  - name: test
    num_bytes: 852087
    num_examples: 651
  download_size: 420337
  dataset_size: 852087
license: cc-by-nc-sa-4.0
---
# Dataset Card for "agieval-logiqa-en"

Dataset taken from https://github.com/microsoft/AGIEval and processed as in that repo.

Raw datset: https://github.com/lgw863/LogiQA-dataset

[Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)](https://creativecommons.org/licenses/by-nc-sa/4.0/)

@misc{zhong2023agieval,
      title={AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models}, 
      author={Wanjun Zhong and Ruixiang Cui and Yiduo Guo and Yaobo Liang and Shuai Lu and Yanlin Wang and Amin Saied and Weizhu Chen and Nan Duan},
      year={2023},
      eprint={2304.06364},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

@inproceedings{Liu2020LogiQAAC,
  title={LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning},
  author={Jian Liu and Leyang Cui and Hanmeng Liu and Dandan Huang and Yile Wang and Yue Zhang},
  booktitle={International Joint Conference on Artificial Intelligence},
  year={2020}
}