- Di Wang, Leonid Boytsov, J. Araki, Alkesh Patel, Jeffrey G. Gee, Zhengzhong Liu, Eric Nyberg, T. Mitamura. 2014. CMU Multiple-choice Question Answering System at NTCIR-11 QA-Lab. Abstract: We describe CMU’s UIMA-based modular automatic question answering (QA) system. This system answers multiplechoice English questions for the world history entrance exam. Questions are preceded by short descriptions providing a historical context. Given the context and question-specic instructions, we generate veriable assertions for each answer choice. These assertions are evaluated using several evidencing modules, which assign a plausibility score to each assertion. These scores are then aggregated to produce the most plausible answer choice. In the NTCIR-11 QALab evaluations, our system achieved 51.6% accuracy on the training set, 47.2% on Phase 1 testing set, and 34.1% on Phase 2 testing set.
