Peer-review systems such as SWoRD lack intelligence for detecting and responding to problems with students' reviewing performance. While prior work has demonstrated the feasibility of automatically identifying desirable feedback features in free-text reviews of student papers, similar methods have not yet been developed for feedback regarding argument diagrams. One desira- ble feedback feature is problem localization, which has been shown to positive- ly correlate with feedback implementation in both student papers and argument diagrams. In this paper we demonstrate that features previously developed for identifying localization in paper reviews do not work well when applied to peer reviews of argument diagrams. We develop a novel algorithm tailored for re- views of argument diagrams, and demonstrate significant performance im- provements in identifying problem localization in an experimental evaluation.
['Huy V. Nguyen', 'Diane J. Litman']
Identifying Localization in Peer Reviews of Argument Diagrams