2nd CfP: GermEval2024 GerMS-Detect - Sexism Detection and Annotator Disagreement modeling in German Online News Fora @Konvens 2024
GermEval2024 Shared Task: GerMS-Detect – Sexism Detection in German Online News Fora2nd CALL FOR PARTICIPATIONWe would like to invite you to the GermEval Shared Task GerMS-Detect on Sexism Detection in German Online News Fora collocated withKonvens 2024.Competition WebsiteImportant Dates:Development phase: May 1 - June 5, 2024 (ongoing)Competition phase: June 7 - June 25, 2024Paper submission due: July 1, 2024Camera ready due: July 20, 2024Shared Task@KONVENS: 10 September, 2024Task descriptionThis shared task is not just about the detection of sexism/misogyny in comments posted in (mostly) German language to the comment section of an Austrian online newspaper:many of the texts to be classified contain ambiguous language, very subtle ways to express misogyny or sexism or lack important context. For these reasons, there can bequite some disagreement between annotators on the appropriate label. In many cases, there is no single correct label. For this reason the shared task is not just aboutcorrectly predicting a single label chosen from all the labels assigned by human annotators, but about models which can predict the level of disagreement, the rangeof labels assigned by annotators or the distribution of labels to expect for a specific group of annotators.For details see theCompetition Website.OrganizersThe task is organized by theAustrian Research Institute for Artificial Intelligence (OFAI).Organizing team:Brigitte Krenn (brigitte.krenn (AT) ofai.at)Johann Petrak (johann.petrak (AT) ofai.at)Stephanie Gross (stephanie.gross (AT) ofai.at)