Working of MultipleChoiceModel
I wanted to know in detail as to howxForMultipleChoiceModelworks ? So prompt and choices are concatenated beforehand (preprocess_func). I had a look at source codehere. So number of options are chosen frominput_ids, followed by flattening of all keys inencodingobject from tokenizer (input_ids,position_ids) after which it is sent toLongFormerModel. Can you please expain what happens exactly after this step ? I see that some padding is performed after whichLongFormerEncoderis called. How does the Multiple choice head work and how is the loss computed ? Thanks.