How to set input to validate of T5 Model
I’m fintuning T5 for superglue datasets.Now, I use first half of ‘validation’ set as validation set and the second half of ‘validation’ set as test set.I’m little bit confused of how to passdecoder_input_idson validation step.For example,input_ids,attention_maskcould be obtained fromtokenize("My model outperformed baseline models").And in my opinion, I should give just start token asdecoder_input_idswith the variables above toforward(). Is it correct?This results in the length of the output become 1(same as start token).Do I need to just pass tokenized ‘labels’ withoutdecoder_input_idslike in training step?And I’m not sure if I need to usegenerate()instead offorward().
2023-02-21T15:44:29Z
Hey@kwonmhaHave you seen our examples?This one, focused on GLUE, may give you the answers you need