Matching output with shape in T5 model
I’m trying to fine-tune T5 (ForConditionalGeneration) model with local files (added 3d attention mask in forward function of T5ForConditionalGeneration), and got error when the model evaluates,File “/home/paulc/customized_t5/models/custom_amr_to_sg/t5_model/modeling_t5.py”, line 568, in forwardscores += position_biasRuntimeError: output with shape [32, 12, 1, 2] doesn’t match the broadcast shape [32, 12, 2, 2]It does’t give an error while training though…I tried with the solution from thelinkwhich is similar to T5,but it still gives me the same error…Might evaluate function be the problem?Thank you in advance!
2023-08-17T11:57:54Z
Did you find the bug?Thanks in advance