Number of dims don't match in permute in BERT
I’m facing a peculiar issue. I’m running evaluation onHANS. I have used this script more than a hundred times at this point but this error never appeared before.When I userun_hans.py, I’m getting this error intranspose_for_scores,RuntimeError: number of dims don't match in permute. I’ve inspected the dimension of input, it istorch.Size[128]). It is same as MNLI data sample fromrun_gluewhich works. I tried with older versions of transformers, and get the same error.I tried with other models such asroberta-baseand it works. I am not sure why this problem occurs because the attention weight vector has 4 dimensions[# bs, n_heads, seq_length, 64]. Can anyone suggest a workaround to fix this ?