Position Embedding error in HuggingFace
image988×127 29.8 KBthis variable is position embedding which is getting initialised as 1,50,128 but is reading the weights of cls_token which is 1,1,128
2023-09-21T07:36:13Z
image1456×86 49.4 KB