In LayoutLMv2, TIA and MVLM
hello.i m trying reproduce LayoutLMv2 pretraining performance.But I faced problem with compute TIA lossIn LayoutLMV2 paper,TIA(Text-Image-alignment) explain like this,When MVLM and TIA are preformed simultaneously, TIA losses of the tokens masked in MVLM are not taken into account. THis prevents the model from learning the useless but straighforward correspondence from ‘[MASK]’ to ‘[Covered]’i understand that means when setting tia_label, if token masked with MVLM’s [MASK] , ignore that token to prevent model train [MASK] to [Covered].So if input embedding will be generate like thisinput :['a']['b']['mask']['d']['e']['f']['mask']in line :#line1 : ['a']['b']['mask']['d']
   #line2  : ['e']['f']['mask']TIA perform cover line 15% probability,  in this case, assumeline2will covered,total input’s TIA_label will be#[       line1         ][     line2       ]
 ['a']['b']['mask']['d']['e']['f']['mask']
 [notCover][notCover][ignore][notCover]  [Covered][Covered][ignore]But, TIA loss compute the binary cross entropy losshow they compute loss?thanks.