Deberta v3 Input length and Absolute positional embeddings
Hello, I have two questions regarding the implementation of deberta v3.Given that the masked language modelling has been replaced with an Electra style learning, is it safe to assume that the absolute positonal embeddings have been dropped?Furthermore, if that is the case, is it safe to assume the V3 version can deal with any input length?