Do any models support 3 types of token_type_ids?
On a page of the Transformers documentationherethey mention thatSome models, likeXLNetModeluse an additional token represented by a2.when referring to token_type_ids model input.I looked on XLNetModel’s documentation and AFAIK it seems to only support 2 types.Are there any models that support 2+ types of token?Cheers,Cyrus