These models do not require language embeddings during inference. They should identify the language from the
context and infer accordingly.
XLM-RoBERTa
The following XLM-RoBERTa models can be used for multilingual tasks:

FacebookAI/xlm-roberta-base (Masked language modeling, 100 languages)
FacebookAI/xlm-roberta-large (Masked language modeling, 100 languages)