[RAG]AttributeError: 'RagTokenizer' object has no attribute 'convert_tokens_to_ids'
Hi,I tried to set a symbol to stop the RAG model’s generation. I saw there is ‘eos_token_id’ parameter in model.generate(), but the RagTokenizer doesn’t have ‘convert_tokens_to_ids’. How can I use the ‘eos_token_id’ to stop the generation with certain symbol like “%” or “*”? Thank you.