Data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 6952 column 3
I am trying to use Mistral 7B model v0.3 it is showing this error for the codefrom huggingface_hub import loginlogin(token=“my token removed for security reason”)from transformers import AutoModelForCausalLM, AutoTokenizermodel_id = “mistralai/Mistral-7B-v0.3”tokenizer = AutoTokenizer.from_pretrained(model_id)model = AutoModelForCausalLM.from_pretrained(model_id)inputs = tokenizer(“Hello my name is”, return_tensors=“pt”)outputs = model.generate(**inputs, max_new_tokens=20)print(tokenizer.decode(outputs[0], skip_special_tokens=True))
2024-07-04T14:23:00Z
you could use an older version of the model files