Can't load tokenizer using from_pretrained, Inference API
Can't load tokenizer using from_pretrained, please update its configuration: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 560, column 3Here are my project files:Files.I could use the model locally from the local checkpoint folder after the finetune; however, when I upload the same checkpoint folder on hugginceface as a model, it doesn’t seem to work anymore. Could anyone please help me with that! Thank you!
2024-05-06T09:00:37Z
Thanks for reporting, will forward to the team!Duplicate ofModel Inference API error
2024-05-06T10:09:19Z
Thank you! Looking forward to hearing from the team!!!
2024-05-06T12:41:01Z
Could use the same model uploaded onKaggle. However, when used with AutoTokenizer, it complained, worked with MBart50Tokenizer.
2024-05-06T12:55:30Z
Update: Works with MBart50Tokenizer from the HuggingFace checkpoint as well.  Here is theSpaceI was testing it.