Problem with whisper-large-v3
I was trying to use the new whisper-large-v3 model and get the following error:File “/ext3/miniconda3/lib/python3.10/site-packages/transformers/tokenization_utils_base.py”, line 2065, in _from_pretrainedraise ValueError(ValueError: Non-consecutive added token ‘<|0.02|>’ found. Should have index 50365 but has index 50366 in saved vocabulary.Looks like some bug in the model?
2023-11-08T06:17:02Z
I have met this question. Maybe need to upgrade the transformers package?
2023-11-08T08:33:25Z
it didn’t help and i have the same problem
2023-11-08T13:37:28Z
cc@ArthurZmaybe
2023-11-08T14:41:45Z
Actually, it just fixed it for me…thanks!
2024-01-20T05:06:20Z
upgrade the transformer package solve my problem
2024-01-24T23:30:52Z
Hi did you fix it now? I meet the same problem
2024-01-29T10:45:41Z
Something changed in the whisper code. I just downgraded to 4.36 and now its working fine