No chat_template is present in tokenizer_config.json

#1
by antonpolishko - opened

Becuase of lack of chat_template this model fails to be used with transforer v4.44+.

I'm getting next error in vLLM logs

ValueError: As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one.

Sign up or log in to comment