Is the chat template correct? (issue for vLLM)
#22
by
MichaelAI23
- opened
If I prompt the model with a text and an image, it produces the [IMG] without a newline \n. However the correct version seems to be with \n.
Also I tried deployment with vLLM and passing this chat template. It does not produce an error, but creates gibberish results.
Thanks in advance!