Spaces:

huggingchat

/

chat-ui

like 1.1k

Running

How to remove special tokens like <|im_start|> and <|im_end|> from chat messages and previews.

Model config:
{
"name": "IlyaGusev/saiga_nemo_12b",
"displayName": "IlyaGusev/saiga_nemo_12b",
"description": "Saiga/MistralNemo 12B, Russian fine-tune of Mistral Nemo. Based on an abliterated version of Mistral Nemo.",
"websiteUrl": "https://mistral.ai/news/mistral-nemo/",
"parameters": {
"stop": [""],
"temperature": 0.1,
"truncate": 9000,
"max_new_tokens": 1536
},
"endpoints": [{
"type" : "tgi",
"url": "http://tgi",
}]
}