thesven

/

Llama-3-70B-Instruct-GGUF

like 0

The console shows:

llm_load_vocab: ************************************
llm_load_vocab: GENERATION QUALITY WILL BE DEGRADED!
llm_load_vocab: CONSIDER REGENERATING THE MODEL
llm_load_vocab: ************************************

It is already a month when the GGUF format was updated and people still somehow create broken quants...