unsloth

/

DeepSeek-R1-Distill-Llama-8B-GGUF

like 76

Follow

Unsloth AI 1.43k

Hi, there is the 4KM guff of the model producing outputs of the same quality as that of 4bnb?

You mean the 4bit Bnb produces different results than the 4KM GGUF of this model? :)

Hi, there is the 4KM guff of the model producing outputs of the same quality as that of 4bnb?

You mean the 4bit Bnb produces different results than the 4KM GGUF of this model? :)

The results should be different since they are different quantized models?

I meant model accuracy/perplexity score, is that close or off?