mistralai

/

Mistral-Small-24B-Instruct-2501

like 361

Follow

Mistral AI_ 4.41k

This model seems to be quite sensitive to settings. I've seen many posts and comments on Reddit about this model having weird bugs due to inference settings. Could you share the optimal settings for running this model?

For example, what should the repeat penalty, top p & k values be? And is the optimal temperature indeed 0.15 as stated in the model card?