Get Exact Same response

#165
by Motaseam - opened

Hi everyone,
I am using Llama 3.1: 8b-instruct.
I am trying to get the exact same response, so I set these parameters with the following values:

"temperature": 0,  
"top_p": 1,  
"top_k": 1,  
"frequency_penalty": 0,  
"presence_penalty": 0,  
"repetition_penalty": 10,  
"min_p": -1,  
"top_a": 0,  

However, it still gives me different responses (it less but still there a difference). Any ideas?
Thanks!

Sign up or log in to comment