elineve's picture
Upload 301 files
07423df
raw
history blame contribute delete
278 Bytes
Determines whether to sample from the next token distribution instead of choosing the token with the highest probability. If turned **On**, the next token in a predicted sequence is sampled based on the probabilities. If turned **Off**, the highest probability is always chosen.