kechengcode
/

phi-2-mlc

Model card Files Files and versions Community

kechengcode commited on Nov 15, 2024

Commit

64c34c8

·

verified ·

1 Parent(s): fb7f360

Update mlc-chat-config.json

Files changed (1) hide show

mlc-chat-config.json +2 -2

mlc-chat-config.json CHANGED Viewed

@@ -25,8 +25,8 @@
   "prefill_chunk_size": 768,
   "attention_sink_size": -1,
   "tensor_parallel_shards": 1,
-  "mean_gen_len": 128,
-  "max_gen_len": 512,
   "shift_fill_factor": 0.3,
   "temperature": 0.7,
   "repetition_penalty": 1.0,

   "prefill_chunk_size": 768,
   "attention_sink_size": -1,
   "tensor_parallel_shards": 1,
+  "mean_gen_len": 96,
+  "max_gen_len": 192,
   "shift_fill_factor": 0.3,
   "temperature": 0.7,
   "repetition_penalty": 1.0,