OPEA
/

Safetensors
llama
4-bit precision
intel/auto-round
cicdatopea commited on
Commit
6b17813
·
verified ·
1 Parent(s): 6010237

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -211,7 +211,7 @@ It seems like we're about to embark on a delightful adventure! "Once upon a time
211
  pip3 install lm-eval==0.4.5
212
 
213
  ```bash
214
- auto-round --eval --model_name "OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc" --eval_bs 16 --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
215
  ```
216
 
217
  | Metric | BF16 | INT4 |
 
211
  pip3 install lm-eval==0.4.5
212
 
213
  ```bash
214
+ auto-round --eval --model "OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc" --eval_bs 16 --tasks leaderboard_mmlu_pro,leaderboard_ifeval,lambada_openai,hellaswag,piqa,winogrande,truthfulqa_mc1,openbookqa,boolq,arc_easy,arc_challenge,mmlu,gsm8k
215
  ```
216
 
217
  | Metric | BF16 | INT4 |