banghua commited on
Commit
d7193d2
·
verified ·
1 Parent(s): 15f4e1b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -62,7 +62,7 @@ outputs = pipeline(
62
  print(outputs[0]["generated_text"][-1])
63
  ```
64
 
65
- We found that by adding system prompts that enforce the model to think step by step, the model can do even better in math and problems like counting `r`s in strawberry.
66
 
67
  ## Acknowledgment
68
  We would like to thank the [LMSYS Organization](https://lmsys.org/) for their support of testing the model. We would like to thank Meta AI and the open source community for their efforts in providing the datasets and base models.
 
62
  print(outputs[0]["generated_text"][-1])
63
  ```
64
 
65
+ We found that by adding system prompts that enforce the model to think step by step, the model can do even better in math and problems like counting `r`s in strawberry. For fairness consideration we **do not** include such system prompt during chat evaluation.
66
 
67
  ## Acknowledgment
68
  We would like to thank the [LMSYS Organization](https://lmsys.org/) for their support of testing the model. We would like to thank Meta AI and the open source community for their efforts in providing the datasets and base models.