feidfoe commited on
Commit
905e3e9
·
1 Parent(s): d084b26

Add a notice about the result pushing pipeline

Browse files

Related to [#401](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard/discussions/401), I think it will be better if there is a notice on the submission page.

Files changed (1) hide show
  1. src/display/about.py +3 -0
src/display/about.py CHANGED
@@ -107,6 +107,9 @@ When we add extra information about models to the leaderboard, it will be automa
107
  If your model is displayed in the `FAILED` category, its execution stopped.
108
  Make sure you have followed the above steps first.
109
  If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
 
 
 
110
  """
111
 
112
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"
 
107
  If your model is displayed in the `FAILED` category, its execution stopped.
108
  Make sure you have followed the above steps first.
109
  If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
110
+
111
+ - Currently, there is an issue with our pipeline, which is responsible for automatically pushing the evaluation results; therefore, we will manually push them once a day
112
+ - Until we fix this issue, there may be a delay in your results appearing on the leaderboard, even if the evaluation is successfully completed. Thank you for your patience.
113
  """
114
 
115
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"