Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Add a notice about the result pushing pipeline
Browse filesRelated to [#401](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard/discussions/401), I think it will be better if there is a notice on the submission page.
- src/display/about.py +3 -0
src/display/about.py
CHANGED
@@ -107,6 +107,9 @@ When we add extra information about models to the leaderboard, it will be automa
|
|
107 |
If your model is displayed in the `FAILED` category, its execution stopped.
|
108 |
Make sure you have followed the above steps first.
|
109 |
If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
|
|
|
|
|
|
|
110 |
"""
|
111 |
|
112 |
CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"
|
|
|
107 |
If your model is displayed in the `FAILED` category, its execution stopped.
|
108 |
Make sure you have followed the above steps first.
|
109 |
If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
|
110 |
+
|
111 |
+
- Currently, there is an issue with our pipeline, which is responsible for automatically pushing the evaluation results; therefore, we will manually push them once a day
|
112 |
+
- Until we fix this issue, there may be a delay in your results appearing on the leaderboard, even if the evaluation is successfully completed. Thank you for your patience.
|
113 |
"""
|
114 |
|
115 |
CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"
|