Spaces:
Runtime error
Runtime error
caesar-one
commited on
Commit
ยท
af20151
1
Parent(s):
1f93c1a
Small improvements.
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
---
|
2 |
title: Italian Open LLM Leaderboard
|
3 |
-
emoji:
|
4 |
colorFrom: red
|
5 |
colorTo: green
|
6 |
sdk: streamlit
|
@@ -15,7 +15,7 @@ license: apache-2.0
|
|
15 |
Italian leaderboard
|
16 |
|
17 |
## Leaderboard
|
18 |
-
| Model Name | Year | Publisher |
|
19 |
|--------------------------------------------------------------------------------------------|------|-------------------------------------------|-------------|--------------|-------|------------------|---------------|---------------|---------------|------------------------|-------------------------|--------------------|---------------------|-------------------------|
|
20 |
| [DanteLLM](https://huggingface.co/rstless-research/DanteLLM-7B-Instruct-Italian-v0.1-GGUF) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 47.52 | 47.34 | 47.69 | 47.05 | 48.27 | 41.89 | 47.01 | 47.99 | 47.79 | 52.41 |
|
21 |
| [OpenDanteLLM](https://huggingface.co/rstless-research/) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 45.97 | 45.13 | 46.80 | 44.25 | 46.89 | 41.72 | 46.76 | 46.49 | 46.75 | 48.06 |
|
@@ -47,7 +47,7 @@ Italian leaderboard
|
|
47 |
- [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
|
48 |
- [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
|
49 |
- [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
|
50 |
-
- [
|
51 |
|
52 |
\* Equal contribution.
|
53 |
### Ack
|
|
|
1 |
---
|
2 |
title: Italian Open LLM Leaderboard
|
3 |
+
emoji: ๐
|
4 |
colorFrom: red
|
5 |
colorTo: green
|
6 |
sdk: streamlit
|
|
|
15 |
Italian leaderboard
|
16 |
|
17 |
## Leaderboard
|
18 |
+
| Model Name | Year | Publisher | # Params | Lang. | Avg. | Avg. (0-shot) | Avg. (N-shot) | MMLU (0-shot) | MMLU (5-shot) | ARC-C (0-shot) | ARC-C (25-shot) | HellaSwag (0-shot) | HellaSwag (10-shot) | TruthfulQA (0-shot) |
|
19 |
|--------------------------------------------------------------------------------------------|------|-------------------------------------------|-------------|--------------|-------|------------------|---------------|---------------|---------------|------------------------|-------------------------|--------------------|---------------------|-------------------------|
|
20 |
| [DanteLLM](https://huggingface.co/rstless-research/DanteLLM-7B-Instruct-Italian-v0.1-GGUF) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 47.52 | 47.34 | 47.69 | 47.05 | 48.27 | 41.89 | 47.01 | 47.99 | 47.79 | 52.41 |
|
21 |
| [OpenDanteLLM](https://huggingface.co/rstless-research/) | 2023 | RSTLess (Sapienza University of Rome) | 7B | Italian FT | 45.97 | 45.13 | 46.80 | 44.25 | 46.89 | 41.72 | 46.76 | 46.49 | 46.75 | 48.06 |
|
|
|
47 |
- [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
|
48 |
- [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
|
49 |
- [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
|
50 |
+
- [Prof. Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
|
51 |
|
52 |
\* Equal contribution.
|
53 |
### Ack
|
main.py
CHANGED
@@ -230,7 +230,7 @@ def filter_dataframe_by_column_values(df: pd.DataFrame) -> pd.DataFrame:
|
|
230 |
|
231 |
|
232 |
def setup_basic():
|
233 |
-
title = "
|
234 |
|
235 |
st.set_page_config(
|
236 |
page_title=title,
|
@@ -240,7 +240,7 @@ def setup_basic():
|
|
240 |
st.title(title)
|
241 |
|
242 |
st.markdown(
|
243 |
-
"The Italian LLM Leaderboard published along with the paper DanteLLM: Let's Push Italian LLM Research Forward! ๐ค๐ฎ๐น๐ (LREC-
|
244 |
)
|
245 |
|
246 |
def setup_leaderboard(readme: str):
|
@@ -319,7 +319,7 @@ def setup_disclaimer():
|
|
319 |
- [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
|
320 |
- [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
|
321 |
- [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
|
322 |
-
- [
|
323 |
|
324 |
\*Equal contribution
|
325 |
"""
|
|
|
230 |
|
231 |
|
232 |
def setup_basic():
|
233 |
+
title = "๐ Italian LLM-Leaderboard ๐ฎ๐น๐ค"
|
234 |
|
235 |
st.set_page_config(
|
236 |
page_title=title,
|
|
|
240 |
st.title(title)
|
241 |
|
242 |
st.markdown(
|
243 |
+
"The Italian Open LLM Leaderboard published along with the paper DanteLLM: Let's Push Italian LLM Research Forward! ๐ค๐ฎ๐น๐ (LREC-COLING 2024) \n"
|
244 |
)
|
245 |
|
246 |
def setup_leaderboard(readme: str):
|
|
|
319 |
- [Andrea Bacciu](https://www.linkedin.com/in/andreabacciu/)* (Work done prior joining Amazon)
|
320 |
- [Cesare Campagnano](https://www.linkedin.com/in/caesar-one/)*
|
321 |
- [Giovanni Trappolini](https://www.linkedin.com/in/giovanni-trappolini/)
|
322 |
+
- [Prof. Fabrizio Silvestri](https://www.linkedin.com/in/fabrizio-silvestri-a6b0391/)
|
323 |
|
324 |
\*Equal contribution
|
325 |
"""
|