text
Excited to bring our benchmarking leaderboard of >100 LLM API endpoints to HF! 
Excited to bring our benchmarking leaderboard of >100 LLM API endpoints to HF! 
new_line
new_line
text
Speed and price are often just as important as quality when building applications with LLMs. We bring together all the data you need to consider all three when you need to pick a model and API provider.
Speed and price are often just as important as quality when building applications with LLMs. We bring together all the data you need to consider all three when you need to pick a model and API provider.
new_line
new_line
text
Coverage:
Coverage:
new_line
text
‣ Quality (Index of evals, MMLU, Chatbot Arena, HumanEval, MT-Bench)
‣ Quality (Index of evals, MMLU, Chatbot Arena, HumanEval, MT-Bench)
new_line
text
‣ Throughput (tokens/s: median, P5, P25, P75, P95)
‣ Throughput (tokens/s: median, P5, P25, P75, P95)
new_line
text
‣ Latency (TTFT: median, P5, P25, P75, P95)
‣ Latency (TTFT: median, P5, P25, P75, P95)
new_line
text
‣ Context window
‣ Context window
new_line
text
‣ OpenAI library compatibility
‣ OpenAI library compatibility
new_line
new_line
text
Link to Space: 
Link to Space: 
resource
https://huggingface.co/spaces/ArtificialAnalysis/LLM-Performance-Leaderboard
space
ArtificialAnalysis/LLM-Performance-Leaderboard
https://huggingface.co/spaces/ArtificialAnalysis/LLM-Performance-Leaderboard
new_line
new_line
text
Blog post: 
Blog post: 
link
https://huggingface.co/blog/leaderboard-artificial-analysis
https://huggingface.co/blog/leaderboard-artificial-analysis
Excited to bring our benchmarking leaderboard of >100 LLM API endpoints to HF! 

Speed and price are often just as important as quality when building applications with LLMs. We bring together all the data you need to consider all three when you need to pick a model and API provider.

Coverage:
‣ Quality (Index of evals, MMLU, Chatbot Arena, HumanEval, MT-Bench)
‣ Throughput (tokens/s: median, P5, P25, P75, P95)
‣ Latency (TTFT: median, P5, P25, P75, P95)
‣ Context window
‣ OpenAI library compatibility

Link to Space: https://huggingface.co/spaces/ArtificialAnalysis/LLM-Performance-Leaderboard

Blog post: https://huggingface.co/blog/leaderboard-artificial-analysis
🔥
jeffboudier victor Kukedlc clefourrier Ijithad ajibawa-2023 ShahabVFX not-lain
❤️
clefourrier PineappleParadiseDreams not-lain