LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
Paper
•
2407.12772
•
Published
•
33
LMMs-Eval
Dataset Collection of LMMs-Eval
-
-
lmms-lab/VQAv2
Viewer • Updated • 770k • 6.82k • 19 -
lmms-lab/MME
Viewer • Updated • 2.37k • 14.9k • 17 -
lmms-lab/DocVQA
Viewer • Updated • 16.6k • 9.88k • 27 -
lmms-lab/MMBench
Viewer • Updated • 24k • 5.51k • 12 -
lmms-lab/textvqa
Viewer • Updated • 45.3k • 9.19k • 8 -
lmms-lab/CMMMU
Viewer • Updated • 12k • 189 • 4 -
lmms-lab/RefCOCO
Viewer • Updated • 17.6k • 786 • 10 -
lmms-lab/egoschema
Viewer • Updated • 15.6k • 2.22k • 1 -
lmms-lab/VideoChatGPT
Viewer • Updated • 3.49k • 1.3k • 7 -
lmms-lab/RealWorldQA
Viewer • Updated • 765 • 5.09k • 3 -
lmms-lab/GQA
Viewer • Updated • 24.2M • 14.7k • 13 -
lmms-lab/POPE
Viewer • Updated • 18k • 11.6k • 6 -
lmms-lab/ai2d
Viewer • Updated • 3.09k • 4.23k • 6 -
lmms-lab/ChartQA
Viewer • Updated • 2.5k • 4.5k • 10 -
lmms-lab/TextCaps
Viewer • Updated • 28.4k • 1.56k • 5 -
lmms-lab/COCO-Caption2017
Viewer • Updated • 45.7k • 1.04k • 11 -
lmms-lab/OK-VQA
Viewer • Updated • 5.05k • 1.01k • 5 -
lmms-lab/COCO-Caption
Viewer • Updated • 81.3k • 391 • 5 -
lmms-lab/HallusionBench
Viewer • Updated • 1.13k • 657 • 4 -
lmms-lab/MMMU
Viewer • Updated • 11.6k • 10.4k • 4 -
lmms-lab/ScienceQA
Viewer • Updated • 12.6k • 5.76k • 3 -
lmms-lab/VizWiz-VQA
Viewer • Updated • 12.3k • 3.05k • 4 -
lmms-lab/MMVet
Viewer • Updated • 218 • 1.9k • 4 -
lmms-lab/RefCOCOplus
Viewer • Updated • 7.58k • 94 • 4 -
lmms-lab/llava-bench-in-the-wild
Viewer • Updated • 60 • 1.9k • 7 -
lmms-lab/SEED-Bench
Viewer • Updated • 18k • 4.34k • 3 -
lmms-lab/RefCOCOg
Viewer • Updated • 12.6k • 76 • 2 -
lmms-lab/NoCaps
Viewer • Updated • 15.1k • 726 • 3 -
lmms-lab/flickr30k
Viewer • Updated • 31.8k • 573 • 9 -
lmms-lab/MMBench_EN
Viewer • Updated • 11.1k • 234 • 3 -
lmms-lab/MMBench_CN
Viewer • Updated • 13.2k • 93 • 3 -
lmms-lab/MP-DocVQA
Viewer • Updated • 10.2k • 371 • 2 -
lmms-lab/DC100_EN
Preview • Updated • 49