FSMBench

university

AI & ML interests

Evaluating and Benchmarking Large Multimodal Models

Recent Activity

corpaul authored a paper 5 months ago

Large Language Models are Pretty Good Zero-Shot Video Game Bug Detectors

corpaul authored a paper 5 months ago

Zoom is what you need: An empirical study of the power of zoom and spatial biases in image classification

corpaul authored a paper 5 months ago

CLIP meets GamePhysics: Towards bug identification in gameplay videos using zero-shot transfer learning

View all activity

spaces 3

FSMBenchLeaderboard

Heatmaps

No application file

Something

models

None public yet

datasets 13

FSMBench/fsmbench_reborn_subset_864

Viewer • Updated May 13, 2024 • 864 • 40

FSMBench/fsmbench_reborn_12k

Viewer • Updated May 13, 2024 • 12.8k • 38

FSMBench/simple_fsm_vision_qa

Viewer • Updated May 6, 2024 • 1.92k • 30

FSMBench/fsmbench_what_will_be_the_state_12K_with_output_instruction

Viewer • Updated May 5, 2024 • 12.8k • 29

FSMBench/fsmbench_intersection_set_2

Viewer • Updated Apr 21, 2024 • 1.58k • 32

FSMBench/fsmbench_what_will_be_the_state_12K_oneshot

Viewer • Updated Apr 16, 2024 • 12.8k • 34

FSMBench/fsmbench_intersection_set_1

Viewer • Updated Apr 16, 2024 • 500 • 39

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step_image

Viewer • Updated Apr 13, 2024 • 12.8k • 30

FSMBench/fsmbench_what_will_be_the_state_12K_image

Viewer • Updated Mar 23, 2024 • 12.8k • 31

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step

Viewer • Updated Mar 18, 2024 • 12.8k • 31