Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
45 Open 820 Closed
45 Open 820 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add LENS dataset support
#1421 opened Jan 30, 2026 by songlier Loading…
bench format update
#1420 opened Jan 29, 2026 by sjarvie Loading…
[Benchmark] Support VLADBench
#1415 opened Jan 24, 2026 by Depth2World Loading…
[Fix] Optimize the evaluation process for OCR-Reasoning
#1413 opened Jan 24, 2026 by shannanyinxiang Loading…
[Benchmark] Support ScienceOlympiad Galaxy10DECaLS VRSBench
#1410 opened Jan 21, 2026 by zhouyujin Loading…
Support asclepius benchmark
#1408 opened Jan 18, 2026 by o0t1ng0o Loading…
Support CoreCognition
#1407 opened Jan 15, 2026 by ZTWHHH Loading…
[Benchmark & Fix] add support for VLMs Are Biased benchmark and fix lint for jtvl
#1406 opened Jan 15, 2026 by FangXinyu-0913 Loading…
1
granite vision fix for transformers 4.57.3
#1404 opened Jan 13, 2026 by alfassy Loading…
[Benchmark] Support Asclepius
#1403 opened Jan 13, 2026 by StevenSU4 Loading…
[Update] Fix warning in Video-MME, unisvg timeout and increase max line width
#1399 opened Jan 9, 2026 by mzr1996 Loading…
[Benchmark] Add Design2Code
#1395 opened Jan 5, 2026 by yanghtr Loading…
[Model] Support CoVT series
#1394 opened Jan 3, 2026 by Wakals Loading…
[Benchmark] Add AV-SpeakerBench
#1393 opened Jan 3, 2026 by plnguyen2908 Loading…
1
[Model]&[Benchmark] Add Moondream3 & DeepSeek-OCR Support; Add Fox OCR Benchmark Support
#1392 opened Jan 2, 2026 by yuxuanfanOrion Loading…
[Benchmark]Add TextHalu-Bench
#1385 opened Dec 28, 2025 by Sammy20207109 Loading…
1
feat: add benchmark groundingme
#1382 opened Dec 25, 2025 by lirang04 Loading…
anno-qwen-pixels
#1381 opened Dec 25, 2025 by The-Martyr Loading…
[Benchmark] Support SArena Benchmark
#1371 opened Dec 23, 2025 by JoeLeelyf Loading…
[Fix] Fix SArena evaluation
#1364 opened Dec 17, 2025 by mzr1996 Loading…
Add SGI-Bench-1.0
#1358 opened Dec 15, 2025 by vaporhug Loading…
6
[Benchmark] Add VTCbench
#1355 opened Dec 14, 2025 by bjzhb666 Loading…
2
[Model] Add KVL model support
#1354 opened Dec 11, 2025 by amoeba04 Loading…
2
add self leaderboard api
#1350 opened Dec 5, 2025 by Graysonicc Loading…
[Benchmark] Support MVU_Eval
#1348 opened Dec 5, 2025 by Tianhao-Peng Loading…
1
ProTip! Mix and match filters to narrow down what you’re looking for.