JMMMU

non-profit

https://mmmu-japanese-benchmark.github.io/JMMMU/

AI & ML interests

None defined yet.

Recent Activity

AtsuMiyai submitted a paper about 15 hours ago

360CityArena: A Realistic Virtual Urban Navigation Benchmark for Embodied Agents

AtsuMiyai authored a paper 4 months ago

Paper Reconstruction Evaluation: Evaluating Presentation and Hallucination in AI-written Papers

AtsuMiyai authored a paper 8 months ago

JMMMU-Pro: Image-based Japanese Multi-discipline Multimodal Understanding Benchmark via Vibe Benchmark Construction

View all activity

Papers

JMMMU-Pro: Image-based Japanese Multi-discipline Multimodal Understanding Benchmark via Vibe Benchmark Construction

View all Papers

JMMMU 's Spaces 2

JMMMU-Pro Leaderboard

Evaluating LMMs on Image-based Japanese VQA

JMMMU Leaderboard

Evaluating LMMs on Japanese subjects