ManipArena
ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3 synchronized real-to-sim tasks built via 3D scanning for fair Vision-Language-Action and world-model comparison. Demonstrations are recorded on 5 robot platforms with 3 synchronized RGB cameras (one overhead + two wrist), 56-D proprioception (joint positions/velocities/currents), gripper and mobile-base states, and three-level language annotations, in LeRobot v2.1 format.
- Scale
- 188 hours
- Formats
- lerobot
- License
- Apache-2.0
- Published
- 2026-03-30
Decision summary
teleoperation
Metadata requires review against the official source before publication.
Read the dataset manifest and feature schema.
Catalog assessment
Selection evidence
73/100
Provisional · confidence 48 · 4/6 evaluated
Access and governance
Access and license are declared by the source.
Schema and signal coverage
No machine-readable schema has been verified yet.
Policy training readiness
Observation and action/state signals are declared; alignment quality still depends on sample verification.
View 3 more dimensions
World-model readiness
Temporal observations plus geometry or semantic context are declared; sample alignment remains to be audited.
Failure and recovery readiness
No verified failure/recovery annotation evidence is available yet.
Download and processing readiness
Scale is declared; transfer and processing estimates are not measured.
Review unresolved evidence and next checks
Signal gaps
- Gaze / attention. Not enough evidence is available to classify this signal.
- Feedback / correction / failure. Not enough evidence is available to classify this signal.
Next checks
- Read the dataset manifest and feature schema.
- Run a bounded sample audit before assigning Strong readiness.
Record specifics
Dataset facts
- Source
- ManipArena (SYSU x MBZUAI)
- Evidence
- secondary claim
- Formats
- lerobot
- episodes
- 10812
- hours
- 188
- tasks
- 20
Metadata coverage
Loop signals
5/7 present or partial
No decision-grade evidence captured yet.
unknownNo decision-grade evidence captured yet.
unknownView 5 more signal categories
video · ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3 synchronized real-to-sim tasks built via 3D scanning for fair Vision-Language-Action and world-model comparison. Demonstrations are recorded on 5 robot platforms with 3 synchronized RGB cameras (one overhead + two wrist), 56-D proprioception (joint positions/velocities/currents), gripper and mobile-base states, and three-level language annotations, in LeRobot v2.1 format.
presentee_pose · ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3 synchronized real-to-sim tasks built via 3D scanning for fair Vision-Language-Action and world-model comparison. Demonstrations are recorded on 5 robot platforms with 3 synchronized RGB cameras (one overhead + two wrist), 56-D proprioception (joint positions/velocities/currents), gripper and mobile-base states, and three-level language annotations, in LeRobot v2.1 format.
partiallanguage · has-success-labels · ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3 synchronized real-to-sim tasks built via 3D scanning for fair Vision-Language-Action and world-model comparison. Demonstrations are recorded on 5 robot platforms with 3 synchronized RGB cameras (one overhead + two wrist), 56-D proprioception (joint positions/velocities/currents), gripper and mobile-base states, and three-level language annotations, in LeRobot v2.1 format.
presentsimulation · ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3 synchronized real-to-sim tasks built via 3D scanning for fair Vision-Language-Action and world-model comparison. Demonstrations are recorded on 5 robot platforms with 3 synchronized RGB cameras (one overhead + two wrist), 56-D proprioception (joint positions/velocities/currents), gripper and mobile-base states, and three-level language annotations, in LeRobot v2.1 format.
presentOpen · Apache-2.0 · lerobot
presentEvidence details and provenance
Official signal claims
Schema and annotations
No machine-readable schema facts are captured.
Sample verification
Pending. Metadata does not prove sample coverage, alignment, or file integrity.
curated official source
Integration notes
- Metadata requires review against the official source before publication.
Catalog links