OpenBot
Back to datasets
Mobile Robots datasetOpenReadiness 93 · confidence 51

AgiBot World 2026 Dataset

Large-scale real-world humanoid interaction data

9.36TBsize

A multi-scenario real-world dataset with LeRobot structure, key frames, instruction segments, and paired digital-twin resources.

Best for

Humanoid VLA training

Not for / blocker

Non-commercial share-alike license; commercial use requires separate legal review or permission.

Download decision

Start with an official sample or one task; do not download the full release before schema validation.

Policy learningUseful

Has observation, action/state proxy, and task or language context.

fit 85 · confidence 55

World modelUseful

Has visual observations plus geometry, calibration, depth, or reconstruction cues.

fit 82 · confidence 55

WAMUseful

Contains observation, intent, action/state, and feedback-like supervision.

fit 88 · confidence 55

Verified facts and provenance

Claims, metadata verification, and sample verification are shown separately.

Official dataset card: Features Schema and Annotation Layers
Official claim · signals
VideoDepthActionsRobot stateLanguageTask phaseSkill AnnotationsSuccess FailureIntervention TakeoverRecoveryObject Bounding BoxesKEY FramesSIM Real
Metadata verified · schema / annotations
is_result_succeedError FrameSuccess FrameIntervention Frametake_overerror_causerestorableinstruction_segmentsTask Frame2D Bounding Boxobservation.stateactionobservation.images.*task_indextimestamp
Sample / pipeline verification

Unknown — metadata conclusions do not prove sample coverage, alignment, or file integrity.

Declared loop signal coverage

Signals inferred from official metadata; Data pipeline verification is still pending.

6/7 categories present or partial

Observation / ego video

video · depth

present

Action / hand pose / robot state

actions · robot state · Large-scale real-world humanoid interaction data

present

Gaze / attention

No decision-grade evidence captured yet.

unknown

Language intent / task phase

language · task phase · skill annotations · Long-horizon task decomposition

present

Feedback / correction / failure

success/failure · Failure and intervention mining · Failure, success, intervention, takeover, and recovery fields are declared, but their coverage is not sample-verified by OpenBot.

present

Sim-real pairing

depth · sim-real · Sim-real pairing

present

License / format / access

Open · CC BY-NC-SA 4.0 · LeRobot v2.1 · MP4

present

Model and task fit · OpenBot inference

Policy learningUseful

Has observation, action/state proxy, and task or language context.

fit 85 · confidence 55

World modelUseful

Has visual observations plus geometry, calibration, depth, or reconstruction cues.

fit 82 · confidence 55

WAMUseful

Contains observation, intent, action/state, and feedback-like supervision.

fit 88 · confidence 55

Failure miningUseful

Has failure/evaluation-style labels with action or manipulation context.

fit 82 · confidence 55

Good tasks

video-language reasoning3D / sim-real alignmentlong-horizon planningskill-level imitation learningfailure and recovery miningobject-conditioned policy / groundinghumanoid whole-body / dual-arm learning

Blockers and unresolved evidence

  • Gaze / attentionunknown
    Not enough evidence to classify this signal. Verify metadata or a bounded sample.

Raw dataset signals

VideoDepthActionsRobot stateLanguageTask phaseSkill AnnotationsSuccess FailureIntervention TakeoverRecoveryObject Bounding BoxesKEY FramesSIM Real

OpenBot fit

  • Humanoid VLA training
  • Hierarchical policy learning
  • Skill-level imitation learning
  • Long-horizon task decomposition
  • Single-instruction LeRobot training
  • Object-conditioned policy
  • Language-region grounding
  • Failure and intervention mining
  • Sim-real pairing

Related models and papers

Model references linked to similar loop signals.

Integration notes

  • Non-commercial share-alike license; commercial use requires separate legal review or permission.
  • The official card provides a roughly 7GB task_3777 sample; validate this before downloading the 9.36TB full release.
  • Failure, success, intervention, takeover, and recovery fields are declared, but their coverage is not sample-verified by OpenBot.

Related by signals