MicroAGI01 Dataset
Household skill segmentation
An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.
Household skill segmentation
One of the more directly robotics-relevant egocentric datasets in this catalog.
Start with an official sample or one task; do not download the full release before schema validation.
Observation and action/state signals are declared; alignment quality still depends on sample verification.
fit 85 · confidence 55
Temporal observations plus geometry or semantic context are declared; sample alignment remains to be audited.
fit 82 · confidence 50
No verified failure/recovery annotation evidence is available yet.
not scored · confidence 15
Verified facts and provenance
Claims, metadata verification, and sample verification are shown separately.
Unknown — no machine-readable schema facts have been captured.
Unknown — metadata conclusions do not prove sample coverage, alignment, or file integrity.
Declared loop signal coverage
Signals inferred from official metadata; Data pipeline verification is still pending.
Observation / ego video
video · depth · camera pose · An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.
Action / hand pose / robot state
camera pose · hand pose · Foxglove layout · Hand-pose action proxy extraction
Gaze / attention
No decision-grade evidence captured yet.
Language intent / task phase
task phase · An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.
Feedback / correction / failure
No decision-grade evidence captured yet.
Sim-real pairing
depth · camera pose · An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.
License / format / access
License required · MicroAGI01 Open Use, No-Resale License v1.0 · MCAP · CSV
Catalog decision scorecard
Access and license are declared by the source.
fit 75 · confidence 85
No machine-readable schema has been verified yet.
not scored · confidence 15
Observation and action/state signals are declared; alignment quality still depends on sample verification.
fit 85 · confidence 55
Temporal observations plus geometry or semantic context are declared; sample alignment remains to be audited.
fit 82 · confidence 50
No verified failure/recovery annotation evidence is available yet.
not scored · confidence 15
The release is very large and no recommended sample/subset is recorded.
fit 30 · confidence 65
Good tasks
Blockers and unresolved evidence
- Gaze / attentionunknownNot enough evidence to classify this signal. Verify metadata or a bounded sample.
- Feedback / correction / failureunknownNot enough evidence to classify this signal. Verify metadata or a bounded sample.
- Read the dataset manifest and feature schema.
- Run a bounded sample audit before assigning Strong readiness.
Raw dataset signals
OpenBot fit
- Household skill segmentation
- Hand-pose action proxy extraction
- Foxglove-to-OpenBot episode conversion
Related models and papers
Model references linked to similar loop signals.
DreamZero / World Action Models
World-action model framing where future visual states and actions are predicted in an aligned policy model.
RDT-1B
Diffusion foundation model for bimanual manipulation that uses large-scale robot data to generate action trajectories.
RT-X
Cross-embodiment RT model family trained from the Open X-Embodiment mixture to study transfer across robots and tasks.
RT-2
Vision-language-action model that transfers web-scale vision-language knowledge into robotic control.
RoboCat
Self-improving generalist robotic agent that collects new demonstrations to improve its own manipulation capabilities.
ACT
Action Chunking with Transformers predicts short action sequences for efficient imitation learning in manipulation tasks.
Integration notes
- One of the more directly robotics-relevant egocentric datasets in this catalog.
- Good target for an OpenBot Data MCAP adapter.