OpenBot
Dataset catalog39 indexed · 26 open · 27 on Hugging Face

Pick datasets by evidence, not link lists.

Compare access, license, modality, signal, and scale before a training run.

Filters

Showing 39 of 39 datasets

AgiBot World 2026Open2026-03-11CC BY-NC-SA 4.0· AgiBot World

Humanoid VLA training

9.36TBsize
Best for

Humanoid VLA training

Check before use

Non-commercial share-alike license; commercial use requires separate legal review or permission.

Selection readiness73evidence confidence 65
~7GBsample
LeRobot v2.1format
AgiBot G2platform
ObservationActionIntentFeedback
VideoDepthActionsRobot stateLanguageTask phaseSkill AnnotationsSuccess Failure+5
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
BridgeData V2Open2023-08-24· UC Berkeley RAIL

Open-vocabulary policies

53K+trajectories
Best for

Open-vocabulary policies

Check before use

A core public baseline for VLA and policy post-training.

Selection readiness77evidence confidence 37
24environments
13skills
ObservationActionIntentSim-real
VideoDepthActionsRobot stateLanguageGoal
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
DROIDOpen2024-03-19· DROID Dataset Team

VLA fine-tuning

350hours
Best for

VLA fine-tuning

Check before use

Strong real-world diversity; verify release subset completeness before processing.

Selection readiness77evidence confidence 37
76Ktrajectories
564scenes
86tasks
ObservationActionIntentSim-real
VideoActionsRobot stateLanguageCamera calibration
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Egocentric Adjust BottleOpen2026-05-02Apache-2.0· Hugging Face · SUZ-tsinghua/egocentric_adjust_bottle

LeRobot conversion tests

10K-100Krows
Best for

LeRobot conversion tests

Check before use

One of the more directly robot-task-shaped open HF entries.

Selection readiness73evidence confidence 48
Roboticstasks
ObservationActionIntentGovernance
ImagesLanguageRobot state
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
EO-Data1.5MOpen2025-08-28· IPEC-COMMUNITY / EO-Robotics

Embodied reasoning

1.5Msamples
Best for

Embodied reasoning

Check before use

Separate EO-Data1.5M training samples from EO-Bench evaluation data.

Selection readiness78evidence confidence 37
Pretrainingrole
Vision + text + actionmodalities
ObservationActionIntentFeedback
VideoImagesLanguageActionsTask phaseFuture state
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
Galaxea Open-World DatasetOpen2025-08-30CC BY-NC-SA 4.0· OpenGalaxea

Mobile manipulation

500+hours
Best for

Mobile manipulation

Check before use

Strong source for connecting subtask annotation to mobile manipulation evaluation.

Selection readiness63evidence confidence 48
11sites
R1 Liteembodiment
ObservationActionIntentFeedback
VideoActionsRobot stateLanguageTask phaseOutcome
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
GM-100Open2026-01-26· Robbyant / LingBot-VLA team

Real-robot VLA evaluation

100tasks
Best for

Real-robot VLA evaluation

Check before use

Author-created benchmark; reported model results are not independent OpenBot reproduction.

Selection readiness73evidence confidence 37
Benchmarkrole
Model authorsource
ObservationActionIntentFeedback
VideoActionsRobot stateTask phaseOutcome
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
LeRobot Community DatasetsOpen2025· Hugging Face LeRobot community

Open VLA pretraining

~10Mframes
Best for

Open VLA pretraining

Check before use

Licenses and annotation quality vary by repository; treat this as a collection with per-source governance.

Selection readiness73evidence confidence 37
487 datasetscurated for SmolVLA
SO100 / SO101common arms
ObservationActionIntentGovernance
VideoActionsRobot stateLanguageTask phase
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
LIBERO-Long LeRobotOpen2026-04-24· Robbyant / LIBERO

Long-horizon policy learning

Post-trainingrole
Best for

Long-horizon policy learning

Check before use

Track as a LIBERO dataset release, not as an unrelated top-level series once versioned Catalog storage is active.

Selection readiness73evidence confidence 37
LIBERO-Longbenchmark
LeRobotformat
ObservationActionIntentFeedback
VideoActionsRobot stateLanguageTask phaseOutcome
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
MicroAGI01License required2026MicroAGI01 Open Use, No-Resale License v1.0· Hugging Face · MicroAGI-Labs/MicroAGI01

Household skill segmentation

676clips
Best for

Household skill segmentation

Check before use

One of the more directly robotics-relevant egocentric datasets in this catalog.

Selection readiness68evidence confidence 48
137tasks
14categories
3.85 TBsize
ObservationActionIntentSim-real
VideoDepthCamera poseHand poseIMUTask phase
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Open X-EmbodimentOpen2023-10-13Dataset-specific; code Apache-2.0· Google DeepMind / Open X-Embodiment collaboration

Cross-embodiment VLA pretraining

22robots
Best for

Cross-embodiment VLA pretraining

Check before use

Licenses differ across constituent datasets and must be checked individually.

Selection readiness73evidence confidence 48
21institutions
527skills
ObservationActionIntentGovernance
VideoActionsRobot stateLanguageTask phase
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
RoboMINDOpen2024-12-18· RoboMIND collaboration

Failure mining

107Ktrajectories
Best for

Failure mining

Check before use

One of the strongest current matches for OpenBot loop-signal analysis.

Selection readiness75evidence confidence 43
479tasks
5Kfailure demos
4embodiments
ObservationActionIntentFeedback
VideoActionsRobot stateLanguageOutcomeFailureTask phase
Policy training readiness85 · c55
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
RoboTwin 2.0Open2024-09-18MIT (code; verify generated asset terms)· RoboTwin Platform

Bimanual VLA post-training

100K+trajectories
Best for

Bimanual VLA post-training

Check before use

This entry covers a generator, released trajectories, and benchmark; keep those artifacts distinct in the future release schema.

Selection readiness77evidence confidence 48
50tasks
2.0release
ObservationActionIntentSim-real
VideoDepthActionsRobot stateTask phaseOutcomeSIM Real
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Xperience-10MGated2026-03-11Apache-2.0· Hugging Face · ropedia-ai/xperience-10m

World model pretraining

10,000hours
Best for

World model pretraining

Check before use

Very large and controlled-access; the practical OpenBot path is metadata indexing plus targeted subset pulls.

Selection readiness77evidence confidence 48
10Mexperiences
2.88BRGB frames
~1 PBscale
ObservationActionIntentSim-real
VideoAudioDepthCamera poseHand poseIMULanguage
Policy training readiness85 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Ego-Exo4DLicense required2023-11-22Ego-Exo4D License Agreement· Ego-Exo4D

Learning from skilled human demonstrations

1,422hours
Best for

Learning from skilled human demonstrations

Check before use

Especially relevant when a task needs both wearable camera context and external validation views.

Selection readiness70evidence confidence 42
800+participants
13cities
131contexts
ObservationActionIntentFeedback
VideoExternal CameraAudioPoseObject masksLanguage
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
EgoStation GoPro Pick-and-PlaceOpen2026-05-12CC-BY-NC· Hugging Face · zeno-labs/egostation-gopro-pick-and-place-v1

Pick-and-place benchmark fixtures

10K-100Krows
Best for

Pick-and-place benchmark fixtures

Check before use

Open access but non-commercial license terms apply.

Selection readiness57evidence confidence 42
Pick-placetasks
ObservationActionIntentGovernance
VideoHand poseTrajectoryActions
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
EgoWorldOpen2026-03-30CC-BY-NC· Hugging Face · haoyang-li/EgoWorld

Schema validation for LeRobot v3

514frames
Best for

Schema validation for LeRobot v3

Check before use

Small, but excellent for testing catalog pages, loaders, and schema conversions.

Selection readiness63evidence confidence 48
2episodes
10 Hzfps
35.1 MBsize
ObservationActionSim-realGovernance
Hand poseMano MeshCamera poseDepthActions
Policy training readiness70 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
EPIC-KITCHENS-100License required2020-06-23EPIC-KITCHENS License· EPIC-KITCHENS

Kitchen manipulation vocabulary

100hours
Best for

Kitchen manipulation vocabulary

Check before use

Still a strong reference point for kitchen-centric manipulation data.

Selection readiness70evidence confidence 42
20Mframes
90Kactions
45environments
ObservationActionIntentGovernance
VideoActionsObjectsNarration
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Kriya Egocentric 100K PreviewOpen2026-03-17MIT· Hugging Face · ankk98/kriya-egocentric-100k

Action-label schema tests

<1Krows
Best for

Action-label schema tests

Check before use

Preview-scale dataset, not the full corpus.

Selection readiness70evidence confidence 42
ObservationActionIntentGovernance
VideoActionsLanguage
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Manus Egocentric SampleOpen2026-01-01CC-BY-NC· Hugging Face · OpenGraphLabs-Research/manus-egocentric-sample

Testing LeRobot import paths

10K-100Krows
Best for

Testing LeRobot import paths

Check before use

Good open sample for OpenBot Data loaders and dataset pages.

Selection readiness57evidence confidence 42
Roboticstasks
ObservationActionFeedbackGovernance
VideoHand poseHand poseActions
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
OBayData Dexterous Manipulation DemoOpen2026-03-18CC-BY-4.0· Hugging Face · obaydata/egocentric-dexterous-manipulation-demo

Dexterous-hand data demos

1K-10Krows
Best for

Dexterous-hand data demos

Check before use

Open access on Hugging Face, but non-commercial license terms apply.

Selection readiness70evidence confidence 42
500train
100test
ObservationActionIntentGovernance
VideoHand poseObjectsDemonstrations
Policy training readiness70 · c55
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
RH20TLicense required2023-07-02Mixed CC BY-SA 4.0 / CC BY-NC 4.0 subsets· Shanghai Jiao Tong University

Contact-rich policy learning

110K+sequences
Best for

Contact-rich policy learning

Check before use

Commercial-use rights differ by subset; privacy-sensitive human recordings are included.

Selection readiness54evidence confidence 48
147tasks
40TB+raw size
ObservationActionSim-realGovernance
VideoDepthActionsRobot stateAudioForceTactileOutcome
Policy training readiness70 · c55
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Ego-1KLicense required2026-01-29Apache-2.0· Hugging Face · facebook/ego-1k

View synthesis for wrist/ego cameras

956clips
Best for

View synthesis for wrist/ego cameras

Check before use

Short recordings, but high camera density and strong reconstruction value.

Selection readiness74evidence confidence 41
491Kframes
5.9Mimages
12cameras
ObservationActionSim-realGovernance
VideoScene MetadataCamera calibration
Policy training readinessUnknown
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Ego-RealmGated2026CC BY 4.0· Hugging Face · Luel-ai/Ego-Realm

Fast catalog smoke tests

108clips
Best for

Fast catalog smoke tests

Check before use

Small but concrete; useful for demos and ingestion tests.

Selection readiness70evidence confidence 35
10hduration
40.65 GBsize
1.08Mframes
ObservationActionAttentionGovernance
VideoAudio
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Ego4DLicense required2021-10-13Ego4D License Agreement· Ego4D

Pretraining egocentric perception

3,670+hours
Best for

Pretraining egocentric perception

Check before use

Best treated as a large source corpus rather than a direct robot-action dataset.

Selection readiness74evidence confidence 41
926wearers
74locations
9countries
ObservationActionAttentionIntent
VideoAudioNarrationGaze3D scanStereo
Policy training readinessUnknown
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
Egocentric Activity SampleOpen2026-04-25CC-BY-4.0· Hugging Face · WhissleAI/egocentric-activity-sample

Activity-recognition examples

<1Krows
Best for

Activity-recognition examples

Check before use

Good open sample for testing language annotations around egocentric clips.

Selection readiness70evidence confidence 35
3tasks
ObservationActionIntentGovernance
VideoNarrationLanguageHand-object
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Egocentric Affordance DatasetOpen2026-02-14CC-BY-NC· Hugging Face · Kavin60606/egocentric-affordance-dataset

Affordance pretraining

10K-100Krows
Best for

Affordance pretraining

Check before use

Useful for dataset curation labels even when source videos are not robot trajectories.

Selection readiness56evidence confidence 41
2tasks
ObservationActionIntentFeedback
ImagesAffordance LabelTask LabelView Label
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
Egocentric-100K EvaluationOpen2025-12-09Apache-2.0· Hugging Face · builddotai/Egocentric-100K-Evaluation

Comparing egocentric corpora before ingest

30Krows
Best for

Comparing egocentric corpora before ingest

Check before use

Open evaluation layer; the larger source datasets may still be gated.

Selection readiness70evidence confidence 35
6 GBsize
3sources
ObservationActionFeedbackGovernance
ImagesHand VisibilityActive ManipulationActive Labor
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Egocentric-10KGated2025-11-09CC-BY-NC· Hugging Face · builddotai/Egocentric-10K

Industrial manipulation priors

10,000hours
Best for

Industrial manipulation priors

Check before use

Good candidate for OpenBot Data indexing, dedup, and active-manipulation scoring.

Selection readiness33evidence confidence 35
1.08Bframes
192,900clips
16.4 TBstorage
ObservationActionFeedbackGovernance
VideoCamera calibrationMetadata
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Egocentric-10K EvaluationOpen2025-11-10CC-BY-4.0· Hugging Face · builddotai/Egocentric-10K-Evaluation

Benchmarking egocentric data quality

30Ksamples
Best for

Benchmarking egocentric data quality

Check before use

Good open-access companion to the gated Egocentric-10K source dataset.

Selection readiness79evidence confidence 35
Egocentric-10Ksource
ObservationActionIntentFeedback
ImagesHand LabelsActive Manipulation LabelsDataset Metadata
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
EgoMMLicense required2026-05-10Apache-2.0· Hugging Face · ldkong/EgoMM

Wearable-assistant evaluation

463hours
Best for

Wearable-assistant evaluation

Check before use

A practical bridge between video-only egocentric data and robot-ready sensor streams.

Selection readiness70evidence confidence 35
55,532clips
22,056narrated
489 GBsize
ObservationIntentFeedbackSim-real
VideoAudioIMUIMUNarration
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
EgoSchemaLicense required2023-08-17MIT· EgoSchema

Video-language model evaluation

250+hours
Best for

Video-language model evaluation

Check before use

Not a manipulation training set, but helpful for evaluating whether agents understand long first-person context.

Selection readiness70evidence confidence 35
5,000+QA pairs
3 minclip length
ObservationActionIntentFeedback
VideoLanguageLanguageTemporal Reasoning Labels
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
EgoStation CatalogOpen2026-05-11CC-BY-NC· Hugging Face · zeno-labs/egostation-catalog-v1

Dataset registry examples

<1Krows
Best for

Dataset registry examples

Check before use

Best treated as a registry source rather than raw training data.

Selection readiness56evidence confidence 41
Catalogrole
ObservationActionIntentGovernance
Dataset MetadataTask phaseCamera TagsLerobot References
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
EgoTracksLicense required2023-05-05Ego4D License Agreement· Ego4D

Object persistence in robot tasks

5.9Kclips
Best for

Object persistence in robot tasks

Check before use

Useful for Bench/Data integration when failures involve losing an object through a manipulation step.

Selection readiness70evidence confidence 35
22.42Ktracks
3.6Ktrain
2.3Kval/test
ObservationActionIntentFeedback
Bounding BoxesObject TemplatesPresence Scores
Policy training readinessUnknown
World-model readinessUnknown
official claim·verified 2026-07-28
Use in Data
Grid Egocentric Residential SamplesOpen2026-05-28CC-BY-4.0· Hugging Face · aryan56789gridai/grid-egocentric-residential-samples

Residential manipulation examples

<1Krows
Best for

Residential manipulation examples

Check before use

Small open-access sample, useful for demos rather than model-scale training.

Selection readiness69evidence confidence 41
Householddomain
Videomodality
ObservationActionIntentGovernance
VideoHousehold Task TagsManipulation Tags
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
Industrial Workplace Egocentric FHD SamplesOpen2026-05-24MIT· Hugging Face · TrainThemAI/Industrial-Workplace-Egocentric-FHD-Samples

Industrial manipulation examples

<1Krows
Best for

Industrial manipulation examples

Check before use

Useful for examples and smoke tests; scale is intentionally small.

Selection readiness69evidence confidence 41
EN/ESlanguages
Industrialdomain
ObservationActionIntentGovernance
VideoIndustrial TasksDemonstrationsWorkplace Labels
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
LingBot Masked Depth Modeling DataOpen2026-03-21· Robbyant

Depth completion

3.0Msamples
Best for

Depth completion

Check before use

Perception dataset rather than an action-policy training corpus; RobbyVla is the manipulation-related subset.

Selection readiness82evidence confidence 30
2.0Mreal
1.0Msimulated
ObservationActionSim-realGovernance
ImagesDepthCamera calibrationPoint cloudSIM Real
Policy training readinessUnknown
World-model readiness82 · c50
official claim·verified 2026-07-28
Use in Data
POV Egocentric Video Robotics FHD SamplesOpen2026MIT· Hugging Face · TrainThemAI/POV-Egocentric-Video-Robotics-FHD-Samples

Small open fixture for first-person video ingestion

<1Krows
Best for

Small open fixture for first-person video ingestion

Check before use

Small sample dataset, not a large training corpus.

Selection readiness69evidence confidence 41
EN/ESlanguages
FHDquality
ObservationActionIntentGovernance
VideoTask phaseDemonstrationsRobotics Labels
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data
Wearable AIGated2026-05-15MIT· Hugging Face · facebook/wearable-ai

Agent evaluation over streaming first-person video

2,100clips
Best for

Agent evaluation over streaming first-person video

Check before use

Less robot-action focused, but useful for evaluating an agent's temporal grounding.

Selection readiness69evidence confidence 41
3tasks
~317 GBsize
ObservationActionIntentFeedback
VideoLanguageLanguageLanguageTask phase
Policy training readinessUnknown
World-model readiness68 · c50
official claim·verified 2026-07-28
Use in Data

Want these datasets cleaned and versioned?

OpenBot Data turns raw sources into versioned, replay-ready training data.

Explore OpenBot Data