Compare access, license, modality, signal, and scale before a training run.
Showing 26 of 26 datasets · 14 open · 12 restricted · 21 on Hugging Face · fallback catalog
Synchronized first-person and third-person skilled activity
Learning from skilled human demonstrations
Especially relevant when a task needs both wearable camera context and external validation views.
Large-scale daily-life egocentric video
Pretraining egocentric perception
Best treated as a large source corpus rather than a direct robot-action dataset.
Ego4D-style activity sample with narrations
Activity-recognition examples
Good open sample for testing language annotations around egocentric clips.
Apache-2.0 LeRobot bottle-adjustment task
LeRobot conversion tests
One of the more directly robot-task-shaped open HF entries.
First-person affordance labels for manipulation
Affordance pretraining
Useful for dataset curation labels even when source videos are not robot trajectories.
Hand visibility and active-manipulation benchmark
Benchmarking egocentric data quality
Good open-access companion to the gated Egocentric-10K source dataset.
Long-form egocentric video QA
Video-language model evaluation
Not a manipulation training set, but helpful for evaluating whether agents understand long first-person context.
Catalog metadata for first-person manipulation datasets
Dataset registry examples
Best treated as a registry source rather than raw training data.
GoPro first-person pick-and-place trajectories
Pick-and-place benchmark fixtures
Open access but non-commercial license terms apply.
Long-term object tracking in egocentric video
Object persistence in robot tasks
Useful for Bench/Data integration when failures involve losing an object through a manipulation step.
Unscripted kitchen actions from wearable cameras
Kitchen manipulation vocabulary
Still a strong reference point for kitchen-centric manipulation data.
CC-BY household first-person manipulation samples
Residential manipulation examples
Small open-access sample, useful for demos rather than model-scale training.
MIT-licensed industrial first-person video samples
Industrial manipulation examples
Useful for examples and smoke tests; scale is intentionally small.
MIT-licensed preview of egocentric action annotations
Action-label schema tests
Preview-scale dataset, not the full corpus.
Household manipulation with pose annotations
Household skill segmentation
One of the more directly robotics-relevant egocentric datasets in this catalog.
Egocentric dexterous manipulation sample set
Dexterous-hand data demos
Open access on Hugging Face, but non-commercial license terms apply.
MIT-licensed POV robotics video samples
Small open fixture for first-person video ingestion
Small sample dataset, not a large training corpus.
Egocentric video QA for wearable assistants
Agent evaluation over streaming first-person video
Less robot-action focused, but useful for evaluating an agent's temporal grounding.
Multimodal human experience for embodied AI
World model pretraining
Very large and controlled-access; the practical OpenBot path is metadata indexing plus targeted subset pulls.
Multiview egocentric scene reconstruction
View synthesis for wrist/ego cameras
Short recordings, but high camera density and strong reconstruction value.
Small egocentric sample set for manipulation domains
Fast catalog smoke tests
Small but concrete; useful for demos and ingestion tests.
Cross-dataset active labor and hand-presence evaluation
Comparing egocentric corpora before ingest
Open evaluation layer; the larger source datasets may still be gated.
Factory worker first-person video
Industrial manipulation priors
Good candidate for OpenBot Data indexing, dedup, and active-manipulation scoring.
Bimanual manipulation in LeRobot format
Schema validation for LeRobot v3
Small, but excellent for testing catalog pages, loaders, and schema conversions.
LeRobot egocentric hand-tracking sample
Testing LeRobot import paths
Good open sample for OpenBot Data loaders and dataset pages.
Video + audio + IMU egocentric clips
Wearable-assistant evaluation
A practical bridge between video-only egocentric data and robot-ready sensor streams.
OpenBot Data turns raw sources into versioned, replay-ready training data.
