Submit a dataset
Maintainers: add a corpus or update access, license, and scale facts at the official source.
contact@openbot.ai297 published datasets
A complete server-rendered directory of the current public Catalog. Use the main datasets page when you need search, filters, and comparisons.
lerobot · 2026-06-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "fps": 30, "features": { "observation.state": { "dtype": "float32", "shape": [ 14 ], "names": [ "leftarmjoint1", "leftarmjoint2", "leftarmjoint3", "leftarmjoint4", "leftarmjoint5"… See the full description on the dataset page:…
lerobot · 2026-06-29
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "fps": 30, "features": { "observation.state": { "dtype": "float32", "shape": [ 14 ], "names": [ "leftarmjoint1", "leftarmjoint2", "leftarmjoint3", "leftarmjoint4", "leftarmjoint5"… See the full description on the dataset page:…
lerobot · 2026-06-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "fps": 30, "features": { "observation.state": { "dtype": "float32", "shape": [ 14 ], "names": [ "leftarmjoint1", "leftarmjoint2", "leftarmjoint3", "leftarmjoint4", "leftarmjoint5"… See the full description on the dataset page:…
UC Berkeley / MIT / Amazon FAR / CMU / XDOF · 2026-06-25
ABC-130k is an open bimanual robot manipulation dataset released with the paper 'Scalable Behavior Cloning with Open Data, Training, and Evaluation'. It contains roughly 130,919 episodes (43,090 annotated) totaling about 3,598 hours collected on bimanual YAM stations with two 6-DoF arms and parallel-jaw grippers, spanning ~195 tasks such as pick-and-place,…
FFTAI · 2025
ActionNet: A Dataset for Dexterous Bimanual Manipulation
Official source · 2023
Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perception
Official source · 2024
Aria Everyday Activities Dataset
AgiBot (Zhiyuan Robotics) · 2026-03-01
AgiBot World 2026 is the latest release of the AgiBot World embodied-AI dataset, succeeding the earlier Alpha/Beta releases. It is collected in real-world commercial, home, and general-purpose environments using the AGIBOT G2 wheeled humanoid with dual 7-DOF force-controlled arms, capturing synchronized RGB(D), LiDAR point clouds, tactile, IMU, and…
Official source · 2025
AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
agibot-world · 2026-03-11
AgiBot World 2026 Real-World Embodied Intelligence Dataset Overview As robotics research advances into real-world scenarios, the demand for authentic, high-quality data has become increasingly urgent. Following AGIBOT WORLD's "ImageNet moment," we now release the AGIBOT WORLD 2026 dataset. Built upon massive real-world scenes, it systematically spans…
AIRoA (AI Robot Association) · 2025-09-29
The AIRoA MoMa Dataset is a large-scale, real-world dataset for mobile manipulation collected with the Toyota Human Support Robot (HSR) via leader-follower teleoperation in household environments. It contains 25,469 episodes (~94 hours) sampled at 30 Hz, with synchronized RGB images from head and wrist cameras, joint states, six-axis wrist force-torque…
Official source · 2025
AIST Bimanual Manipulation Dataset
CMU AirLab · 2020-07-01
ALFA (AirLab Failure and Anomaly Dataset) from CMU's AirLab is a real-world flight dataset for fault detection and isolation (FDI) and anomaly detection (AD) on a fixed-wing UAV. It contains processed data for 47 autonomous flights covering eight fault types: 23 sudden full engine (power loss) failures and 24 scenarios of seven control-surface (actuator)…
tonyzhaozh · 2023
Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware
Stanford · 2023-04-23
Bimanual teleoperated demonstrations of fine manipulation tasks.
Official source · 2024
ALOHA Unleashed: A Simple Recipe for Robot Dexterity
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "aloha", "totalepisodes": 18, "totalframes": 67500, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:18" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-09-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1, "totalframes": 3750, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:1" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath": null, "features": {…
lerobot · 2024-03-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 25000, "totaltasks": 1, "totalvideos": 50, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-05-13
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 25000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-03-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 50, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-05-13
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-03-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 50, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-05-13
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-03-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-05-13
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "aloha", "totalepisodes": 50, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2024-05-04
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 49, "totalframes": 29400, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:49" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-05-05
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 100, "totalframes": 60000, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:100" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-05-04
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 50, "totalframes": 35000, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:50" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-05-04
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 49, "totalframes": 34300, "totaltasks": 1, "chunkssize": 1000, "fps": 50, "splits": { "train": "0:49" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
zc-alexfan · 2022
ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation
Armnet · 2026-07-27
ArmnetBench v0.1 is a real-world manipulation benchmark: 7 policies run on a fleet of low-cost SO-101 cells, with every episode human-scored. It is released as evaluation data rather than a training corpus, which makes it unusual here — most of the catalog is demonstrations, and this is what happens when policies actually try. What is in it. 3,718 episodes…
assembly-101 · 2022
Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities
facebookresearch · 2023
AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation
Official source · 2026
VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulation
google-research · 2022
BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning
lerobot · 2024-07-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1647, "totalframes": 42328, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:1647" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-08-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 7331, "totalframes": 156012, "totaltasks": 1, "chunkssize": 1000, "fps": 5, "splits": { "train": "0:7331" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-27
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 11834, "totalframes": 610907, "totaltasks": 1, "chunkssize": 1000, "fps": 3, "splits": { "train": "0:11834" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 2955, "totalframes": 241059, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:2955" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
yanlai00 · 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets
Berkeley · 2023-08-24
A large dataset of WidowX manipulation in diverse kitchen and tabletop scenes.
University of Freiburg · 2022-12-01
CALVIN (Composing Actions from Language and Vision) is an open-source PyBullet-simulated benchmark for learning long-horizon, language-conditioned continuous-control manipulation policies with a Franka Panda arm. It spans four tabletop environments (A, B, C, D), 34 manipulation tasks, and ~1000 crowd-sourced language annotations, with evaluation rollouts…
CaptainCook4D · 2023
CaptainCook4D: A Dataset for Understanding Errors in Procedural Activities
gsig · 2018
Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videos
Official source · 2026
ChildLens: An egocentric video dataset for activity analysis in children
Official source · 2008
Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database
Skoltech — Intelligent Space Robotics Laboratory · 2025-03-03
CognitiveDrone is a simulated UAV vision-language-action dataset from Skoltech's Intelligent Space Robotics Laboratory, built to train drones on tasks that require reasoning rather than pure flight control. Each trajectory spawns the quadrotor before a set of virtual gates and asks it to fly through the correct one by solving an embedded cognitive task,…
lerobot · 2026-07-16
Lerobot Community Datasets v3 - A Cross-Embodiment Pretraining Dataset for Vision Language Action Models A large-scale robotics dataset for vision-language-action learning, featuring 791 datasets across 46 robot types, enabling cross-embodiment pretraining for generalist robot policies. Overview This is a crowdsourced, open-source dataset compiled from 235…
lerobot · 2024-07-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 139, "totalframes": 8277, "totaltasks": 3, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:139" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
RekaAI · 2026
CS2-10k: A Large-Scale Egocentric Counter-Strike 2 Dataset
Official source · 2026
Official catalog record.
tianheyu927 · 2018
One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning
Fanqi-Lin · 2025
Data Scaling Laws in Imitation Learning for Robotic Manipulation
BAAI-Humanoid · 2026
DECO: Decoupled Multimodal Diffusion Transformer for Bimanual Dexterous Manipulation with a Plugin Tactile Adapter
NVIDIA Research (with UT Austin and UC San Diego) · 2024-10-31
DexMimicGen is an automated data-generation system that synthesizes large-scale trajectory datasets for bimanual dexterous manipulation from a handful of human teleoperation demonstrations. It generated over 21,000 demonstrations from 60 source human demos across 9 simulation tasks in robosuite/MuJoCo, spanning three embodiments (bimanual Panda arms with…
ZZongzheng0918 · 2026
Dexora: Open-source VLA for High-DoF Bimanual Dexterity
real-stanford · 2025
DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulation
dexwild · 2025
DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies
NVIDIA (with University of Washington) · 2021-04-09
DexYCB is a large-scale RGB-D dataset of 582,000 frames capturing 10 human subjects grasping 20 objects from the YCB-Video set, recorded synchronously from 8 calibrated Intel RealSense D415 cameras around a tabletop (640x480 @ 30fps, 1,000 trials total). Each frame is annotated with segmentation masks, 6D object poses, MANO hand pose, and 2D/3D hand joints.…
NVIDIA · 2026-02-06
The publicly released dataset accompanying DreamDojo, NVIDIA's generalist robot world model (arXiv 2602.06949, ICML 2026). DreamDojo is pretrained on DreamDojo-HV — a 44.7k-hour in-house egocentric human-video corpus that is not publicly released. What is released (Feb 2026) is the GR-1 post-training data: teleoperated trajectories on the Fourier GR-1…
DROID Collaboration (Stanford, UC Berkeley, et al. — 13 institutions) · 2024-03-19
DROID (Distributed Robot Interaction Dataset) is a large-scale in-the-wild robot manipulation dataset of 76,000 teleoperated demonstration trajectories (~350 hours), collected across 564 scenes and 84 tasks by 50 collectors over 12 months in North America, Asia, and Europe (13 institutions). Every episode uses a standardized Franka Panda 7-DoF arm with two…
lerobot · 2025-07-16
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "Franka", "totalepisodes": 95658, "totalframes": 27630375, "totaltasks": 49630, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 500, "fps": 15, "splits": { "train": "0:95658" }, "datapath":…
Hugging Face · facebook/ego-1k · 2026-01-29
A synchronized 12-camera egocentric dataset for neural 3D/4D reconstruction, hand-object interaction, and novel-view synthesis.
Official source · 2020
EGO-CH: Dataset and Fundamental Tasks for Visitors Behavioral Understanding Using Egocentric Vision
Official source · 2021
Ego-Deliver: A Large-Scale Dataset for Egocentric Video Analysis
Meta FAIR (Project Aria) and 15+ university partners · 2023-11-30
Ego-Exo4D is a large-scale multimodal, multiview video dataset of skilled human activities (cooking, music, soccer, health, basketball, dance, bike repair, rock climbing) captured simultaneously from first-person Aria glasses and third-person GoPro cameras. It contains 1,286.3 hours of video from 740 camera wearers across 13 cities and 123 scene contexts,…
Official source · 2025
Ego-EXTRA: video-language Egocentric Dataset for EXpert-TRAinee assistance
Hugging Face · Luel-ai/Ego-Realm · 2026
A compact Pineye-camera video set covering horticulture, kitchen, and laundry clips for quick first-person manipulation experiments.
Official source · 2026
Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
Meta AI (Facebook AI Research) and academic consortium · 2022-10-01
Ego4D is a massive-scale dataset of 3,670 hours of daily-life egocentric (first-person) video captured by 923 unique camera wearers across 74 locations in 9 countries, built by a consortium of Facebook AI (Meta) and 13 universities. Portions include audio, 3D environment meshes, eye gaze, stereo, multi-camera footage, IMU, and dense textual narrations,…
sanweiliti · 2021
EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices
Official source · 2018
Egocentric Shopping Cart Localization
Hugging Face · WhissleAI/egocentric-activity-sample · 2026-04-25
A CC-BY-4.0 sample dataset for egocentric activity recognition, visual QA, temporal localization, narrations, hands, and objects.
Hugging Face · SUZ-tsinghua/egocentric_adjust_bottle · 2026-05-02
A LeRobot-style robotics dataset for an egocentric bottle adjustment task, packaged as Parquet with image, text, and timeseries modalities.
Hugging Face · Kavin60606/egocentric-affordance-dataset · 2026-02-14
A CC-BY-4.0 egocentric image dataset with affordance, task, and view labels for robotics and embodied-AI perception tasks.
Hugging Face · builddotai/Egocentric-10K · 2025-11-09
A large in-the-wild factory dataset with head-mounted 1080p videos, camera intrinsics, and WebDataset shards.
Hugging Face · builddotai/Egocentric-10K-Evaluation · 2025-11-10
An Apache-2.0 evaluation dataset for measuring hand presence and active object manipulation in first-person industrial frames.
builddotai · 2025
Egocentric-100K Dataset Release
Hugging Face · builddotai/Egocentric-100K-Evaluation · 2025-12-09
An Apache-2.0 benchmark comparing Egocentric-100K, Ego4D, and EPIC-KITCHENS samples for hand visibility, active manipulation, and active labor.
facebookresearch · 2020
EgoCom: A Multi-Person Multi-Modal Egocentric Communications Dataset
suriyachaudary · 2016
First Person Action Recognition Using Deep Learned Descriptors
Apple · 2025-05-16
EgoDex is a large-scale egocentric human manipulation dataset from Apple, comprising 829 hours of 1080p 30Hz video (~90M frames) recorded with Apple Vision Pro. It pairs each frame with 3D pose annotations for the head, upper body, and hands (68 joints) via on-device tracking, plus camera intrinsics and natural-language task descriptions. The data spans 194…
Official source · 2017
Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor
zhenqis123 · 2026
EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation
Official source · 2026
EgoEngine: From Egocentric Human Videos to High-Fidelity Dexterous Robot Demonstrations
ZJUWang01 · 2026
EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras
iSEE-Laboratory · 2024
EgoExo-Fitness: Towards Egocentric and Exocentric Full-Body Action Understanding
hyf015 · 2024
EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World
ardamamur · 2025
EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding
3dlg-hcvc · 2026
EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates
Official source · 2018
EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition
Official source · 2015
Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions
owenzlz · 2022
Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applications
Official source · 2026
EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal
Rice RobotPI Lab · 2026-06-16
EgoInfinity is not a static dataset but a modular, upgradable data engine: it takes ordinary internet video of people manipulating objects and automatically recovers metric 4D hand–object interaction, then retargets that motion into executable robot joint trajectories — no manual annotation and no depth sensors. Runs over Meta FAIR's Action100M corpus —…
EvolvingLMMs-Lab · 2025
EgoLife: Towards Egocentric Life Assistant
Official source · 2026
EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks
Official source · 2026
EgoMAGIC: An Egocentric Video Field Medicine Dataset for Training Perception Algorithms
HeqianQiu · 2025
EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real World
SimarKareer · 2024
EgoMimic: Scaling Imitation Learning via Egocentric Video
Hugging Face · ldkong/EgoMM · 2026-05-10
A tri-modal egocentric dataset built from EgoLife and Ego-Exo4D sources, packaged into fixed-duration clips with optional narrations.
facebookresearch · 2023
EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding
Y-Haneji · 2024
EgoOops: A Dataset for Mistake Action Detection from Egocentric Videos Referring to Procedural Texts
ai4ce · 2022
Egocentric Prediction of Action Target in 3D
Official source · 2024
EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision
EgoSchema · 2023-08-17
A diagnostic video-language benchmark derived from Ego4D, designed to test temporal and causal reasoning over long first-person videos.
JackYFL233 · 2026
Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation
Hugging Face · zeno-labs/egostation-catalog-v1 · 2026-05-11
A CC-BY-NC-4.0 catalog dataset for egocentric first-person manipulation data, including GoPro pick-and-place metadata.
Hugging Face · zeno-labs/egostation-gopro-pick-and-place-v1 · 2026-05-12
A non-gated CC-BY-NC-4.0 LeRobot-style dataset with GoPro first-person manipulation, hand-world coordinates, and 6DoF trajectory tags.
egosteer · 2026
EgoSteer: A Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videos
Lightwheel · 2026-08-07
EgoSuite-Open100K is a large egocentric corpus of people performing everyday work tasks, captured on a head rig with stereo cameras and — on the EgoPro line — a camera on each wrist. Recordings carry 3D hand pose, full-body pose on the body subsets, and subtask-level semantic segments, and ship in LeRobot v3 and MCAP. Read the hours claim carefully. The…
Fujiry0 · 2024
EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery Videos
Official source · 2026
EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video
Jianyi2004 · 2026
TouchAnything: A Dataset and Framework for Bimanual Tactile Estimation from Egocentric Video
Ego4D · 2023-05-05
An Ego4D benchmark focused on tracking objects through heavy hand interaction, occlusion, viewpoint changes, and object disappearance/reappearance.
Official source · 2026
EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction
GaTech-RL2 · 2026
EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World
JeffWang987 · 2024
EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation
Hugging Face · haoyang-li/EgoWorld · 2026-03-30
A compact egocentric bimanual manipulation dataset with world-frame 3D hand poses, MANO meshes, camera trajectories, depth maps, and 40D action/state vectors.
taegyoun88 · 2026
EgoXtreme: A Dataset for Robust Object Pose Estimation in Egocentric Views under Extreme Conditions
Official source · 2018
In the Eye of the Beholder: Gaze and Actions in First Person Video
fpv-iplab · 2023
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios
IPEC-COMMUNITY · 2025-12-07
EO-Bench: Embodied Reasoning Benchmark for Vision-Language Models Overview EO-Bench is a comprehensive benchmark designed to evaluate the embodied reasoning capabilities of vision-language models (VLMs) in robotics scenarios. This benchmark is part of the EO-1 project, which develops unified embodied foundation models for general robot control. The…
IPEC-COMMUNITY / EO-Robotics · 2025-08-28
A large multimodal corpus combining vision, text, embodied reasoning, and action supervision for EO-1 pretraining.
Official source · 2018
Scaling Egocentric Vision: The EPIC-KITCHENS Dataset
University of Bristol (with University of Catania and University of Toronto) · 2022-06-01
EPIC-KITCHENS-100 is the largest annotated egocentric (head-mounted camera) dataset of unscripted daily kitchen activities, comprising 100 hours of video (20M frames) across 700 variable-length videos recorded by 37 participants in 45 kitchens across 4 cities. It provides ~90K fine-grained action segments with dense language narrations, plus optical flow,…
silicx · 2025
exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representation
zxzm-zak · 2024
FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Dataset
IPEC-COMMUNITY · 2025
FastUMI-100K: Advancing Data-driven Robotic Manipulation with a Large-scale UMI-style Dataset
Official source · 2026
FEEL (Force-Enhanced Egocentric Learning): A Dataset for Physical Action Understanding
lerobot · 2026-10-12
FineART: Fine-Grained Annotated Robotic Trajectory Dataset FineART is co-released by Scale AI and Hugging Face LeRobot. The data was collected and annotated by the Physical AI unit at Scale AI. FineART is a bimanual manipulation dataset where every episode comes with dense, human-written subtask annotations. It has 40,543 teleoperated episodes (1,718…
Official source · 2024
FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning
lerobot · 2024-08-06
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1804, "totalframes": 338188, "totaltasks": 24, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:1804" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
UC Berkeley (RAIL / Robotic AI & Learning Lab) · 2024-01-16
FMB is a real-world robotic manipulation benchmark from UC Berkeley's RAIL lab for studying functional manipulation, where a Franka Panda arm composes skills (grasping, repositioning, assembly/insertion) using 3D-printed objects on assembly boards. It comprises 22,550 expert demonstration trajectories across single-object and multi-object multi-stage tasks,…
guiggh · 2017
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations
OpenDriveLab · 2025
FreeTacMan: Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulation
FTP-1 (Yuan et al.) · 2026-06-11
FTP-1-Dataset is the heterogeneous pretraining corpus behind FTP-1 (A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation). It aggregates roughly 3,000 hours of contact-rich manipulation data from 26 sources spanning human demonstrations, dexterous-hand, and gripper robots, recorded with 21 distinct tactile sensors…
CLVR Lab, KAIST · 2023-05-22
FurnitureBench is a reproducible real-world benchmark from CLVR Lab (KAIST) for long-horizon, complex robotic manipulation framed as furniture assembly with a Franka Panda arm. It releases 5100 successful teleoperation demonstrations totaling 219.6 hours across 9 furniture models and three task-initialization randomness levels (low/medium/high). The…
Galaxea AI · 2025-08-30
The Galaxea Open-World Dataset is a large-scale real-world mobile manipulation collection gathered with a single embodiment, the Galaxea R1 Lite dual-arm mobile manipulator, across home, kitchen, retail, and office environments. It contains roughly 100K demonstration trajectories totaling 500+ hours, paired with fine-grained subtask-level language…
Robbyant / LingBot-VLA team · 2026-01-26
A 100-task multi-platform benchmark used by the LingBot-VLA team to compare post-trained VLA policies on real robots.
Hugging Face · aryan56789gridai/grid-egocentric-residential-samples · 2026-05-28
A CC-BY-4.0 household egocentric sample set tagged for manipulation, VLA, imitation learning, and robot learning.
taeinkwon · 2021
H2O: Two Hands Manipulating Objects for First Person Interaction Recognition
Config · 2026-06-30
HABIT (Human-Aware Behavior and Interaction Training dataset) is a large-scale robot manipulation dataset collected in human-present environments, where a co-present human shares the workspace and interacts with the robot in every episode. 10,563 episodes, 164 hours of bimanual manipulation across 60 tasks Organized into three human-robot interaction roles…
Official source · 2026
HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning
ThunderVVV · 2025
HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos
hd-epic · 2025
HD-EPIC: A Highly-Detailed Egocentric Video Dataset
Simple AI (Simple World Lab) · 2026
HiFi-UMI-2K is the public release from HiFi-UMI, a portable bimanual capture system built by Simple AI's Simple World Lab. Demonstrations are recorded by a human wearing a head-mounted stereo rig and a glove-like gripper on each hand — there is no robot, no teleoperation rig, and no instrumented room anywhere in the collection loop. The claim being tested.…
BitRobot · 2026-06-25
HIW-500 (Humanoids In-the-Wild) is a large-scale dataset for whole-body humanoid robot learning in natural home environments, capturing human teleoperation demonstrations on the Unitree G1 across 12 real homes in Southeast Asia. It contains 500+ hours and 23K+ episodes spanning 10+ household tasks with 161 subtask labels (~10 TB). Each episode records…
leolyliu · 2022
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction
Ember-HoloAssist · 2023
HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World
facebookresearch · 2024
HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos
Human-CLAW · 2026
HumanCLAW: Can Vision-Language Models Act Through a Body?
Official source · 2026
HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
USC Physical Superintelligence Lab · 2025-10-09
Humanoid Everyday is a large-scale, diverse humanoid manipulation dataset from USC's Physical Superintelligence Lab, collected via human-supervised teleoperation on real Unitree G1 and H1 humanoids. It comprises 10,300 trajectories and over 3 million frames across 260 tasks in 7 categories, spanning dexterous manipulation, human-humanoid interaction, and…
Stanford University · 2024-06-15
HumanPlus is a Stanford full-stack system that lets a customized 33-DoF Unitree H1 humanoid shadow human body and hand motion in real time from RGB cameras, and then learn autonomous whole-body skills via behavior cloning on teleoperated demonstrations. The low-level shadowing policy is trained in simulation using the 40-hour AMASS human-motion dataset; the…
Richard-coder-Nai · 2026
Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations
lerobot · 2024-08-22
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 631, "totalframes": 146241, "totaltasks": 7, "chunkssize": 1000, "fps": 20, "splits": { "train": "0:631" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 170, "totalframes": 7148, "totaltasks": 17, "chunkssize": 1000, "fps": 5, "splits": { "train": "0:170" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
CMU AirLab · 2021-03-24
An empirical UAV energy-use dataset collected by CMU AirLab to measure how small electric delivery drones consume power under varied operating conditions. A DJI Matrice 100 (M100) quadcopter was autonomously flown on a triangular take-off/cruise/land pattern while sweeping payload (0 g, 250 g, 500 g), cruise altitude (25, 50, 75, 100 m), and cruise speed…
Vivek9Chavan · 2025
IndEgo: A Dataset of Industrial Scenarios and Collaborative Work for Egocentric Assistants
TimSchoonbeek · 2023
IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Setting
Hugging Face · TrainThemAI/Industrial-Workplace-Egocentric-FHD-Samples · 2026-05-24
A small MIT-licensed set of industrial and workplace egocentric video samples for robotics, VLA, imitation learning, and manipulation demos.
lerobot · 2025-09-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1, "totalframes": 169, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:1" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath": null, "features": {…
lerobot · 2024-07-29
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 102, "totalframes": 39693, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:102" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-26
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 100, "totalframes": 32951, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:100" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-29
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 50, "totalframes": 37972, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:50" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-29
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 50, "totalframes": 36013, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:50" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
Official source · 2016
KrishnaCam: Using a Longitudinal, Single-Person, Egocentric Dataset for Scene Understanding Tasks
Hugging Face · ankk98/kriya-egocentric-100k · 2026-03-17
A small MIT-licensed preview dataset with egocentric video/action annotation metadata for video-text-to-text and action-recognition experiments.
Robotics at Google / Google Research · 2022-10-12
Language-Table is a suite of human-collected datasets and a multi-task continuous control benchmark for open-vocabulary visuolinguomotor learning, released with the paper 'Interactive Language: Talking to Robots in Real Time'. It contains nearly 600,000 natural-language-labeled trajectories of a UFACTORY xArm6 robot moving colored blocks on a tabletop…
ut-hcrl · 2025
LEGATO: Cross-Embodiment Imitation Using a Grasping Tool
Buzz-Beater · 2020
LEMMA: A Multi-View Dataset for Learning Multi-Agent Multi-Task Activities
Hugging Face LeRobot community · 2025
A growing collection of community-contributed robot datasets used to pretrain and adapt open policies such as SmolVLA.
LeRobot (Hugging Face) · 2026-06-22
The shirt-folding dataset from LeRobot's open-source 'Unfolding Robotics: Open-Source Shirt Folding from Data to Deployment' project, which trained a bimanual robot to fold t-shirts at a 90% success rate. Collected via real-world leader-follower teleoperation across 8 bimanual setups optimizing for diversity (25+ t-shirts, 8 backgrounds, varied camera/robot…
Technion – Israel Institute of Technology · 2026-06-12
LESS ("More with LESS: Local Scene Representations for Tactile Imaging", RSS 2026) tackles artificial palpation — reconstructing what is inside a soft object purely by touching it. The motivating application is breast cancer screening, where over 40% of cases are first detected by palpation. >800 hours of robotic tactile interaction, released as ~66 GB…
Official source · 2026
LET-Base-Dataset: LET Basic Operation Dataset
UT Austin — Lifelong Robot Learning (Bo Liu, Yifeng Zhu, Yuke Zhu, Peter Stone) · 2023-06-05
LIBERO is a benchmark for knowledge transfer in lifelong robot learning, and its defining feature is experimental control rather than scale. Three of its suites hold everything fixed except one factor, so a policy's failure can be attributed to a specific kind of distribution shift instead of to "the scene changed". The five suites. LIBERO-Spatial (10…
lerobot · 2026-01-16
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 1693, "totalframes": 273465, "totaltasks": 40, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 500, "fps": 10.0, "splits": { "train": "0:1693" }, "datapath":…
lerobot · 2026-01-20
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 379, "totalframes": 101469, "totaltasks": 10, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 500, "fps": 10, "splits": { "train": "0:379" }, "datapath":…
lerobot · 2025-02-27
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 379, "totalframes": 101469, "totaltasks": 10, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:379" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-02-27
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 428, "totalframes": 52042, "totaltasks": 10, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:428" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-02-27
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 454, "totalframes": 66984, "totaltasks": 10, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:454" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-02-27
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 432, "totalframes": 52970, "totaltasks": 10, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:432" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
Robbyant / LIBERO · 2026-04-24
A LeRobot-formatted LIBERO-Long release used for post-training and evaluating video-action and VLA policies on extended tasks.
Fudan University and Shanghai Innovation Institute (with Tongji University and NUS) · 2025-10-14
LIBERO-Plus takes the position that headline success rates on LIBERO hide how brittle vision-language-action policies actually are, and it tests that by perturbing the benchmark rather than extending it. The tasks are the same; what changes is everything around them. Seven perturbation factors, decomposed into 21 low-level components: object layout, camera…
Robbyant · 2026-03-21
A roughly three-million-sample mixture of real indoor, robot-manipulation, and simulated RGB-D data used by LingBot-Depth.
ManipArena (SYSU x MBZUAI) · 2026-03-30
ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3…
gist-ailab · 2025
ManipForce: Force-Guided Policy Learning with Frequency-Aware Representation for Contact-Rich Manipulation
UC San Diego (Hao Su Lab / SAPIEN) · 2023-02-09
ManiSkill2 is a unified, fully simulated robotic manipulation benchmark built on the SAPIEN physics engine, covering 20 manipulation task families with 2000+ object models and 4M+ verified demonstration frames. It spans stationary and mobile-base, single- and dual-arm, and rigid- and soft-body tasks, with RGB, depth/RGBD, and point-cloud observations and a…
real-stanford · 2024
ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Data
Hugging Face · OpenGraphLabs-Research/manus-egocentric-sample · 2026-01-01
An Apache-2.0 robotics dataset sample with egocentric video, hand tracking, Manus glove signals, and imitation-learning oriented metadata.
robbyant · 2026-03-21
LingBot-Depth Dataset Self-curated RGB-D dataset for training LingBot-Depth, a masked depth modeling approach (arxiv:2601.17895). Each sample contains an RGB image, raw sensor depth, and ground truth depth. Total size: 2.71 TBDepth scale: millimeters (mm), stored as 16-bit PNGLicense: CC BY-NC-SA 4.0 Sub-datasets Name Description Samples RobbyReal…
fpv-iplab · 2020
The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-Like Domain
lerobot · 2025-02-19
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "metaworld", "totalepisodes": 2500, "totalframes": 204806, "totaltasks": 50, "chunkssize": 1000, "fps": 80, "splits": { "train": "0:2500" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-02-13
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "metaworld", "totalepisodes": 100, "totalframes": 6125, "totaltasks": 1, "chunkssize": 1000, "fps": 80, "splits": { "train": "0:100" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
Hugging Face · MicroAGI-Labs/MicroAGI01 · 2026
An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.
Official source · 2018
Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation
NVIDIA (with The University of Texas at Austin) · 2023-10-26
MimicGen is a data-generation system (CoRL 2023, NVIDIA + UT Austin) that synthesizes large-scale robot manipulation datasets by adapting a small set of human teleoperation demonstrations to new object poses, objects, and robot embodiments. The public release contains over 48,000 simulated task demonstrations across 12 tasks (categories:…
Stanford University · 2024-01-04
Mobile ALOHA is a teleoperated mobile bimanual manipulation dataset collected by Fu, Zhao, and Finn (Stanford) using the low-cost whole-body Mobile ALOHA system, with ~50 human demonstrations per task across whole-body tasks such as sauteing shrimp, opening a two-door cabinet, calling/entering an elevator, and rinsing a pan. The TFDS/Open X release contains…
fpvlabs · 2026
MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware
Allen Institute for AI (Ai2) · 2026-05-04
Ai2's self-collected MolmoAct real-robot manipulation dataset, used to train MolmoAct action reasoning models, covering household and tabletop domains. The Household split has 7,529 episodes across 115 tasks with varying viewpoints; the Tabletop split adds 2,959 episodes across 19 tasks with a fixed exocentric camera (~10,488 episodes total). It uses a…
Allen Institute for AI (Ai2) · 2026-05-04
A large-scale bimanual manipulation dataset collected by Ai2 for MolmoAct2 using paired YAM follower arms. It contains 32,246 episodes (76M frames) spanning 34 tabletop tasks with 720+ hours of teleoperated demonstrations. Each episode provides three RGB camera views (left, right, top) plus 14-dim joint/gripper states, in LeRobot format with per-episode…
Allen Institute for AI (Ai2) · 2026-05-04
A MolmoAct2 resource from Ai2 providing per-episode annotated language instructions for low-cost SO-100 and SO-101 arm data sourced from 1,220 community LeRobot repositories (377 users). It does not re-host trajectories; each source dataset gets a tasksannotated.parquet of refined instructions indexed by episode, with the source repos listed in…
Allen Institute for AI (Ai2) · 2026-03-17
MolmoBot is a large-scale, fully-simulated robot manipulation dataset from Ai2 (Allen Institute for AI), built to enable zero-shot sim-to-real transfer. ~1.7M expert trajectories (5,704 hours) across 8 task types — articulated-object manipulation (opening doors, drawers, cabinets) and pick-and-place Generated entirely in simulation (MuJoCo via Ai2…
michaelyuancb · 2025
MotionTrans: Human VR Data Enable Motion-Level Learning for Robotic Manipulation Policies
KarolHausman · 2021
MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale
Official source · 2025
MV-UMI: A Scalable Multi-View Interface for Cross-Embodiment Learning
NVIDIA (GEAR Lab / Isaac) · 2025-05-19
The public, downloadable dataset behind NVIDIA's Isaac GR00T N1 humanoid foundation model. It bundles simulated post-training trajectories across multiple embodiments (Fourier GR1 humanoid in arms-only/full-upper-body/arms+waist configs, single-arm and bimanual Franka Panda with gripper and dexterous-hand variants, and a Unitree G1 loco-manipulation set)…
facebookresearch · 2024
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild
Hugging Face · obaydata/egocentric-dexterous-manipulation-demo · 2026-03-18
A non-gated CC-BY-NC-4.0 demo dataset with first-person dexterous manipulation, hand-pose, object-detection, and robotics tags.
LeCAR-Lab · 2024
OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learning
MrSecant · 2026
OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation
Official source · 2025
Galaxea Open-World Dataset and G0 Dual-System VLA Model
Google DeepMind / Open X-Embodiment collaboration · 2023-10-13
A large multi-institution collection spanning 22 robot embodiments and hundreds of skills for cross-robot policy learning.
Open X-Embodiment Collaboration (led by Google DeepMind) · 2023-10-13
Open X-Embodiment is a large-scale, standardized aggregation of robot learning datasets assembled by a collaboration of 21 institutions, pooling 60 existing datasets from 34 labs covering 22 robot embodiments and over 1 million real robot trajectories demonstrating 527 skills (160,266 tasks). All datasets are converted to a common RLDS (Reinforcement…
inclusionAI · 2026
Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning
Official source · 2026
Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics
lerobot · 2026-04-07
OpenArm Hardware Modifications for Cloth Folding Custom 3D-printable parts used in the Unfolding Robotics project, where we trained a bimanual robot to fold t-shirts with a 90% success rate. These files modify the standard OpenArm. Files File Description J45cmextended.step Extended upper arm (bicep) segment, adds +5 cm of reach to compensate for the lack of…
ahadjawaid · 2025
OpenEgo: A Large-Scale Multimodal Egocentric Dataset for Dexterous Manipulation
lerobot · 2026-06-25
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "fps": 30, "features": { "observation.images.depth": { "dtype": "image", "shape": [ 720, 1280, 1 ], "names": [ "height", "width", "channels" ], "info": { "isdepth_map":… See the full description on the dataset page:…
lerobot · 2025-09-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1, "totalframes": 421, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:1" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath": null, "features": {…
Official source · 2016
Recognizing Micro-Actions and Reactions from Paired Egocentric Videos
RogerQi · 2025
Humanoid Policy Human Policy
Official source · 2015
Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours
Hugging Face · TrainThemAI/POV-Egocentric-Video-Robotics-FHD-Samples · 2026
A small MIT-licensed first-person robotics video sample set for human demonstrations, VLA experiments, manipulation, and household activities.
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 206, "totalframes": 25650, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:206" }, "datapath":…
lerobot · 2024-07-04
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 206, "totalframes": 25650, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:206" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath": null, "features": {…
LilyDaytoy · 2023
Panoptic Video Scene Graph Generation
genrobot-ai · 2026
RealOmni-Open DataSet
Official source · 2025
RealSource-World: A Large-Scale Real-World Dual-Arm Manipulation Dataset
Official source · 2025
REASSEMBLE: A Multimodal Dataset for Contact-rich Robotic Assembly and Disassembly
RekaAI · 2026
RekaDaily-10k: Collecting 10,000+ Hours of Egocentric Household Manipulation Data
Shanghai Jiao Tong University (Cewu Lu Lab / MVIG) · 2023-07-02
RH20T is a large-scale real-world robotic manipulation dataset of over 110,000 contact-rich manipulation sequences spanning 147 tasks (48 from RLBench, 29 from MetaWorld, 70 self-proposed), each paired with a human demonstration video. Data was collected on 7 hardware configurations using four robot arms (Flexiv, UR5, Franka, Kuka) with 8-10 global RGBD…
RoboArena (multi-institution consortium) · 2025-08-05
RoboArena is a living, distributed real-robot benchmark: Chatbot Arena, but the contestants are robot policies and the arena is a network of physical Franka arms. Crucially, every episode is an autonomous policy rollout, not a teleoperated demonstration — a human is present only to reset the scene and score the result. 10,783 policy episodes across 3,883…
UT Austin (Yuke Zhu) and NVIDIA Research · 2024-06-04
RoboCasa is a MuJoCo/robosuite-based simulation framework of photorealistic kitchen environments for training generalist robots (used in NVIDIA's GR00T effort). The original RSS 2024 release provides 120 kitchen scenes (10 floor plans, 12 styles), 2,509 3D assets across 153 categories, and 100 tasks (25 atomic + 75 LLM-generated composite), with 50 human…
lerobot · 2026-04-16
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "robocasa", "totalepisodes": 25307, "totalframes": 14957899, "totaltasks": 50, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 200, "fps": 20, "splits": { "train": "0:25307" }, "datapath":…
Official source · 2025
RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulation
MMLab@HKU and collaborators · 2026-07-05
RoboDojo is a sim-and-real evaluation benchmark built to answer a blunt question: how good are generalist manipulation policies really? The answer it reports is sobering — the best of 30 policies evaluated in simulation reached only 8.80% success against 76.03% for human teleoperation. 60 tasks total: 42 simulation tasks (NVIDIA Isaac Sim 5.1 / Isaac Lab…
Stanford Vision and Learning Lab / ARISE Initiative · 2021-08-06
robomimic is a framework and dataset suite for robot learning from demonstration, released with the CoRL 2021 study 'What Matters in Learning from Offline Human Demonstrations for Robot Manipulation' (Mandlekar et al.). It provides teleoperated human and machine-generated demonstrations on five simulated robosuite/MuJoCo tasks (Lift, Can, Square, Transport,…
RoboMIND collaboration · 2024-12-18
A unified multi-embodiment manipulation dataset with successful demonstrations, real-world failures, and failure causes.
Official source · 2025
RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligence
lerobot · 2026-04-10
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "panda", "totalepisodes": 1600, "totalframes": 768897, "totaltasks": 116, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 200, "fps": 10, "splits": { "train": "0:1600" }, "datapath":…
UC Berkeley (BAIR), Stanford, UPenn GRASP, Google Brain · 2019-10-24
RoboNet is a large-scale, open dataset for multi-robot learning, containing over 15 million video frames of robot-object interaction collected autonomously across four research labs (UC Berkeley BAIR, Stanford AI Lab, UPenn GRASP, Google Brain Robotics). It aggregates data from 7 robot platforms (Sawyer, Franka Panda, Baxter, Fetch, Google R3, Kuka LBR…
robopen · 2023
RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking
Carnegie Mellon University and Meta AI · 2023-09-05
RoboSet is a large-scale real-world multi-task robot manipulation dataset collected on Franka-Emika Panda arms with Robotiq grippers across everyday kitchen scenes, combining teleoperated (9,500) and kinesthetic-playback (19,000) demonstrations. It spans 12 manipulation skills expressed across 38 tasks, recording RGB and depth frames from 4 camera views…
CMU AirLab · 2020-05-18
The Robotic Interestingness Dataset (also called the SubT Front Camera, or SubTF, dataset) from CMU's AirLab is a visual scene dataset for studying online prediction of visually 'interesting' scenes for mobile robots. It consists of 7 long-form video sequences (~53-83 minutes each, ~467.7 minutes / ~7.8 hours total) recorded from the front-facing RGB camera…
lerobot · 2024-08-05
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1995, "totalframes": 187507, "totaltasks": 3, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:1995" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
RoboTurk-Platform · 2018
RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
RoboTwin-Platform · 2024-09-18
[ICML 2026] RoboTwin 2.0 Offical Code Repo
RoboTwin Platform · 2024-09-18
A configurable dual-arm data generator and benchmark with strong domain randomization, pre-collected trajectories, and LeRobot integration.
google-research · 2022
RT-1: Robotics Transformer for Real-World Control at Scale
Google (Robotics at Google / Everyday Robots) · 2022-12-13
The RT-1 robot action dataset (fractal20220817_data in Open X-Embodiment) contains 87,212 human-teleoperated demonstration episodes of tabletop manipulation with 17 objects, collected on Google's Everyday Robots mobile manipulators. Each step pairs an RGB image and natural-language instruction with a discretized arm+base action, plus…
CMU AirLab · 2024-07-01
SubT-MRS is an extremely challenging real-world dataset designed to push SLAM toward all-weather, perceptually-degraded environments. It comprises roughly five years of data: three years from the DARPA Subterranean (SubT) Challenge (2019-2021) plus two additional years of diverse environments (2022-2023). The collection covers over 2000 hours and 300+…
lerobot · 2025-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.1", "robottype": "so100", "totalepisodes": 50, "totalframes": 19631, "totaltasks": 1, "totalvideos": 100, "totalchunks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:50" }, "datapath":…
lerobot · 2025-05-20
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "so100", "totalepisodes": 52, "totalframes": 35713, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:52" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2025-05-20
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "so100", "totalepisodes": 56, "totalframes": 22956, "totaltasks": 1, "chunkssize": 1000, "fps": 30, "splits": { "train": "0:56" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
RIOTU Lab, Prince Sultan University · 2024-02-15
A large set of synthetic UAV flight trajectories produced by the RIOTU Lab's automated ROS 2 / Gazebo / PX4 pipeline (FlightGen). A simulated multirotor tracks time-parameterized reference paths — circles and lemniscates with randomized centres, radii and angular velocities — while its ground-truth 3D position is logged and resampled at 10 Hz. Each…
OpenDriveLab · 2026
TAMEn: Tactile-Aware Manipulation Engine for Closed-Loop Data Collection in Contact-Rich Tasks
CMU AirLab · 2020-03-31
TartanAir is a large-scale synthetic dataset for visual SLAM and robot navigation, released by CMU's AirLab (Robotics Institute) and presented at IROS 2020. Data is collected in 30 photo-realistic Unreal Engine environments via the AirSim plugin, spanning urban, rural, nature, domestic, public and sci-fi scenes, with challenging conditions including…
CMU AirLab · 2024-03-01
TartanAir V2 is a large-scale photorealistic synthetic dataset built on Unreal Engine 4 with the AirSim plugin, developed by CMU's AirLab (castacks) to push the limits of visual SLAM, navigation, and robotics perception. It contains 65 highly distinct simulated environments covering urban, rural, domestic, infrastructure, thematic, and nature scenarios,…
CMU AirLab · 2024-03-05
TartanAviation is an open-source multimodal dataset focused on terminal-area airspace operations at general-aviation airports, providing a holistic view of the airport environment by concurrently collecting image, speech, and ADS-B trajectory data using sensor setups installed within airport boundaries. It contains 3.1 million images across 550 sequences…
CMU AirLab · 2022-05-03
TartanDrive is a large-scale real-world off-road driving dataset from CMU's AirLab, built for learning off-road vehicle dynamics models. It contains roughly 200,000 off-road driving interactions (about five hours of data) collected on a modified Yamaha Viking ATV driven across diverse terrain. The authors describe it as the largest real-world multimodal…
CMU AirLab · 2024-02-02
TartanDrive 2.0 is an expanded large-scale off-road driving dataset from CMU's AirLab, collected on a Yamaha Viking All-Terrain Vehicle (ATV named 'Vicky') over 255+ acres of diverse terrain in Western Pennsylvania (narrow paths, dense foliage, rocky areas, dirt paths, steep hills). It comprises roughly 7 hours of data at speeds up to 15 m/s. Building on…
GAP-LAB-CUHK-SZ · 2025
TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulation
Official source · 2017
Action Recognition in RGB-D Egocentric Videos
fredfyyang · 2022
Touch and Go: Learning from Human-Collected Vision and Touch
YolandaXinyueZhu · 2025
Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper
CMU AirLab · 2021-09-30
TrajAir is a general-aviation aircraft trajectory dataset collected by CMU's AirLab (Robotics Institute) around the non-towered Pittsburgh-Butler Regional Airport (ICAO: KBTP), a single-runway GA airport ~10 miles north of Pittsburgh, PA. Data was recorded with an on-site ADS-B receiver (1090 MHz / 978 MHz, plus TIS-B for non-equipped aircraft) over 8…
Tsinghua University — THU-EAI Lab · 2025-08-25
U2UData+ (published under the name U2UData-2) is a large-scale swarm-UAV dataset for Embodied Long-Horizon tasks, collected entirely in the U2USim UE5.2/AirSim simulator on terrain mapped from Yunnan Province. Fifteen UAVs fly in autonomous formation mode executing a wildlife-conservation task across 12 weather and terrain scenes, producing 720 traces of…
Beihang University — Institute of Artificial Intelligence · 2025-05-14
UAV-Flow is the first real-world benchmark for language-conditioned, fine-grained UAV trajectory control, framed as the "Flying-on-a-Word" (Flow) task. Certified pilots — each with 800+ hours of experience — manually flew 30,692 short-range trajectories across three university campuses (5.02 km²) on DJI Mavic 3T RTK platforms, flying exclusively from the…
Beihang University — Institute of Artificial Intelligence · 2025-05-14
UAV-Flow-Sim is the simulated half of the UAV-Flow benchmark, built in an Unreal Engine campus environment and used for systematic, repeatable evaluation of language-conditioned UAV policies. It contains 10,109 trajectories spanning 10 Flow task types, with the same schema as the real split — atomic language instruction, egocentric RGB observation, and…
lerobot · 2024-07-24
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 192, "totalframes": 13384, "totaltasks": 1, "chunkssize": 1000, "fps": 1, "splits": { "train": "0:192" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
real-stanford · 2024
Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots
lerobot · 2024-04-20
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1447, "totalframes": 699432, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:1447" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
hku-mars · 2026
UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception
real-stanford · 2024
UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers
Official source · 2026
UniFoLM-WBT-Dataset
lerobot · 2026-08-28
Unitree G1 Hardware Modifications Custom 3D-printable parts and reference photos for modifying the Unitree G1: OpenArm grippers on the wrists, an extra head camera, and a backpack enclosure for the CAN-FD interface and cabling. Everything here is printable geometry plus photos of the assembled result — there is no firmware or control code in this repo.…
lerobot · 2024-08-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 1000, "totalframes": 100000, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:1000" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
lerobot · 2024-07-23
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "unknown", "totalepisodes": 102, "totalframes": 7490, "totaltasks": 1, "chunkssize": 1000, "fps": 10, "splits": { "train": "0:102" }, "datapath": "data/chunk-{chunkindex:03d}/file-{fileindex:03d}.parquet", "videopath":…
Official source · 2025
ViTaMIn: Learning Contact-Rich Tasks Through Robot-Free Visuo-Tactile Manipulation Interface
chuanyune · 2025
ViTaMIn-B: A Reliable and Efficient Visuo-Tactile Bimanual Manipulation Interface
lerobot · 2026-04-16
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "franka", "totalepisodes": 10977, "totalframes": 3114872, "totaltasks": 295, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 200, "fps": 10, "splits": { "train": "0:10977" }, "datapath":…
mariusbock · 2023
WEAR: An Outdoor Sports Dataset for Wearable and Egocentric Activity Recognition
Hugging Face · facebook/wearable-ai · 2026-05-15
A benchmark for long-form QA, conversational QA, and proactive assistant behavior over first-person wearable-camera videos.
CMU AirLab · 2017-09-24
The Wire Detection Dataset accompanies the IROS 2017 paper 'Wire Detection using Synthetic Data and Dilated Convolutional Networks for Unmanned Aerial Vehicles' (Ratnesh Madaan, Daniel Maturana, Sebastian Scherer, Robotics Institute, Carnegie Mellon University / AirLab). The method targets detection of thin structures such as power lines from unmanned…
CMU AirLab · 2023-12-14
WIT-UAS is a wildland-fire long-wave infrared (LWIR) thermal dataset collected by CMU's AirLab (Airborne Robotics Lab) to detect crew and vehicle assets from aerial views amidst prescribed burns. It is split into two subsets: WIT-UAS-ROS (full ROS bag files containing sensor and robot data of UAS flights over fire) and WIT-UAS-Image (hand-labeled LWIR…
tars-robotics · 2025
World In Your Hands: A Large-Scale and Open-source Ecosystem for Learning Human-centric Manipulation in the Wild
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 800, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 15, "splits": { "train": "0:800" }, "datapath":…
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 800, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 15, "splits": { "train": "0:800" }, "datapath":…
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 800, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 15, "splits": { "train": "0:800" }, "datapath":…
lerobot · 2024-05-12
This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v2.0", "robottype": "unknown", "totalepisodes": 800, "totalframes": 20000, "totaltasks": 1, "totalvideos": 0, "totalchunks": 1, "chunkssize": 1000, "fps": 15, "splits": { "train": "0:800" }, "datapath":…
Hugging Face · ropedia-ai/xperience-10m · 2026-03-11
A large egocentric multimodal dataset with synchronized video streams, audio, depth, poses, mocap, IMU, and hierarchical language annotations.
CMU AirLab · 2018-05-01
The Yamaha-CMU Off-Road (YCOR) dataset is a semantic segmentation benchmark for autonomous off-road navigation, released by CMU AirLab. It contains 1,076 egocentric RGB images collected from a Yamaha off-road vehicle at four locations in Western Pennsylvania and Ohio, spanning three different seasons to capture varied terrain and lighting conditions. Each…
facebookresearch · 2019
You2Me: Inferring Body Pose in Egocentric Video via First and Second Person Interactions
Did the index miss a corpus you publish or need? These paths reach a human.
Submit a dataset
Maintainers: add a corpus or update access, license, and scale facts at the official source.
contact@openbot.aiRequest specific data
Tell us the task, embodiment, and signals you need; we point you at published records or gaps.
contact@openbot.aiDiscuss a data partnership
For data sourcing, custom collection, and synthetic data inquiries from teams and enterprises.
contact@openbot.ai