OpenBot

232 published datasets

All datasets, A–Z.

A complete server-rendered directory of the current public Catalog. Use the main datasets page when you need search, filters, and comparisons.

A

16 records

ABC-130k

UC Berkeley / MIT / Amazon FAR / CMU / XDOF · 2026-06-25

ABC-130k is an open bimanual robot manipulation dataset released with the paper 'Scalable Behavior Cloning with Open Data, Training, and Evaluation'. It contains roughly 130,919 episodes (43,090 annotated) totaling about 3,598 hours collected on bimanual YAM stations with two 6-DoF arms and parallel-jaw grippers, spanning ~195 tasks such as pick-and-place,…

Open

ActionNet

Official source · 2025

ActionNet: A Dataset for Dexterous Bimanual Manipulation

Unknown

ADT

Official source · 2023

Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perception

Unknown

AEA

Official source · 2024

Aria Everyday Activities Dataset

Unknown

AgiBot World 2026

AgiBot (Zhiyuan Robotics) · 2026-03-01

AgiBot World 2026 is the latest release of the AgiBot World embodied-AI dataset, succeeding the earlier Alpha/Beta releases. It is collected in real-world commercial, home, and general-purpose environments using the AGIBOT G2 wheeled humanoid with dual 7-DOF force-controlled arms, capturing synchronized RGB(D), LiDAR point clouds, tactile, IMU, and…

Open

AgiBot World Beta

Official source · 2025

AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems

Unknown

AIRoA MoMa Dataset

AIRoA (AI Robot Association) · 2025-09-29

The AIRoA MoMa Dataset is a large-scale, real-world dataset for mobile manipulation collected with the Toyota Human Support Robot (HSR) via leader-follower teleoperation in household environments. It contains 25,469 episodes (~94 hours) sampled at 30 Hz, with synchronized RGB images from head and wrist cameras, joint states, six-axis wrist force-torque…

Open

Aist-Bimanual

Official source · 2025

AIST Bimanual Manipulation Dataset

Unknown

ALFA (AirLab Failure and Anomaly Dataset)

CMU AirLab · 2020-07-01

ALFA (AirLab Failure and Anomaly Dataset) from CMU's AirLab is a real-world flight dataset for fault detection and isolation (FDI) and anomaly detection (AD) on a fixed-wing UAV. It contains processed data for 47 autonomous flights covering eight fault types: 23 sudden full engine (power loss) failures and 24 scenarios of seven control-surface (actuator)…

Open

ALOHA

tonyzhaozh · 2023

Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware

Unknown

ALOHA Static

Stanford · 2023-04-23

Bimanual teleoperated demonstrations of fine manipulation tasks.

Unknown

ALOHA Unleashed

Official source · 2024

ALOHA Unleashed: A Simple Recipe for Robot Dexterity

Unknown

ARCTIC

zc-alexfan · 2022

ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation

Unknown

ArmnetBench v0.1 Dataset

Armnet · 2026-07-27

ArmnetBench v0.1 is a real-world manipulation benchmark: 7 policies run on a fleet of low-cost SO-101 cells, with every episode human-scored. It is released as evaluation data rather than a training corpus, which makes it unusual here — most of the catalog is demonstrations, and this is what happens when policies actually try. What is in it. 3,718 episodes…

Open

Assembly101

assembly-101 · 2022

Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities

Unknown

AssemblyHands

facebookresearch · 2023

AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation

Unknown

B

4 records

C

7 records

D

12 records

Daimon-Infinity

Official source · 2026

Official catalog record.

Unknown

DAML

tianheyu927 · 2018

One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning

Unknown

Data Scaling Laws

Fanqi-Lin · 2025

Data Scaling Laws in Imitation Learning for Robotic Manipulation

Unknown

DECO-50

Official source · 2026

DECO: Decoupled Multimodal Diffusion Transformer for Bimanual Dexterous Manipulation with a Plugin Tactile Adapter

Unknown

DexMimicGen

NVIDIA Research (with UT Austin and UC San Diego) · 2024-10-31

DexMimicGen is an automated data-generation system that synthesizes large-scale trajectory datasets for bimanual dexterous manipulation from a handful of human teleoperation demonstrations. It generated over 21,000 demonstrations from 60 source human demos across 9 simulation tasks in robosuite/MuJoCo, spanning three embodiments (bimanual Panda arms with…

Open

Dexora

Official source · 2026

Dexora: Open-source VLA for High-DoF Bimanual Dexterity

Unknown

DexUMI

real-stanford · 2025

DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulation

Unknown

DexWild

dexwild · 2025

DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies

Unknown

DexYCB

NVIDIA (with University of Washington) · 2021-04-09

DexYCB is a large-scale RGB-D dataset of 582,000 frames capturing 10 human subjects grasping 20 objects from the YCB-Video set, recorded synchronously from 8 calibrated Intel RealSense D415 cameras around a tabletop (640x480 @ 30fps, 1,000 trials total). Each frame is annotated with segmentation masks, 6D object poses, MANO hand pose, and 2D/3D hand joints.…

Open

DreamDojo GR-1 Post-Training

NVIDIA · 2026-02-06

The publicly released dataset accompanying DreamDojo, NVIDIA's generalist robot world model (arXiv 2602.06949, ICML 2026). DreamDojo is pretrained on DreamDojo-HV — a 44.7k-hour in-house egocentric human-video corpus that is not publicly released. What is released (Feb 2026) is the GR-1 post-training data: teleoperated trajectories on the Fourier GR-1…

Open

DROID

DROID Collaboration (Stanford, UC Berkeley, et al. — 13 institutions) · 2024-03-19

DROID (Distributed Robot Interaction Dataset) is a large-scale in-the-wild robot manipulation dataset of 76,000 teleoperated demonstration trajectories (~350 hours), collected across 564 scenes and 84 tasks by 50 collectors over 12 months in North America, Asia, and Europe (13 institutions). Every episode uses a standardized Franka Panda 7-DoF arm with two…

Open

droid_1.0.1

lerobot · 2025-07-16

This dataset was created using LeRobot. Dataset Structure meta/info.json: { "codebaseversion": "v3.0", "robottype": "Franka", "totalepisodes": 95658, "totalframes": 27630375, "totaltasks": 49630, "chunkssize": 1000, "datafilessizeinmb": 100, "videofilessizeinmb": 500, "fps": 15, "splits": { "train": "0:95658" }, "datapath":…

Unknown

E

64 records

Ego-1K

Hugging Face · facebook/ego-1k · 2026-01-29

A synchronized 12-camera egocentric dataset for neural 3D/4D reconstruction, hand-object interaction, and novel-view synthesis.

Closed

EGO-CH

Official source · 2020

EGO-CH: Dataset and Fundamental Tasks for Visitors Behavioral Understanding Using Egocentric Vision

Unknown

Ego-Deliver

Official source · 2021

Ego-Deliver: A Large-Scale Dataset for Egocentric Video Analysis

Unknown

Ego-Exo4D

Meta FAIR (Project Aria) and 15+ university partners · 2023-11-30

Ego-Exo4D is a large-scale multimodal, multiview video dataset of skilled human activities (cooking, music, soccer, health, basketball, dance, bike repair, rock climbing) captured simultaneously from first-person Aria glasses and third-person GoPro cameras. It contains 1,286.3 hours of video from 740 camera wearers across 13 cities and 123 scene contexts,…

Open

Ego-EXTRA

Official source · 2025

Ego-EXTRA: video-language Egocentric Dataset for EXpert-TRAinee assistance

Unknown

Ego-Realm

Hugging Face · Luel-ai/Ego-Realm · 2026

A compact Pineye-camera video set covering horticulture, kitchen, and laundry clips for quick first-person manipulation experiments.

Gated

Ego2Robot

Official source · 2026

Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data

Unknown

Ego4D

Meta AI (Facebook AI Research) and academic consortium · 2022-10-01

Ego4D is a massive-scale dataset of 3,670 hours of daily-life egocentric (first-person) video captured by 923 unique camera wearers across 74 locations in 9 countries, built by a consortium of Facebook AI (Meta) and 13 universities. Portions include audio, 3D environment meshes, eye gaze, stereo, multi-camera footage, IMU, and dense textual narrations,…

Open

EgoBody

sanweiliti · 2021

EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices

Unknown

EgoCart

Official source · 2018

Egocentric Shopping Cart Localization

Unknown

Egocentric Activity Sample

Hugging Face · WhissleAI/egocentric-activity-sample · 2026-04-25

A CC-BY-4.0 sample dataset for egocentric activity recognition, visual QA, temporal localization, narrations, hands, and objects.

Open

Egocentric Adjust Bottle

Hugging Face · SUZ-tsinghua/egocentric_adjust_bottle · 2026-05-02

A LeRobot-style robotics dataset for an egocentric bottle adjustment task, packaged as Parquet with image, text, and timeseries modalities.

Open

Egocentric Affordance Dataset

Hugging Face · Kavin60606/egocentric-affordance-dataset · 2026-02-14

A CC-BY-4.0 egocentric image dataset with affordance, task, and view labels for robotics and embodied-AI perception tasks.

Open

Egocentric-10K

Hugging Face · builddotai/Egocentric-10K · 2025-11-09

A large in-the-wild factory dataset with head-mounted 1080p videos, camera intrinsics, and WebDataset shards.

Gated

Egocentric-10K Evaluation

Hugging Face · builddotai/Egocentric-10K-Evaluation · 2025-11-10

An Apache-2.0 evaluation dataset for measuring hand presence and active object manipulation in first-person industrial frames.

Open

Egocentric-100K

builddotai · 2025

Egocentric-100K Dataset Release

Unknown

Egocentric-100K Evaluation

Hugging Face · builddotai/Egocentric-100K-Evaluation · 2025-12-09

An Apache-2.0 benchmark comparing Egocentric-100K, Ego4D, and EPIC-KITCHENS samples for hand visibility, active manipulation, and active labor.

Open

EgoCom

facebookresearch · 2020

EgoCom: A Multi-Person Multi-Modal Egocentric Communications Dataset

Unknown

EgoConvNet

suriyachaudary · 2016

First Person Action Recognition Using Deep Learned Descriptors

Unknown

EgoDex

Apple · 2025-05-16

EgoDex is a large-scale egocentric human manipulation dataset from Apple, comprising 829 hours of 1080p 30Hz video (~90M frames) recorded with Apple Vision Pro. It pairs each frame with 3D pose annotations for the head, upper body, and hands (68 joints) via on-device tracking, plus camera intrinsics and natural-language task descriptions. The data spans 194…

Open

EgoDexter

Official source · 2017

Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor

Unknown

EgoEMG

zhenqis123 · 2026

EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation

Unknown

EgoEngine

Official source · 2026

EgoEngine: From Egocentric Human Videos to High-Fidelity Dexterous Robot Demonstrations

Unknown

EgoEVHands

ZJUWang01 · 2026

EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras

Unknown

EgoExo-Fitness

iSEE-Laboratory · 2024

EgoExo-Fitness: Towards Egocentric and Exocentric Full-Body Action Understanding

Unknown

EgoExoLearn

hyf015 · 2024

EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World

Unknown

EgoExOR

ardamamur · 2025

EgoExOR: An Ego-Exo-Centric Operating Room Dataset for Surgical Activity Understanding

Unknown

EgoFun3D

3dlg-hcvc · 2026

EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates

Unknown

EgoGesture

Official source · 2018

EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition

Unknown

EgoHands

Official source · 2015

Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions

Unknown

EgoHOS

owenzlz · 2022

Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applications

Unknown

EgoHTR

Official source · 2026

EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal

Unknown

EgoInfinity

Rice RobotPI Lab · 2026-06-16

EgoInfinity is not a static dataset but a modular, upgradable data engine: it takes ordinary internet video of people manipulating objects and automatically recovers metric 4D hand–object interaction, then retargets that motion into executable robot joint trajectories — no manual annotation and no depth sensors. Runs over Meta FAIR's Action100M corpus —…

Open

EgoLife

EvolvingLMMs-Lab · 2025

EgoLife: Towards Egocentric Life Assistant

Unknown

EgoLive

Official source · 2026

EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks

Unknown

EgoMAGIC

Official source · 2026

EgoMAGIC: An Egocentric Video Field Medicine Dataset for Training Perception Algorithms

Unknown

EgoMe

HeqianQiu · 2025

EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real World

Unknown

EgoMimic

SimarKareer · 2024

EgoMimic: Scaling Imitation Learning via Egocentric Video

Unknown

EgoMM

Hugging Face · ldkong/EgoMM · 2026-05-10

A tri-modal egocentric dataset built from EgoLife and Ego-Exo4D sources, packaged into fixed-duration clips with optional narrations.

Closed

EgoObjects

facebookresearch · 2023

EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understanding

Unknown

EgoOops

Y-Haneji · 2024

EgoOops: A Dataset for Mistake Action Detection from Egocentric Videos Referring to Procedural Texts

Unknown

EgoPAT3D

ai4ce · 2022

Egocentric Prediction of Action Target in 3D

Unknown

EgoPressure

Official source · 2024

EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision

Unknown

EgoSchema

EgoSchema · 2023-08-17

A diagnostic video-language benchmark derived from Ego4D, designed to test temporal and causal reasoning over long first-person videos.

Closed

EgoSPT

JackYFL233 · 2026

Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation

Unknown

EgoStation Catalog

Hugging Face · zeno-labs/egostation-catalog-v1 · 2026-05-11

A CC-BY-NC-4.0 catalog dataset for egocentric first-person manipulation data, including GoPro pick-and-place metadata.

Open

EgoStation GoPro Pick-and-Place

Hugging Face · zeno-labs/egostation-gopro-pick-and-place-v1 · 2026-05-12

A non-gated CC-BY-NC-4.0 LeRobot-style dataset with GoPro first-person manipulation, hand-world coordinates, and 6DoF trajectory tags.

Open

EgoSteer

egosteer · 2026

EgoSteer: A Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videos

Unknown

EgoSuite-Open100K

Lightwheel · 2026-08-07

EgoSuite-Open100K is a large egocentric corpus of people performing everyday work tasks, captured on a head rig with stereo cameras and — on the EgoPro line — a camera on each wrist. Recordings carry 3D hand pose, full-body pose on the body subsets, and subtask-level semantic segments, and ship in LeRobot v3 and MCAP. Read the hours claim carefully. The…

Open

EgoSurgery

Fujiry0 · 2024

EgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery Videos

Unknown

EgoTactile

Official source · 2026

EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video

Unknown

EgoTouch

Official source · 2026

TouchAnything: A Dataset and Framework for Bimanual Tactile Estimation from Egocentric Video

Unknown

EgoTracks

Ego4D · 2023-05-05

An Ego4D benchmark focused on tracking objects through heavy hand interaction, occlusion, viewpoint changes, and object disappearance/reappearance.

Closed

EgoTraj

Official source · 2026

EgoTraj: Real-World Egocentric Human Trajectory Dataset for Multimodal Prediction

Unknown

EgoVerse

GaTech-RL2 · 2026

EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World

Unknown

EgoVid-5M

JeffWang987 · 2024

EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation

Unknown

EgoWorld

Hugging Face · haoyang-li/EgoWorld · 2026-03-30

A compact egocentric bimanual manipulation dataset with world-frame 3D hand poses, MANO meshes, camera trajectories, depth maps, and 40D action/state vectors.

Open

EgoXtreme

Official source · 2026

EgoXtreme: A Dataset for Robust Object Pose Estimation in Egocentric Views under Extreme Conditions

Unknown

EGTEA Gaze+

Official source · 2018

In the Eye of the Beholder: Gaze and Actions in First Person Video

Unknown

ENIGMA-51

fpv-iplab · 2023

ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios

Unknown

EO-Data1.5M

IPEC-COMMUNITY / EO-Robotics · 2025-08-28

A large multimodal corpus combining vision, text, embodied reasoning, and action supervision for EO-1 pretraining.

Open

EPIC-KITCHENS

Official source · 2018

Scaling Egocentric Vision: The EPIC-KITCHENS Dataset

Unknown

EPIC-KITCHENS-100

University of Bristol (with University of Catania and University of Toronto) · 2022-06-01

EPIC-KITCHENS-100 is the largest annotated egocentric (head-mounted camera) dataset of unscripted daily kitchen activities, comprising 100 hours of video (20M frames) across 700 variable-length videos recorded by 37 participants in 45 kitchens across 4 cities. It provides ~90K fine-grained action segments with dense language narrations, plus optical flow,…

Open

exUMI

silicx · 2025

exUMI: Extensible Robot Teaching System with Action-aware Task-agnostic Tactile Representation

Unknown

F

9 records

FastUMI

zxzm-zak · 2024

FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Dataset

Unknown

FastUMI-100K

IPEC-COMMUNITY · 2025

FastUMI-100K: Advancing Data-driven Robotic Manipulation with a Large-scale UMI-style Dataset

Unknown

FEEL

Official source · 2026

FEEL (Force-Enhanced Egocentric Learning): A Dataset for Physical Action Understanding

Unknown

FMB

Official source · 2024

FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning

Unknown

FMB (Functional Manipulation Benchmark)

UC Berkeley (RAIL / Robotic AI & Learning Lab) · 2024-01-16

FMB is a real-world robotic manipulation benchmark from UC Berkeley's RAIL lab for studying functional manipulation, where a Franka Panda arm composes skills (grasping, repositioning, assembly/insertion) using 3D-printed objects on assembly boards. It comprises 22,550 expert demonstration trajectories across single-object and multi-object multi-stage tasks,…

Open

FPHA

guiggh · 2017

First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations

Unknown

FreeTacMan

OpenDriveLab · 2025

FreeTacMan: Robot-free Visuo-Tactile Data Collection System for Contact-rich Manipulation

Unknown

FTP-1 Dataset

FTP-1 (Yuan et al.) · 2026-06-11

FTP-1-Dataset is the heterogeneous pretraining corpus behind FTP-1 (A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation). It aggregates roughly 3,000 hours of contact-rich manipulation data from 26 sources spanning human demonstrations, dexterous-hand, and gripper robots, recorded with 21 distinct tactile sensors…

Open

FurnitureBench

CLVR Lab, KAIST · 2023-05-22

FurnitureBench is a reproducible real-world benchmark from CLVR Lab (KAIST) for long-horizon, complex robotic manipulation framed as furniture assembly with a Franka Panda arm. It releases 5100 successful teleoperation demonstrations totaling 219.6 hours across 9 furniture models and three task-initialization randomness levels (low/medium/high). The…

Open

G

3 records

H

15 records

H2O

taeinkwon · 2021

H2O: Two Hands Manipulating Objects for First Person Interaction Recognition

Unknown

HABIT (Human Aware Behavior and Interaction Training dataset)

Config · 2026-06-30

HABIT (Human-Aware Behavior and Interaction Training dataset) is a large-scale robot manipulation dataset collected in human-present environments, where a co-present human shares the workspace and interacts with the robot in every episode. 10,563 episodes, 164 hours of bimanual manipulation across 60 tasks Organized into three human-robot interaction roles…

Open

HapTile

Official source · 2026

HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning

Unknown

HaWoR

ThunderVVV · 2025

HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos

Unknown

HD-EPIC

hd-epic · 2025

HD-EPIC: A Highly-Detailed Egocentric Video Dataset

Unknown

HiFi-UMI-2K

Simple AI (Simple World Lab) · 2026

HiFi-UMI-2K is the public release from HiFi-UMI, a portable bimanual capture system built by Simple AI's Simple World Lab. Demonstrations are recorded by a human wearing a head-mounted stereo rig and a glove-like gripper on each hand — there is no robot, no teleoperation rig, and no instrumented room anywhere in the collection loop. The claim being tested.…

Open

HIW-500: Humanoids In-the-Wild

BitRobot · 2026-06-25

HIW-500 (Humanoids In-the-Wild) is a large-scale dataset for whole-body humanoid robot learning in natural home environments, capturing human teleoperation demonstrations on the Unitree G1 across 12 real homes in Southeast Asia. It contains 500+ hours and 23K+ episodes spanning 10+ household tasks with 161 subtask labels (~10 TB). Each episode records…

Open

HOI4D

leolyliu · 2022

HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction

Unknown

HoloAssist

Ember-HoloAssist · 2023

HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World

Unknown

HOT3D

facebookresearch · 2024

HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos

Unknown

HumanCLAW

Human-CLAW · 2026

HumanCLAW: Can Vision-Language Models Act Through a Body?

Unknown

HumanEgo

Official source · 2026

HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos

Unknown

Humanoid Everyday

USC Physical Superintelligence Lab · 2025-10-09

Humanoid Everyday is a large-scale, diverse humanoid manipulation dataset from USC's Physical Superintelligence Lab, collected via human-supervised teleoperation on real Unitree G1 and H1 humanoids. It comprises 10,300 trajectories and over 3 million frames across 260 tasks in 7 categories, spanning dexterous manipulation, human-humanoid interaction, and…

Open

HumanPlus

Stanford University · 2024-06-15

HumanPlus is a Stanford full-stack system that lets a customized 33-DoF Unitree H1 humanoid shadow human body and hand motion in real time from RGB cameras, and then learn autonomous whole-body skills via behavior cloning on teleoperated demonstrations. The low-level shadowing policy is trained in simulation using the 40-hour AMASS human-motion dataset; the…

Open

HuMI

Richard-coder-Nai · 2026

Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations

Unknown

I

4 records

K

2 records

L

11 records

Language-Table

Robotics at Google / Google Research · 2022-10-12

Language-Table is a suite of human-collected datasets and a multi-task continuous control benchmark for open-vocabulary visuolinguomotor learning, released with the paper 'Interactive Language: Talking to Robots in Real Time'. It contains nearly 600,000 natural-language-labeled trajectories of a UFACTORY xArm6 robot moving colored blocks on a tabletop…

Open

LEGATO

ut-hcrl · 2025

LEGATO: Cross-Embodiment Imitation Using a Grasping Tool

Unknown

LEMMA

Buzz-Beater · 2020

LEMMA: A Multi-View Dataset for Learning Multi-Agent Multi-Task Activities

Unknown

LeRobot Community Datasets

Hugging Face LeRobot community · 2025

A growing collection of community-contributed robot datasets used to pretrain and adapt open policies such as SmolVLA.

Open

LeRobot Shirt-Folding Dataset

LeRobot (Hugging Face) · 2026-06-22

The shirt-folding dataset from LeRobot's open-source 'Unfolding Robotics: Open-Source Shirt Folding from Data to Deployment' project, which trained a bimanual robot to fold t-shirts at a 90% success rate. Collected via real-world leader-follower teleoperation across 8 bimanual setups optimizing for diversity (25+ t-shirts, 8 backgrounds, varied camera/robot…

Open

LESS (Local Encoder for Spatial Sensing)

Technion – Israel Institute of Technology · 2026-06-12

LESS ("More with LESS: Local Scene Representations for Tactile Imaging", RSS 2026) tackles artificial palpation — reconstructing what is inside a soft object purely by touching it. The motivating application is breast cancer screening, where over 40% of cases are first detected by palpation. >800 hours of robotic tactile interaction, released as ~66 GB…

Open

LET-Base-Dataset

Official source · 2026

LET-Base-Dataset: LET Basic Operation Dataset

Unknown

LIBERO

UT Austin — Lifelong Robot Learning (Bo Liu, Yifeng Zhu, Yuke Zhu, Peter Stone) · 2023-06-05

LIBERO is a benchmark for knowledge transfer in lifelong robot learning, and its defining feature is experimental control rather than scale. Three of its suites hold everything fixed except one factor, so a policy's failure can be attributed to a specific kind of distribution shift instead of to "the scene changed". The five suites. LIBERO-Spatial (10…

Open

LIBERO-Long LeRobot

Robbyant / LIBERO · 2026-04-24

A LeRobot-formatted LIBERO-Long release used for post-training and evaluating video-action and VLA policies on extended tasks.

Open

LIBERO-Plus

Fudan University and Shanghai Innovation Institute (with Tongji University and NUS) · 2025-10-14

LIBERO-Plus takes the position that headline success rates on LIBERO hide how brittle vision-language-action policies actually are, and it tests that by perturbing the benchmark rather than extending it. The tasks are the same; what changes is everything around them. Seven perturbation factors, decomposed into 21 low-level components: object layout, camera…

Open

LingBot Masked Depth Modeling Data

Robbyant · 2026-03-21

A roughly three-million-sample mixture of real indoor, robot-manipulation, and simulated RGB-D data used by LingBot-Depth.

Open

M

18 records

ManipArena

ManipArena (SYSU x MBZUAI) · 2026-03-30

ManipArena is a comprehensive real-world benchmark for evaluating reasoning-oriented generalist robot manipulation, run as a CVPR 2026 Embodied AI Workshop challenge. It provides 10,812 expert trajectories (~188 hours, 13.5M frames) across 20 real tasks spanning execution-reasoning, semantic-reasoning, and long-horizon mobile manipulation, plus 3…

Open

ManipForce

gist-ailab · 2025

ManipForce: Force-Guided Policy Learning with Frequency-Aware Representation for Contact-Rich Manipulation

Unknown

ManiSkill2

UC San Diego (Hao Su Lab / SAPIEN) · 2023-02-09

ManiSkill2 is a unified, fully simulated robotic manipulation benchmark built on the SAPIEN physics engine, covering 20 manipulation task families with 2000+ object models and 4M+ verified demonstration frames. It spans stationary and mobile-base, single- and dual-arm, and rigid- and soft-body tasks, with RGB, depth/RGBD, and point-cloud observations and a…

Open

ManiWAV

real-stanford · 2024

ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Data

Unknown

Manus Egocentric Sample

Hugging Face · OpenGraphLabs-Research/manus-egocentric-sample · 2026-01-01

An Apache-2.0 robotics dataset sample with egocentric video, hand tracking, Manus glove signals, and imitation-learning oriented metadata.

Open

MECCANO

fpv-iplab · 2020

The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-Like Domain

Unknown

MicroAGI01

Hugging Face · MicroAGI-Labs/MicroAGI01 · 2026

An egocentric RGB-D household manipulation dataset with camera pose, 3D hand landmarks, task segmentation, and MCAP recordings.

Closed

MIME

Official source · 2018

Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation

Unknown

MimicGen

NVIDIA (with The University of Texas at Austin) · 2023-10-26

MimicGen is a data-generation system (CoRL 2023, NVIDIA + UT Austin) that synthesizes large-scale robot manipulation datasets by adapting a small set of human teleoperation demonstrations to new object poses, objects, and robot embodiments. The public release contains over 48,000 simulated task demonstrations across 12 tasks (categories:…

Open

Mobile ALOHA

Stanford University · 2024-01-04

Mobile ALOHA is a teleoperated mobile bimanual manipulation dataset collected by Fu, Zhao, and Finn (Stanford) using the low-cost whole-body Mobile ALOHA system, with ~50 human demonstrations per task across whole-body tasks such as sauteing shrimp, opening a two-door cabinet, calling/entering an elevator, and rinsing a pan. The TFDS/Open X release contains…

Open

MobileEgo Anywhere

fpvlabs · 2026

MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware

Unknown

MolmoAct Dataset

Allen Institute for AI (Ai2) · 2026-05-04

Ai2's self-collected MolmoAct real-robot manipulation dataset, used to train MolmoAct action reasoning models, covering household and tabletop domains. The Household split has 7,529 episodes across 115 tasks with varying viewpoints; the Tabletop split adds 2,959 episodes across 19 tasks with a fixed exocentric camera (~10,488 episodes total). It uses a…

Open

MolmoAct2 Bimanual YAM Dataset

Allen Institute for AI (Ai2) · 2026-05-04

A large-scale bimanual manipulation dataset collected by Ai2 for MolmoAct2 using paired YAM follower arms. It contains 32,246 episodes (76M frames) spanning 34 tabletop tasks with 720+ hours of teleoperated demonstrations. Each episode provides three RGB camera views (left, right, top) plus 14-dim joint/gripper states, in LeRobot format with per-episode…

Open

MolmoAct2 SO-100/SO-101 Dataset

Allen Institute for AI (Ai2) · 2026-05-04

A MolmoAct2 resource from Ai2 providing per-episode annotated language instructions for low-cost SO-100 and SO-101 arm data sourced from 1,220 community LeRobot repositories (377 users). It does not re-host trajectories; each source dataset gets a tasksannotated.parquet of refined instructions indexed by episode, with the source repos listed in…

Open

MolmoBot

Allen Institute for AI (Ai2) · 2026-03-17

MolmoBot is a large-scale, fully-simulated robot manipulation dataset from Ai2 (Allen Institute for AI), built to enable zero-shot sim-to-real transfer. ~1.7M expert trajectories (5,704 hours) across 8 task types — articulated-object manipulation (opening doors, drawers, cabinets) and pick-and-place Generated entirely in simulation (MuJoCo via Ai2…

Open

MotionTrans

Official source · 2025

MotionTrans: Human VR Data Enable Motion-Level Learning for Robotic Manipulation Policies

Unknown

MT-Opt

KarolHausman · 2021

MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale

Unknown

MV-UMI

Official source · 2025

MV-UMI: A Scalable Multi-View Interface for Cross-Embodiment Learning

Unknown

N

2 records

O

9 records

OBayData Dexterous Manipulation Demo

Hugging Face · obaydata/egocentric-dexterous-manipulation-demo · 2026-03-18

A non-gated CC-BY-NC-4.0 demo dataset with first-person dexterous manipulation, hand-pose, object-detection, and robotics tags.

Open

OmniH2O

LeCAR-Lab · 2024

OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learning

Unknown

OmniViTac

Official source · 2026

OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation

Unknown

Open Galaxea

Official source · 2025

Galaxea Open-World Dataset and G0 Dual-System VLA Model

Unknown

Open X-Embodiment

Google DeepMind / Open X-Embodiment collaboration · 2023-10-13

A large multi-institution collection spanning 22 robot embodiments and hundreds of skills for cross-robot policy learning.

Open

Open X-Embodiment (OXE)

Open X-Embodiment Collaboration (led by Google DeepMind) · 2023-10-13

Open X-Embodiment is a large-scale, standardized aggregation of robot learning datasets assembled by a collaboration of 21 institutions, pooling 60 existing datasets from 34 labs covering 22 robot embodiments and over 1 million real robot trajectories demonstrating 527 skills (160,266 tasks). All datasets are converted to a common RLDS (Reinforcement…

Open

Open-AoE

inclusionAI · 2026

Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning

Unknown

Open-H-Embodiment

Official source · 2026

Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

Unknown

OpenEgo

ahadjawaid · 2025

OpenEgo: A Large-Scale Multimodal Egocentric Dataset for Dexterous Manipulation

Unknown

P

5 records

Q

1 record

R

20 records

RealOmni

genrobot-ai · 2026

RealOmni-Open DataSet

Unknown

RealSource-World

Official source · 2025

RealSource-World: A Large-Scale Real-World Dual-Arm Manipulation Dataset

Unknown

REASSEMBLE

Official source · 2025

REASSEMBLE: A Multimodal Dataset for Contact-rich Robotic Assembly and Disassembly

Unknown

RekaDaily-10k

RekaAI · 2026

RekaDaily-10k: Collecting 10,000+ Hours of Egocentric Household Manipulation Data

Unknown

RH20T

Shanghai Jiao Tong University (Cewu Lu Lab / MVIG) · 2023-07-02

RH20T is a large-scale real-world robotic manipulation dataset of over 110,000 contact-rich manipulation sequences spanning 147 tasks (48 from RLBench, 29 from MetaWorld, 70 self-proposed), each paired with a human demonstration video. Data was collected on 7 hardware configurations using four robot arms (Flexiv, UR5, Franka, Kuka) with 8-10 global RGBD…

Open

RoboArena

RoboArena (multi-institution consortium) · 2025-08-05

RoboArena is a living, distributed real-robot benchmark: Chatbot Arena, but the contestants are robot policies and the arena is a network of physical Franka arms. Crucially, every episode is an autonomous policy rollout, not a teleoperated demonstration — a human is present only to reset the scene and score the result. 10,783 policy episodes across 3,883…

Open

RoboCasa

UT Austin (Yuke Zhu) and NVIDIA Research · 2024-06-04

RoboCasa is a MuJoCo/robosuite-based simulation framework of photorealistic kitchen environments for training generalist robots (used in NVIDIA's GR00T effort). The original RSS 2024 release provides 120 kitchen scenes (10 floor plans, 12 styles), 2,509 3D assets across 153 categories, and 100 tasks (25 atomic + 75 LLM-generated composite), with 50 human…

Open

RoboCOIN

Official source · 2025

RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulation

Unknown

RoboDojo

MMLab@HKU and collaborators · 2026-07-05

RoboDojo is a sim-and-real evaluation benchmark built to answer a blunt question: how good are generalist manipulation policies really? The answer it reports is sobering — the best of 30 policies evaluated in simulation reached only 8.80% success against 76.03% for human teleoperation. 60 tasks total: 42 simulation tasks (NVIDIA Isaac Sim 5.1 / Isaac Lab…

Open

robomimic

Stanford Vision and Learning Lab / ARISE Initiative · 2021-08-06

robomimic is a framework and dataset suite for robot learning from demonstration, released with the CoRL 2021 study 'What Matters in Learning from Offline Human Demonstrations for Robot Manipulation' (Mandlekar et al.). It provides teleoperated human and machine-generated demonstrations on five simulated robosuite/MuJoCo tasks (Lift, Can, Square, Transport,…

Open

RoboMIND

RoboMIND collaboration · 2024-12-18

A unified multi-embodiment manipulation dataset with successful demonstrations, real-world failures, and failure causes.

Open

RoboMIND 2.0

Official source · 2025

RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligence

Unknown

RoboNet

UC Berkeley (BAIR), Stanford, UPenn GRASP, Google Brain · 2019-10-24

RoboNet is a large-scale, open dataset for multi-robot learning, containing over 15 million video frames of robot-object interaction collected autonomously across four research labs (UC Berkeley BAIR, Stanford AI Lab, UPenn GRASP, Google Brain Robotics). It aggregates data from 7 robot platforms (Sawyer, Franka Panda, Baxter, Fetch, Google R3, Kuka LBR…

Open

RoboSet

robopen · 2023

RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking

Unknown

RoboSet (RoboAgent)

Carnegie Mellon University and Meta AI · 2023-09-05

RoboSet is a large-scale real-world multi-task robot manipulation dataset collected on Franka-Emika Panda arms with Robotiq grippers across everyday kitchen scenes, combining teleoperated (9,500) and kinesthetic-playback (19,000) demonstrations. It spans 12 manipulation skills expressed across 38 tasks, recording RGB and depth frames from 4 camera views…

Open

Robotic Interestingness Dataset (SubTF)

CMU AirLab · 2020-05-18

The Robotic Interestingness Dataset (also called the SubT Front Camera, or SubTF, dataset) from CMU's AirLab is a visual scene dataset for studying online prediction of visually 'interesting' scenes for mobile robots. It consists of 7 long-form video sequences (~53-83 minutes each, ~467.7 minutes / ~7.8 hours total) recorded from the front-facing RGB camera…

Open

RoboTurk

RoboTurk-Platform · 2018

RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation

Unknown

RoboTwin 2.0

RoboTwin Platform · 2024-09-18

A configurable dual-arm data generator and benchmark with strong domain randomization, pre-collected trajectories, and LeRobot integration.

Open

RT-1

google-research · 2022

RT-1: Robotics Transformer for Real-World Control at Scale

Unknown

RT-1 Robot Action Dataset

Google (Robotics at Google / Everyday Robots) · 2022-12-13

The RT-1 robot action dataset (fractal20220817_data in Open X-Embodiment) contains 87,212 human-teleoperated demonstration episodes of tabletop manipulation with 17 objects, collected on Google's Everyday Robots mobile manipulators. Each step pairs an RGB image and natural-language instruction with a discretized arm+base action, plus…

Open

S

2 records

T

11 records

TAMEn

OpenDriveLab · 2026

TAMEn: Tactile-Aware Manipulation Engine for Closed-Loop Data Collection in Contact-Rich Tasks

Unknown

TartanAir

CMU AirLab · 2020-03-31

TartanAir is a large-scale synthetic dataset for visual SLAM and robot navigation, released by CMU's AirLab (Robotics Institute) and presented at IROS 2020. Data is collected in 30 photo-realistic Unreal Engine environments via the AirSim plugin, spanning urban, rural, nature, domestic, public and sci-fi scenes, with challenging conditions including…

Open

TartanAir V2

CMU AirLab · 2024-03-01

TartanAir V2 is a large-scale photorealistic synthetic dataset built on Unreal Engine 4 with the AirSim plugin, developed by CMU's AirLab (castacks) to push the limits of visual SLAM, navigation, and robotics perception. It contains 65 highly distinct simulated environments covering urban, rural, domestic, infrastructure, thematic, and nature scenarios,…

Open

TartanAviation

CMU AirLab · 2024-03-05

TartanAviation is an open-source multimodal dataset focused on terminal-area airspace operations at general-aviation airports, providing a holistic view of the airport environment by concurrently collecting image, speech, and ADS-B trajectory data using sensor setups installed within airport boundaries. It contains 3.1 million images across 550 sequences…

Open

TartanDrive

CMU AirLab · 2022-05-03

TartanDrive is a large-scale real-world off-road driving dataset from CMU's AirLab, built for learning off-road vehicle dynamics models. It contains roughly 200,000 off-road driving interactions (about five hours of data) collected on a modified Yamaha Viking ATV driven across diverse terrain. The authors describe it as the largest real-world multimodal…

Open

TartanDrive 2.0

CMU AirLab · 2024-02-02

TartanDrive 2.0 is an expanded large-scale off-road driving dataset from CMU's AirLab, collected on a Yamaha Viking All-Terrain Vehicle (ATV named 'Vicky') over 255+ acres of diverse terrain in Western Pennsylvania (narrow paths, dense foliage, rocky areas, dirt paths, steep hills). It comprises roughly 7 hours of data at speeds up to 15 m/s. Building on…

Open

TASTE-Rob

GAP-LAB-CUHK-SZ · 2025

TASTE-Rob: Advancing Video Generation of Task-Oriented Hand-Object Interaction for Generalizable Robotic Manipulation

Unknown

THU-READ

Official source · 2017

Action Recognition in RGB-D Egocentric Videos

Unknown

Touch and Go

fredfyyang · 2022

Touch and Go: Learning from Human-Collected Vision and Touch

Unknown

Touch in the Wild

YolandaXinyueZhu · 2025

Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper

Unknown

TrajAir

CMU AirLab · 2021-09-30

TrajAir is a general-aviation aircraft trajectory dataset collected by CMU's AirLab (Robotics Institute) around the non-towered Pittsburgh-Butler Regional Airport (ICAO: KBTP), a single-runway GA airport ~10 miles north of Pittsburgh, PA. Data was recorded with an on-site ADS-B receiver (1090 MHz / 978 MHz, plus TIS-B for non-equipped aircraft) over 8…

Open

U

7 records

U2UData+

Tsinghua University — THU-EAI Lab · 2025-08-25

U2UData+ (published under the name U2UData-2) is a large-scale swarm-UAV dataset for Embodied Long-Horizon tasks, collected entirely in the U2USim UE5.2/AirSim simulator on terrain mapped from Yunnan Province. Fifteen UAVs fly in autonomous formation mode executing a wildlife-conservation task across 12 weather and terrain scenes, producing 720 traces of…

Open

UAV-Flow

Beihang University — Institute of Artificial Intelligence · 2025-05-14

UAV-Flow is the first real-world benchmark for language-conditioned, fine-grained UAV trajectory control, framed as the "Flying-on-a-Word" (Flow) task. Certified pilots — each with 800+ hours of experience — manually flew 30,692 short-range trajectories across three university campuses (5.02 km²) on DJI Mavic 3T RTK platforms, flying exclusively from the…

Open

UAV-Flow-Sim

Beihang University — Institute of Artificial Intelligence · 2025-05-14

UAV-Flow-Sim is the simulated half of the UAV-Flow benchmark, built in an Unreal Engine campus environment and used for systematic, repeatable evaluation of language-conditioned UAV policies. It contains 10,109 trajectories spanning 10 Flow task types, with the same schema as the real split — atomic language instruction, egocentric RGB observation, and…

Open

UMI

real-stanford · 2024

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots

Unknown

UMI-3D

hku-mars · 2026

UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception

Unknown

UMI-on-Legs

real-stanford · 2024

UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllers

Unknown

Unitree UnifoLM-WBT

Official source · 2026

UniFoLM-WBT-Dataset

Unknown

V

2 records

W

5 records

X

1 record

Y

2 records