Robotics training data

Robots don't get a 90% chance.

9scale AI records, simulates and labels the data that takes robots from 90% to 99.9999% reliable.

01 / The gapReliability
90%

At 90% reliable,
10 in 100 fail.

Good enough for a demo. Not good enough for a robot working next to people.

02 / What we sell

The data robots learn trust from.

01

Recorded

Real people, real homes, real factories. Egocentric and teleoperated footage captured to spec, with hand pose, depth and multi-view on request.

  • Egocentric
  • Teleop
  • Multi-view
02

Simulated

Scenario-matched simulation that fills the long tail — the rare drops, slips and edge cases you can't wait to film in the real world.

  • Long-tail
  • Domain-randomised
  • Paired with real
03

Labelled

Every frame passes through LabelNow: segment boundaries, success / failure, rewards and QA by trained reviewers before it ships.

  • Segments
  • Rewards
  • Human QA
03 / From LabelNow

Real and simulated.
Side by side.

A

Recorded

Captured by real people on real tasks, then segmented and scored in LabelNow.

REC · 01
Move sample tubes tray to tray

Lab tube transfer

Modality
Handheld gripper · RGB + 6-DoF pose
Frames
2,493 frames
REC · 02
Pick bricks into second bin

Brick sorting

Modality
Handheld gripper · RGB + 6-DoF pose
Frames
1,967 frames
REC · 03
Lift rods out one by one

Rod pick & place

Modality
Handheld gripper · RGB + 6-DoF pose
Frames
1,375 frames
REC · 04
Transfer capped vials

Vial handling

Modality
Handheld gripper · RGB + 6-DoF pose
Frames
1,801 frames
B

Simulated

The same tasks rebuilt in simulation — with the edge cases reality rarely films.

SIM · 013× speed
Conveyor pick into target bin

Tube to bin

Modality
Sim · RGB + actions
Frames
3,232 frames
SIM · 023× speed
Place parts onto cups

Cup stacking

Modality
Sim · RGB + actions
Frames
5,906 frames
SIM · 033× speed
Sort conveyor parts by bin

Multi-bin packing

Modality
Sim · RGB + actions
Frames
1,770 frames
SIM · 043× speed
Pick from belt, place in bins

Bin shuffle

Modality
Sim · RGB + actions
Frames
3,193 frames

Same episode. Two worlds.

Real robot episodes rebuilt end to end — Gaussian-splat background, generated object meshes, MuJoCo physics. Drag the seam.

● Real robotSimulation ○
⟷
AUTOLab · Block into cupSource: public DROID episodes
04 / Real2Sim

Captured once. Rebuilt in physics.

Every capture is recorded so it can become a simulation environment — the same scene, the same camera, real contact physics.

Contact-driven physicsBlock lifted 12.6 cm · no scripting
Novel views of the scene360° fly-through of a rebuilt DROID scene

0.6 mm

Median depth error on the best rebuilt object

5 / 5

±2 mm perturbation trials passed

0

Unintended contacts while lifting by physics alone

Sim → Real

Trained in simulation.
Works on the real robot.

72%

Real-robot success on first deployment · zero real training data

UR5 bottle pick in simulation, with the simulated wrist camera view
Simulation · virtual lab and the wrist camera the policy sees
Real UR5 robot picking a bottle, wrist camera and external view
Real robot · same policy, wrist camera as its only input
05 / Pipeline

From capture
to checkpoint.

One pipeline, built on LabelNow, that turns raw human activity into training-ready robot data.

Handheld gripper closing on a tube, with jaw width measured on the frame
Grasp events labelled automatically from jaw width + camera pose
  1. 01 — CAPTURE

    Capture

    A distributed contributor network records tasks to your spec on phones and rigs.

  2. 02 — SIMULATE

    Simulate

    We mirror each real task in simulation and generate the variations reality can't.

  3. 03 — LABEL

    Label

    LabelNow annotates segments, outcomes and rewards — frame by frame.

  4. 04 — VERIFY

    Verify

    Multi-pass human QA with agreement scoring. Bad frames never ship.

  5. 05 — DELIVER

    Deliver

    Training-ready datasets in your format: RLDS, LeRobot, HDF5 or raw.

72%

Real-robot success, trained only in sim

96%

Sim success after scaling up

21,504

Simulated robots practising at once

173M

Practice steps per experiment

06 / Contact

Add a nine.

Tell us the task. We'll send back a sample dataset.

Interested in