How Robots LearnGuides

The library

Articles

A conceptual illustration shows a robot transferring the same latent action between two different visual starting contexts through a shared temporal-effect representation.

TERRA Uses Compact Temporal Effects and EAT to Preserve Latent-Action Meaning

TERRA learns latent actions from compact representations of temporal visual change. Its EAT mechanism aligns the effects produced by the same code across different initial states, while the reported evaluations remain claims from the preprint’s authors.

Conceptual illustration of a recorded human hand interaction being converted into hand-pose, contact and force maps for robot learning.

RLHND Extracts Hand Motion and Touch Estimates From a Single Video View

RLHND converts a pretrained Cosmos 3 video diffusion backbone into a deterministic clip-level feature extractor for monocular egocentric recordings. Separate streams estimate anatomically plausible hand pose and dense surface contact and force; the authors also claim leading benchmark performance and robot-learning utility, but the available abstract contains no numerical or task-level evidence.

Conceptual illustration of separate scenes with a person controlling a robot, a person beside a control, and a robot at a task with an observation clipboard.

When does human help teach a robot, and when is it part of a test?

A reading guide to human input during data collection, online training and evaluation, illustrated with LeRobot and Bee.

Conceptual illustration of task cards beside a robot arm and a dotted motion path.

Robot planners and action policies: what does each output?

Compare a skill selector with an action predictor, using the interfaces described by the SayCan and OpenVLA authors.

Illustration of a person recording portable body-and-hand camera views that are converted into motion guidance for a mobile manipulation robot.

How VOMMI Turns Portable RGB Recordings Into Robot Training Signals

VOMMI reconstructs motion from synchronized body and hand RGB views, then uses local-motion tokens to condition vision-language-action post-training. The authors report improvements in trajectory reconstruction, base-velocity error, and mean success across three real-robot tasks.

A generic humanoid robot uses one learned policy to carry, push and kick objects while recovering its balance.

How One Humanoid Policy Learns to Handle Different Objects

The I-BFM authors describe a policy that learns shared humanoid, object and contact dynamics, uses interaction and goal targets across different time scales, and follows latent commands associated with downstream rewards. They report 94.3% nominal success on Carry and 89.3% after robot falls, alongside experiments on a Unitree G1.