CanIEmbody

Embodiment gap

Also: cross-embodiment gap, embodiment mismatch

The differences in kinematics, action space, sensors and dynamics between the robots a policy was trained on and the robot it is deployed on.

The embodiment gap is the set of differences between the robot that produced a policy's training data and the robot the policy is asked to control. It covers the number and arrangement of joints (degrees of freedom), the action representation (joint positions or end-effector deltas), gripper type, camera count and placement, control rate, and actuator dynamics. A policy has no built-in way to map actions across these differences; it learns mappings only for the embodiments in its data.

Cross-embodiment pretraining tries to narrow the gap through data diversity. The Open X-Embodiment collaboration (2023) assembled "a dataset from 22 different robots collected through a collaboration between 21 institutions" and reported positive transfer for its RT-X models. Later VLAs make the embodiment explicit. LeRobot's X-VLA documentation starts from the problem that "Robot data is fragmented across platforms, sensors, embodiments, and collection protocols", and X-VLA learns soft-prompt embeddings per hardware setup. GR00T N1.7 is described as a cross-embodiment policy. SmolVLA pads state and action vectors to a fixed width of 32 in LeRobot v0.6.1 so that different robots fit one network.

A common misconception is that a pretrained generalist VLA runs zero-shot on any robot. The OpenVLA-OFT paper (Kim et al., 2025) observes that VLAs "struggle with novel robot setups and require fine-tuning to achieve good performance". Deploying a pretrained checkpoint on a robot absent from its pretraining data, such as an SO-101, normally means collecting demonstrations on that robot and fine-tuning. The gap is distinct from sim-to-real transfer, which concerns one robot in two worlds.

Policies where this matters

X-VLA · GR00T N1.7 · SmolVLA · OpenVLA-OFT

Related

Degrees of freedom · Vision-language-action model · Sim-to-real transfer · Affordance · Parameter-efficient fine-tuning (PEFT) and LoRA

Sources

  1. T1 · upstream documentedpapersource 2023-10-13verified 2026-10-24 (1d ago)

    Open X-Embodiment: dataset from 22 robots; RT-X shows positive transfer.

    “We assemble a dataset from 22 different robots collected through a collaboration between 21 institutions, demonstrating 527 skills (160266 tasks).”
    https://arxiv.org/abs/2310.08864
  2. T1 · upstream documentedpapersource 2025-02-27verified 2026-10-24 (1d ago)

    OpenVLA-OFT: VLAs need fine-tuning for novel robot setups.

    “VLAs struggle with novel robot setups and require fine-tuning to achieve good performance”
    https://arxiv.org/abs/2502.19645
  3. T1 · upstream documentedofficial-docssource 2026-08-03verified 2026-10-24 (1d ago)lerobot 0.6.1

    LeRobot X-VLA docs on embodiment heterogeneity.

    “Robot data is fragmented across platforms, sensors, embodiments, and collection protocols.”
    https://github.com/huggingface/lerobot/blob/v0.6.1/docs/source/xvla.mdx
  4. T1 · upstream documentedofficial-docssource 2026-08-03verified 2026-10-24 (1d ago)lerobot 0.6.1

    LeRobot describes GR00T as a cross-embodiment policy.

    “It is a cross-embodiment policy that accepts multimodal input, including language, images, and proprioception”
    https://github.com/huggingface/lerobot/blob/v0.6.1/docs/source/groot.mdx
  5. T1 · upstream documentedsource-codesource 2026-08-03verified 2026-10-24 (1d ago)lerobot 0.6.1

    SmolVLA pads actions to 32 dimensions in LeRobot v0.6.1.

    “max_action_dim: int = 32”
    https://github.com/huggingface/lerobot/blob/v0.6.1/src/lerobot/policies/smolvla/configuration_smolvla.py