CanIEmbody

Vision-language-action model

Also: VLA, VLA model

A robot policy built on a pretrained vision-language model that maps camera images, a language instruction and robot state to actions.

A vision-language-action model (VLA) is a robot policy that takes camera images and a natural-language instruction, usually with proprioceptive state, and outputs robot actions. It is built by adapting a vision-language model (VLM) pretrained on Internet-scale data. The term comes from the RT-2 paper (Brohan et al., 2023): "We refer to such category of models as vision-language-action models (VLA)". RT-2 co-fine-tuned a VLM on robot trajectories and web data and emitted actions as text tokens.

VLAs differ mainly in how they produce actions. Autoregressive VLAs such as OpenVLA and π0-FAST predict discrete action tokens. Others attach a continuous action head to the VLM: π0, π0.5, SmolVLA, GR00T N1.7, X-VLA, EO-1 and EVO-1 use flow matching, while OpenVLA-OFT uses parallel decoding with L1 regression. Size varies widely, from OpenVLA's 7B parameters to SmolVLA, which is "designed to be trained on a single GPU and deployed on consumer-grade GPUs or even CPUs".

Two misconceptions recur. "VLA" names an architecture family, not a capability level. Language conditioning does not mean the model follows arbitrary instructions on a new robot, and deployment on a robot absent from pretraining generally requires fine-tuning (see embodiment gap). Nor does the label imply a size: parameter count, action head and precision, not the acronym, decide whether a VLA fits on a Jetson Orin Nano or needs an H100.

Policies where this matters

OpenVLA · OpenVLA-OFT · π0 · π0-FAST · π0.5 · SmolVLA · GR00T N1.7 · X-VLA · EO-1 · Evo-1

Related

Action tokenization · Flow matching · Embodiment gap · Proprioception · Parameter-efficient fine-tuning (PEFT) and LoRA

Sources

  1. T1 · upstream documentedpapersource 2023-07-28verified 2026-10-24 (1d ago)

    RT-2 introduces the term vision-language-action model (VLA).

    “We refer to such category of models as vision-language-action models (VLA) and instantiate an example of such a model, which we call RT-2.”
    https://arxiv.org/abs/2307.15818
  2. T1 · upstream documentedpapersource 2024-06-13verified 2026-10-24 (1d ago)

    OpenVLA is a 7B-parameter open-source VLA.

    “we introduce OpenVLA, a 7B-parameter open-source VLA trained on a diverse collection of 970k real-world robot demonstrations.”
    https://arxiv.org/abs/2406.09246
  3. T1 · upstream documentedpapersource 2025-06-02verified 2026-10-24 (1d ago)

    SmolVLA targets single-GPU training and consumer-grade deployment.

    “SmolVLA is designed to be trained on a single GPU and deployed on consumer-grade GPUs or even CPUs.”
    https://arxiv.org/abs/2506.01844