CanIEmbody

Action tokenization

Also: action discretization, action tokens

Converting continuous robot actions into discrete tokens so that an autoregressive transformer can predict them the way it predicts text.

Action tokenization maps continuous action vectors to a sequence of discrete symbols from a fixed vocabulary, so that an autoregressive model, typically a language-model backbone, can predict actions with the same next-token objective it uses for text. RT-2 (Brohan et al., 2023) established the approach for VLAs by expressing robot actions "as text tokens". The simplest scheme bins each action dimension independently: OpenVLA discretizes "each dimension of the robot actions separately into one of 256 bins", with bin edges set from the 1st and 99th percentiles of the training actions.

Per-dimension, per-timestep binning degrades at high control frequency. FAST (Pertsch et al., "FAST: Efficient Action Tokenization for Vision-Language-Action Models", 2025) found that such schemes "typically perform poorly when learning dexterous skills from high-frequency robot data". FAST instead compresses an action chunk with the discrete cosine transform before tokenizing. π0-FAST is π0 trained with this tokenizer. VQ-BeT learns its vocabulary instead, "tokenizing continuous actions with a hierarchical vector quantization module".

Tokenization sets decoding cost. An autoregressive VLA emits tokens one forward step at a time, so latency grows with the number of tokens per chunk. Continuous heads, such as flow matching, diffusion or the L1 regression with parallel decoding used by OpenVLA-OFT, produce the whole chunk in a fixed number of passes.

A common misreading concerns FAST's headline speed-up. The FAST paper reports matching diffusion VLAs "while reducing training time by up to 5x". That figure is about training, not inference speed, and should not be quoted as a latency advantage of π0-FAST over π0.

Policies where this matters

OpenVLA · π0-FAST · VQ-BeT · OpenVLA-OFT · π0

Related

Vision-language-action model · Action chunking · Flow matching · Inference latency

Sources

  1. T1 · upstream documentedpapersource 2023-07-28verified 2026-10-24 (1d ago)

    RT-2 expresses robot actions as text tokens.

    “we express the actions as text tokens and incorporate them directly into the training set of the model in the same way as natural language tokens.”
    https://arxiv.org/abs/2307.15818
  2. T1 · upstream documentedpapersource 2024-06-13verified 2026-10-24 (1d ago)

    OpenVLA bins each action dimension into 256 bins.

    “we discretize each dimension of the robot actions separately into one of 256 bins.”
    https://arxiv.org/html/2406.09246
  3. T1 · upstream documentedpapersource 2025-01-16verified 2026-10-24 (1d ago)

    FAST: DCT-based action tokenization; training up to 5x faster.

    “we propose a new compression-based tokenization scheme for robot actions, based on the discrete cosine transform.”
    https://arxiv.org/abs/2501.09747
  4. T1 · upstream documentedpapersource 2024-03-05verified 2026-10-24 (1d ago)

    VQ-BeT tokenizes actions with hierarchical vector quantization.

    “VQ-BeT augments BeT by tokenizing continuous actions with a hierarchical vector quantization module.”
    https://arxiv.org/abs/2403.03181