CanIEmbody

Behavioral cloning

Also: BC, behavior cloning

Supervised learning of a policy that maps observations to the actions a demonstrator took, with no reward signal or environment interaction during training.

Behavioral cloning (BC) is the simplest form of imitation learning: record observation–action pairs from a demonstrator and fit a policy to them with supervised learning. It needs no reward function, simulator or online interaction. An early, widely cited example is ALVINN (Pomerleau, NIPS 1988), a neural network that mapped camera and laser range-finder input to the direction a vehicle should travel to follow a road.

Most manipulation policies in this matrix are trained by behavioral cloning on teleoperated demonstrations, including ACT, Diffusion Policy, SmolVLA, and the fine-tuning stage of large VLAs such as π0. They differ in the model used to represent the action distribution (a conditional VAE in ACT, a diffusion model, flow matching or discrete action tokens) and in how much pretraining comes before the cloning step. Modern BC is therefore not plain regression. Generative action heads exist because demonstrations are multimodal, and regressing to their mean can produce an action no demonstrator took.

BC's known weakness is distribution shift. The policy only sees states the demonstrator visited; at deployment its own small errors take it elsewhere, and errors accumulate. The ACT paper (Zhao et al., 2023) calls this the "compounding error" problem of imitation learning. Remedies include action chunking, DAgger-style corrective data, and combining BC with reinforcement learning, as in HIL-SERL.

A common misconception is that more demonstrations always help. Demonstrations that differ in strategy or speed make the target distribution harder to model; the ACT abstract names non-stationary human demonstrations as a challenge alongside compounding error.

Policies where this matters

ACT · Diffusion Policy · SmolVLA · π0 · HIL-SERL

Related

Imitation learning · DAgger · Action chunking · Teleoperation · Diffusion policy

Sources

  1. T1 · upstream documentedpaperverified 2026-10-24 (1d ago)

    Pomerleau (NIPS 1988): ALVINN, a neural network trained to map sensor input to steering direction.

    “ALVINN (Autonomous Land Vehicle In a Neural Network) is a 3-layer back-propagation network designed for the task of road following.”
    https://papers.nips.cc/paper_files/paper/1988/hash/812b4ba287f5ee0bc9d43bbf5bbe87fb-Abstract.html
  2. T1 · upstream documentedpapersource 2023-04-23verified 2026-10-24 (1d ago)

    ACT paper names compounding errors and non-stationary demonstrations as challenges.

    “errors in the policy can compound over time, and human demonstrations can be non-stationary.”
    https://arxiv.org/abs/2304.13705