AI

PerturBot: Breaking Shortcut Priors in Vision-Language-Action Models with Perturbative Training

Read full article at source ↗

Based on a feed excerpt; full article content has not been acquired. Source evidence retrieved 06/10/2026, 07:18:24 UTC.

Briefings

PerturBot is a framework designed to prevent Vision-Language-Action (VLA) models from relying on modality shortcuts—relying on visual, lexical, or motor cues instead of task evidence. By applying task-preserving wrist-view perturbations and enriching instructions with decision-relevant captions, the system makes task-relevant evidence easier to use. The framework includes GroundingFscore, an offline diagnostic tool that reveals how severely a policy relies on shortcuts. Task success rate and GroundingFscore together provide a training-and-evaluation framework for disentangling VLA decisions from shortcut priors while preserving responsiveness to task-relevant evidence.

Key points

• PerturBot applies task-preserving wrist-view perturbations to VLA policies to disrupt modality shortcuts.
• GroundingFscore is an offline diagnostic tool that reveals how severely a policy relies on modality shortcuts.

Context

VLA models often complete complex tasks by ignoring evidence that should determine actions, such as an object near the wrist camera displacing the instructed target. This modality shortcut behavior is common across visual, lexical, and motor modalities, making it difficult to ensure policies rely on task evidence rather than learned regularities.

Limitations

Evidence is limited to a single study proposing PerturBot and GroundingFscore. No specific dataset sizes, model architectures, or experimental results are provided. The framework's effectiveness and scalability remain untested in real-world scenarios.

Generated by Bittrees-hosted qwen35-2b sha256:aaf42c8b7c3c on 19/10/2026, 01:02:35 UTC. Based on publisher-provided feed evidence; may not cover the full original article. Check the source for details.

View archived briefing on IPFS
bafybeibh3zznc6pcjjqtfs2me3rbmmjgeodd3bm62zin546c476bjkaiuq