What Happens After Post-Training Data Collection?
Since launching Axis V2, human-gated DAgger correction has been a core part of our data engine. In this thread, we share a series of experiments exploring how to best process and use post-training data.
The core finding: not every human intervention helps. But if you verify which specific actions actually change the outcome — and train only on those — the improvements are real and they scale.
Results:
- 660 corrections collected → 161 (24.4%) entered training
- Each training snippet is ~0.8 seconds
- Naively imitating full human trajectories dropped success from 40.0% to 36.7%, while 161 verified snippets lifted the three-seed average to 48.3% on the same evaluation set — and reached 48.8–52.5% across three seeds in a separate paired evaluation.
Read the full blog:
Details below ⬇️
显示更多