Subliminal Learning is a LoRA Artifact
Quick summary
arXiv:2606.00831v2 Announce Type: replace Abstract: Subliminal learning is a phenomenon where language models can transmit behavioral traits to other models through seemingly innocuous data (Cloud et al., 2025). In subliminal learning, a teacher model with a behavioral trait (e.g. obsession with cats) can transmit this cat obsession to a student model finetuned only on numerical sequences generated by the teacher. In this paper, we ask: how does this unexpected behavioral transmission occur? We show that subliminal learning is a LoRA artifact. When subliminal learning occurs, transmission has
Key takeaways
- arXiv:2606.00831v2 Announce Type: replace Abstract: Subliminal learning is a phenomenon where language models can transmit behavioral traits to other models through seemingly innocuous data (Cloud et al., 2025).
- In subliminal learning, a teacher model with a behavioral trait (e.g.
- obsession with cats) can transmit this cat obsession to a student model finetuned only on numerical sequences generated by the teacher.
Why it matters
The value of this work lies as much in how it was tested as in the claim itself. Sample design, baselines, uncertainty and replication help separate a laboratory result from real-world impact.
Member comments