01
Scale-Dependent Structural Mimicry in Distilled Reasoning Models
Do distilled models reason, or do they imitate the shape of reasoning?
Read the abstract
This work introduces Causal Trajectory Attribution, a method for studying reasoning traces in distilled language models. It asks whether the reasoning patterns we commonly observe reflect genuine causal reasoning or structural habits inherited from larger teacher models.
The answer shapes how far we can trust chain-of-thought as evidence of understanding. It also shows how reasoning transfers when models are compressed.