An Unchanged Answer Can Hide an Operand’s Causal Role.
When the final answer does not move, an operand can still matter. This work traces its contribution through attention and the MLP layers after it.
Manuscript
An Unchanged Answer Can Hide an Operand’s Causal Role.
When the final answer does not move, an operand can still matter. This work traces its contribution through attention and the MLP layers after it.