Story-Gradient Editing Can Misattribute Newly Learned Real Facts.
When a model is updated with gradients from a story, what happens to the real facts it learns at the same time? This manuscript looks at how the model reports a fact’s source, judges it, and uses it, and finds that these can come apart.