Train on prefill, monitor at decode: Using sparse autoencoders for topic monitoring
Small causal detectors on sparse autoencoder features label every token a model writes with a topic, so the label can change partway through a response. Trained on prefill, they carry over to decoding on Gemma 3 1B and 4B.
arXiv GitHub Research log