Circuit Tracing: Finding Medical Features in Gemma 3

Feb 4 · 4 min read · Language models can answer medical questions with surprising accuracy. But do they actually encode medical knowledge in identifiable, interpretable ways? Or is it all just statistical soup? Using Neuronpedia, we ran a simple experiment to find out. W...