'Mechanistic Interpretability of Antibody Language Models Using SAEs' arXiv 2512.05794 — domain-specific SAE application extends mech-interp methodology to protein-and-antibody language models
The arXiv 2512.05794 paper extends sparse autoencoder mechanistic interpretability methodology to antibody language models — demonstrating SAEs as mechanistic interpretability technique for biological-domain language models. The domain-specific application extends mech-interp infrastructure beyond general LLMs to specialized scientific domains.
The substantive piece is the domain-specific application extension. Pre-paper SAE interpretability research dominantly focused on general-purpose LLMs (Anthropic Claude, Google Gemma). Antibody language model application extends the methodology to biological-domain language models — substantially different domain with specialized scientific use cases (drug discovery, antibody design, immune system research).
The competitive read against the broader 2026 SAE methodology landscape is that domain-specific applications represent productive methodology direction alongside methodology-refinement direction. Concept-annotation methodology + Binary Sparse Coding + domain-specific applications together expand SAE methodology beyond the general-purpose-LLM baseline that DeepMind's deprioritization cited as underperforming.
arXiv — Mechanistic Interpretability of Antibody Language Models Using SAEs (2512.05794) → · arXiv — ProtSAE: Disentangling and Interpreting Protein Language Models via Semantically-Guided Sparse Autoencoders →