GAIN: Multiplicative Modulation for Domain Adaptation

arXiv:2604.04516v2 Announce Type: replace-cross Abstract: Adapting LLMs to new domains causes forgetting because standard methods (e.g., full fine-tuning, LoRA) inject new directions into the weight space. We show that forgetting is governed by one algebraic property: whether the update preserves...