arXiv Aug 13, 2025Emergent Misalignment: When Narrow Finetuning Goes WrongSpooky result: finetuning a model on something innocuous can break alignment in unrelated areas. Alignment might be more brittle than we thought, which is not great news for anyone shipping finetuned models.
Spooky result: finetuning a model on something innocuous can break alignment in unrelated areas. Alignment might be more brittle than we thought, which is not great news for anyone shipping finetuned models.