Glossary
Catastrophic forgetting — Glossary
When fine-tuning erases useful behaviors the base model previously had.
Full definition
Mitigate with mixed training data, parameter-efficient methods, and regression eval suites covering general skills plus the specialty task.