Llama — Field Evidence

Crossing the Margin Cliff: Toward Relearn-Robust LLM Unlearning via Margin Calibration — Large language model unlearning is consistently fragile under relearn attacks. On TOFU, fine-tuning on twenty forget examples substantially recovers held-out forget-set ROUGE for every method