AI & ML
Erased but Recoverable: On the Fragility of Concept Erasure Under Fine-Tuning
arXiv cs.CR0 views
arXiv:2611.24220v1 Announce Type: new Abstract: Existing concept erasure methods for text-to-image diffusion models primarily focus on suppressing target concepts while preserving non-target generation quality. However, in practical applications, open-source diffusion models are often further adapted through DreamBooth, LoRA, or Custom Diffusion. Such adaptations can reshape internal representations, thereby weakening or even reversing the erasure effects achieved by existing methods. We identify erasure persistence as a key yet underexplored dimension of concept erasure and analyze how downstream fine-tuning reshapes internal representations. Our analysis reveals that fine-tuning of the original model does not uniformly modify the model, but preserves certain high-contribution structures, particularly attention heads with stable output subspaces and response magnitudes. We also observe that, after downstream fine-tuning of concept-erased models, these heads' output representations more readily realign with their pretrained counterparts. Motivated by this observation, we propose Stable-Head-Aware Concept Erasure (SHACE), which improves erasure persistence by preserving stable attention structures during concept erasure. SHACE identifies stability-critical attention heads through Attention-Head Stability Profiling and keeps their corresponding parameter blocks unchanged during erasure via Stable-Head Gradient Preservation. Extensive experiments show that SHACE improves resistance to concept recovery across diverse fine-tuning settings while maintaining strong suppression and non-target generation quality.
Source:https://arxiv.org/abs/2611.24220PreviousGuarding the Kingdom of Skill-Based Agents in the AI Dynasty of Computation: Control-Flow Integrity for Agent SkillsNextWhat Survives the Shift from Text to Pixels? Conditional Protection against Prompt Injection in Image-Rendered Documents
Related posts
Teaching VLMs What to Say, Not How to Reason: Rethinking Counterfactual Reasoning in Autonomous Driving
0arXiv cs.RO
SearchDiffusion: Information-Guided Diffusion Planning for Object Search
0arXiv cs.RO
Proprioceptive Simultaneous Base and Terrain Elevation Estimation for Legged Robot Locomotion
0arXiv cs.RO
Remote Teleoperation of Endovascular Robots: A Network Emulation Framework for Systematic Performance Evaluation
0arXiv cs.RO
QDD-MM: A Simple and Compact Open-Source Muscle Module with Quasi-Direct-Drive Motor for Tendon-driven Robots
0arXiv cs.RO
Old Experience, New Lessons: Relabeling Autonomous Robot Rollouts in Interactive Imitation Learning
0arXiv cs.RO