LLM Edit Fingerprint Leak
Published Analyzed Source: arXiv
A side-channel information leakage vulnerability exists in the "locate-then-edit" paradigm of Large Language Model (LLM) knowledge editing, specifically affecting algorithms such as ROME, MEMIT, and AlphaEdit. The parameter update matrix ($\Delta W$) generated during the editing process preserves the algebraic structure of the edited data. Specifically, the row space of the parameter difference matrix encodes a mathematical fingerprint of the key vectors associated with the edited subjects. An…
Reverse-Engineering Model Editing on Language Models
Evaluated models: Llama 3 8B, Qwen 2.5 7B