Global Safety Vector Jailbreak
A safety bypass vulnerability exists in aligned Large Language Models (LLMs) permitting inference-time jailbreaking via direct activation repatching. The vulnerability exploits the distributed nature of safety mechanisms, which are governed by approximately 30% of total attention heads (termed "safety-critical heads"). By utilizing a Global Optimization for Safety Vector Extraction (GOSV) framework, an attacker can identify these interdependent heads using REINFORCE-based optimization. Once…
Evaluated models: Llama 2 7B, Llama 3.1 8B, Mistral 7B+1 more
- Llama 2 7B
- Llama 3.1 8B
- Mistral 7B
- Qwen 2.5 7B