Token Sensitivity Jailbreak
Transformer-based Large Language Models (LLMs) are vulnerable to highly query-efficient black-box jailbreak attacks due to the structural properties of refusal behaviors: skewed token contribution and cross-model consistency. Refusal mechanisms within LLMs are typically triggered by a sparse subset of sensitive tokens rather than the entire prompt, and these refusal representations (specifically the primary left singular vector of the perturbed representation matrix at intermediate layers) are…
Evaluated models: Gemma 7B Instruct, Gemma 2 9B IT, Llama 3 8B Instruct+6 more
- Gemma 7B Instruct
- Gemma 2 9B IT
- Llama 3 8B Instruct
- Llama 3.2 3B Instruct
- Qwen 2.5 7B Instruct
- Qwen 2.5 3B Instruct
- GPT-3.5 Turbo
- GPT-4o
- Claude 3.5 Sonnet