Audio Adversarial Jailbreak
Published Analyzed Source: arXiv
Large Audio-Language Models (LALMs) are vulnerable to a stealthy adversarial jailbreak attack, AdvWave, which leverages a dual-phase optimization to overcome gradient shattering caused by audio discretization. The attack crafts adversarial audio by adding perceptually realistic environmental noise, making it difficult to detect. The attack also dynamically adapts the adversarial target based on the LALM's response patterns.
AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
Evaluated models: GPT-4o, Llama Omni, Qwen 2 Audio+1 more
- GPT-4o
- Llama Omni
- Qwen 2 Audio
- SpeechGPT