Updated 12/29/2024
Large Audio-Language Models (LALMs) are vulnerable to a stealthy adversarial jailbreak attack, AdvWave, which leverages a dual-phase optimization to overcome gradient shattering caused by audio discretization. The attack crafts adversarial audio by adding perceptually realistic environmental noise, making it difficult to detect. The attack also dynamically adapts the adversarial target based on the LALM's response patterns.
AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
Affects: GPT-4o, Llama Omni, Qwen 2 Audio +1 more
Source: arXiv