Voice Agent Behavioral Bypass
Published Analyzed Source: arXiv
Audio Large Language Models (ALLMs) integrated into voice agent systems for high-stakes domains (banking, IT support, logistics) are vulnerable to multimodal adversarial attacks via spoken interaction. Adversaries can exploit the model's inherent compliance and contextual awareness through multi-turn dialogue to bypass authentication safeguards, escalate privileges (e.g., unauthorized credit limit increases), exfiltrate sensitive Personally Identifiable Information (PII), and poison…
Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+4 more
- GPT-4o
- GPT-4o Mini
- Gemini 1.5 Pro
- Gemini 2.5 Flash
- Gemini 2.5 Pro
- Qwen2-Audio 7B
- Qwen 2.5 Omni 7B