Updated 2/21/2026
Audio Large Language Models (ALLMs) integrated into voice agent systems for high-stakes domains (banking, IT support, logistics) are vulnerable to multimodal adversarial attacks via spoken interaction. Adversaries can exploit the model's inherent compliance and contextual awareness through multi-turn dialogue to bypass authentication safeguards, escalate privileges (e.g., unauthorized credit limit increases), exfiltrate sensitive Personally Identifiable Information (PII), and poison…
Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
Affects: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro +4 more
Source: arXiv