Updated 12/29/2024
Embodied Large Language Models (LLMs) are vulnerable to manipulation via voice-based interactions, leading to the execution of harmful physical actions. Attacks exploit three vulnerabilities: (1) cascading LLM jailbreaks resulting in malicious robotic commands; (2) misalignment between linguistic outputs (verbal refusal) and physical actions (command execution); and (3) conceptual deception, where seemingly benign instructions lead to harmful outcomes due to incomplete world knowledge within…
BadRobot: Manipulating Embodied LLMs in the Physical World
Affects: BERT, GPT-3.5 Turbo, GPT-4 Turbo +2 more
Source: arXiv