Agent Tool-Call Safety Gap
LLM agents with tool-calling capabilities are vulnerable to a text-action modality divergence (termed the "GAP" vulnerability), where text-level safety alignment fails to transfer to tool-call execution. Attackers can craft adversarial prompts that cause the model to generate a text-based refusal (demonstrating text safety) while simultaneously executing the requested forbidden action through available external tools. Because text generation and tool-call selection operate through partially…
Evaluated models: Claude Sonnet 4.5, GPT-5.2, Grok 4.1 Fast+3 more
- Claude Sonnet 4.5
- GPT-5.2
- Grok 4.1 Fast
- DeepSeek V3.2
- Kimi K2.5
- GLM-4.7