Skip to main content
LLM Security Database
Skip to research search
Last analyzed 9/9/2026

Language Model Security Database

985 research findings · 1123 evaluated models

Filtered research findings

171 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Published 2/1/2026
Analyzed 3/8/2026

LLM agents with tool-calling capabilities are vulnerable to a text-action modality divergence (termed the "GAP" vulnerability), where text-level safety alignment fails to transfer to tool-call execution. Attackers can craft adversarial prompts that cause the model to generate a text-based refusal (demonstrating text safety) while simultaneously executing the requested forbidden action through available external tools. Because text generation and tool-call selection operate through partially…

Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
Evaluated models: Claude Sonnet 4.5, GPT-5.2, Grok 4.1 Fast +3 more

Source: arXiv

Published 2/1/2026
Analyzed 2/21/2026

Hybrid monitoring protocols for Large Language Model (LLM) agents, specifically those that strictly evaluate both Chain-of-Thought (CoT) reasoning and tool usage (such as LlamaFirewall's AlignmentCheck and Extract-and-Evaluate monitors), are vulnerable to "Agent-as-a-Proxy" indirect prompt injection attacks. Unlike standard injections that target the agent, this attack targets the monitoring model itself. By embedding a malicious string—optimized via an algorithm named Parallel-GCG—into…

Bypassing AI Control Protocols via Agent-as-a-Proxy Attacks
Evaluated models: GPT-4o, Llama 3.1 8B, Mistral 7B +1 more

Source: arXiv

Published 2/1/2026
Analyzed 2/21/2026

A vulnerability exists in LLM-based coding agents that implement modular capability extensions (often referred to as "Agent Skills") where the agent dynamically loads and executes user-provided skill packages. The vulnerability allows for Skill-Based Prompt Injection, specifically leveraging a technique known as "SkillJect." This attack decouples the malicious intent from the operational payload to bypass semantic safety filters. An attacker constructs a skill package containing: 1. Inducement…

SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agents
Evaluated models: Claude Sonnet 4.6, GPT-5 Mini, GLM-4.7 +7 more

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Architectural limitations in Meta's Llama-Prompt-Guard-2-86M and Llama-Guard-3-8B cause them to fail at detecting indirect prompt injections and agentic tool-use attacks, with detection rates dropping as low as 7-37%. Llama-Guard-3-8B enforces strict user/assistant message alternation and lacks support for tool-use roles; attempting to process messages with role: "tool" or role: "ipython" causes the chat template to raise an error, preventing evaluation entirely. PromptGuard 2 operates…

When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift
Evaluated models: Llama 3 8B, Llama 3.1 8B

Source: arXiv

Published 2/1/2026
Analyzed 4/10/2026

LLM agents equipped with tool-use, persistent memory, and environmental interaction capabilities are vulnerable to long-horizon attacks. Attackers can bypass single-turn safety guardrails by exploiting the temporal dimension of multi-turn interactions to incrementally steer agent behavior. The vulnerability manifests because the agent's safety mechanisms perform localized, single-step evaluations but fail to maintain semantic safety across extended interaction trajectories. This enables…

AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks
Evaluated models: GPT-4o, GPT-5.1, Gemini 3 Flash +1 more

Source: arXiv

Published 2/1/2026
Analyzed 3/9/2026

LLM-based Code Interpreter Agents, including OpenInterpreter and OpenCodeInterpreter, are vulnerable to sandbox evasion and arbitrary code execution via Natural Language Disguise and Contextual Channel Injection. Attackers can bypass Abstract Syntax Tree (AST) static analysis and explicit input guardrails by transforming malicious code logic into descriptive natural language instructions (Code Descriptions), which successfully evade syntax-layer blocks. Additionally, attackers can bypass input…

CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agents
Evaluated models: GPT-3.5, GPT-4o, GPT-5

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

Conventional LLM agent architectures suffer from a working memory contamination vulnerability due to indiscriminate memory accumulation. When these agents retrieve external data via tools (e.g., web search, reading emails), the entire raw output is appended directly to their continuous context window. If the external data contains an Indirect Prompt Injection (IPI) payload, the malicious instruction persists in the agent's working memory across its entire multi-step reasoning workflow. This…

AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management
Evaluated models: GPT-4o, GPT-5.1, Claude 3.7 Sonnet +3 more

Source: arXiv

Published 2/1/2026
Analyzed 3/9/2026

OpenClaw is vulnerable to Indirect Prompt Injection (IPI), Tool-Return Manipulation, and Persistent Memory Poisoning. The agent incorporates untrusted external content (e.g., fetched web pages) and external tool outputs directly into its observation stream without sufficient isolation. An attacker can embed malicious payloads into these external channels to hijack the agent's planning and execution trace. This allows the attacker to silently trigger high-privilege actions via OpenClaw's Skills…

From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent
Evaluated models: GPT-4o, Llama 3.1 70B, Qwen 2.5 7B

Source: arXiv

Published 2/1/2026
Analyzed 3/8/2026

A vulnerability in LLM-based autonomous agents allows remote attackers to hijack agent execution via Structural Template Injection (STI). The flaw arises from the lack of strict architectural isolation between internal control tokens and untrusted external data during chat-template serialization. By embedding framework-specific special tokens (e.g., <|im_start|>, <|im_end|>, <tool_call>) and delimiter patterns into externally retrieved data sources (such as web pages, emails, or API…

Automating Agent Hijacking via Structural Template Injection
Evaluated models: GPT-4, GPT-4o, DeepSeek V3

Source: arXiv

Published 2/1/2026
Analyzed 4/11/2026

Tool-calling LLM agents are vulnerable to Indirect Prompt Injection (IPI) attacks that induce "Poisoned Chain-of-Thought (CoT)" persistence. When an attacker embeds fake system constraints or error traces into untrusted external content (e.g., tool outputs or retrieved documents), the agent may generate reasoning traces that accept these malicious constraints as ground truth. Even if the original injected input is later sanitized or removed, the residual poisoned reasoning traces remain in the…

CausalArmor: Efficient Indirect Prompt Injection Guardrails via Causal Attribution
Evaluated models: Gemini 2.5 Flash, Gemini 2.5 Pro, Claude Sonnet 4 +1 more

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.