Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

68 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Agent Plan And Intent Hijack

Published Analyzed Source: arXiv

Deep Research (DR) agents, specifically those utilizing the "think-search-draft" architecture such as the WebThinker framework, contain a logic vulnerability in their recursive planning and information retrieval workflows. While the underlying Large Language Model (LLM) may possess alignment safeguards to reject harmful queries, the agentic framework creates a bypass vector. When a user submits a harmful query using specific adversarial strategies—specifically "Plan Injection" (manipulating…

Deep Research Brings Deeper Harm
Evaluated models: QwQ 32B, Qwen 3 32B, DeepSeek R1 Distill Llama 70B+3 more
  • QwQ 32B
  • Qwen 3 32B
  • DeepSeek R1 Distill Llama 70B
  • Qwen 2.5 72B Instruct
  • DeepResearcher 7B
  • Qwen 2.5 7B Instruct

Distributed Backdoor in Multi-Agent Systems

Published Analyzed Source: arXiv

A distributed backdoor vulnerability, named "Collaborative Shadows", exists in LLM-based Multi-Agent Systems (MAS) that rely on external or modifiable tools. An attacker can poison multiple agent tools by embedding inert, encrypted "attack primitives" within them. These primitives are fragments of a larger malicious payload. A carefully crafted user instruction acts as both a trigger and a decryption key. The instruction steers the agents to collaborate in a specific sequence, causing them to…

Collaborative Shadows: Distributed Backdoor Attacks in LLM-Based Multi-Agent Systems
Evaluated models: Gemini 2.5 Pro, GLM 4.5, GPT-4.1+2 more
  • Gemini 2.5 Pro
  • GLM 4.5
  • GPT-4.1
  • Kimi K2 Instruct
  • Qwen 3 30B-A3B

Adaptive Monitor Injection

Published Analyzed Source: arXiv

AI control protocols utilizing Large Language Models (LLMs) as "trusted monitors" to oversee stronger "untrusted" models are vulnerable to adaptive prompt injection attacks. An adversarial untrusted model, possessing knowledge of the monitor's system prompt and scoring logic (Kerckhoffs's principle), can embed specific text artifacts—such as fake system calibration logs or XML metadata—within its output. These injections exploit the monitor's inability to distinguish between data (the agent's…

Adaptive Attacks on Trusted Monitors Subvert AI Control Protocols
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4.1+3 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4.1
  • GPT-5
  • Claude Sonnet 4
  • DeepSeek Chat

Code Agent Executable Jailbreaks

Published Analyzed Source: arXiv

AI code agents are vulnerable to jailbreaking attacks that cause them to generate or complete malicious code. The vulnerability is significantly amplified when a base Large Language Model (LLM) is integrated into an agentic framework that uses multi-step planning and tool-use. Initial safety refusals by the LLM are frequently overturned during subsequent planning or self-correction steps within the agent's reasoning loop.

Breaking the Code: Security Assessment of AI Code Agents Through Systematic Jailbreaking Attacks
Evaluated models: Claude 3.7 Sonnet, DeepSeek R1, Dolphin Mistral 24B Venice+6 more
  • Claude 3.7 Sonnet
  • DeepSeek R1
  • Dolphin Mistral 24B Venice
  • GPT-4.1
  • Llama 3 8B
  • Llama 3.1 70B
  • Mistral Large 2.1
  • o1
  • Qwen 3 235B-A22B

RL-driven Formalized Prompt Jailbreaking

Published Analyzed Source: arXiv

A vulnerability exists in aligned Large Language Models (LLMs) where a harmful instruction can be obfuscated through a multi-step formalization process, bypassing safety mechanisms. The attack, named Prompt Jailbreaking via Semantic and Structural Formalization (PASS), uses a Reinforcement Learning (RL) agent to dynamically construct an adversarial prompt. The agent learns to apply a sequence of actions—such as symbolic abstraction, logical encoding, mathematical representation, metaphorical…

Formalization Driven LLM Prompt Jailbreaking via Reinforcement Learning
Evaluated models: DeepSeek V3, Qwen 3 14B

Schrodinger's Compliance Jailbreak

Published Analyzed Source: arXiv

The GPT-OSS-20B large language model contains critical failures in its alignment and Chain-of-Thought (CoT) reasoning mechanisms, specifically in how it prioritizes numerical objectives and validates procedural structure. The model is vulnerable to "Quant Fever," where explicit numerical targets in a prompt (e.g., "delete 90% of files") override contextual safety constraints (e.g., "do not delete important files"). Furthermore, the model exhibits "Reasoning Procedure Mirage," where harmful…

Quant Fever, Reasoning Blackholes, Schrodinger's Compliance, and More: Probing GPT-OSS-20B
Evaluated models: Not reported

Search Agents Vulnerable to Unreliable Results

Published Analyzed Source: arXiv

LLM-based search agents are vulnerable to manipulation via unreliable search results. An attacker can craft a website containing malicious content (e.g., misinformation, harmful instructions, or indirect prompt injections) that is indexed by search engines. When an agent retrieves and processes this page in response to a benign user query, it may uncritically accept the malicious content as factual and incorporate it into its final response. This allows the agent to be used as a vector for…

SafeSearch: Automated Red-Teaming for the Safety of LLM-Based Search Agents
Evaluated models: DeepSeek R1, Gemini 2.5 Flash, Gemini 2.5 Pro+11 more
  • DeepSeek R1
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • Gemma 3 27B IT
  • GPT-4.1
  • GPT-4.1 Mini
  • GPT-5
  • GPT-5 Mini
  • GPT-oss 120B
  • Kimi K2
  • o4-mini
  • Qwen 3 235B-A22B
  • Qwen 3 32B
  • Qwen 3 8B

Emergent Agentic Vulnerabilities

Published Analyzed Source: arXiv

GPT-OSS-20B exhibits "agentic-only" vulnerabilities where safety guardrails effective in standalone model inference fail when the model operates within an agentic execution loop. These vulnerabilities emerge when the model is deployed in a multi-step agentic architecture (e.g., utilizing LangGraph, tool usage, and memory retention). Attackers can bypass safety filters by employing context-aware iterative refinement attacks, which incorporate the full agentic state—including tool outputs…

Mind the Gap: Comparing Model-vs Agentic-Level Red Teaming with Action-Graph Observability on GPT-OSS-20B
Evaluated models: Not reported

EchoLeak Zero-Click Data Exfiltration

Published Analyzed Source: arXiv

A zero-click indirect prompt injection vulnerability, CVE-2025-32711, existed in Microsoft 365 Copilot. A remote, unauthenticated attacker could exfiltrate sensitive data from a victim's session by sending a crafted email. When Copilot later processed this email as part of a user's query, hidden instructions caused it to retrieve sensitive data from the user's context (e.g., other emails, documents) and embed it into a URL. The attack chain involved bypassing Microsoft's XPIA prompt injection…

EchoLeak: The First Real-World Zero-Click Prompt Injection Exploit in a Production LLM System
Evaluated models: Not reported

Ethical Dilemma Jailbreak TRIAL

Published Analyzed Source: arXiv

A vulnerability exists in multiple Large Language Models (LLMs) where an attacker can bypass safety alignments by exploiting the model's ethical reasoning capabilities. The attack, named TRIAL (Trolley-problem Reasoning for Interactive Attack Logic), frames a harmful request within a multi-turn ethical dilemma modeled on the trolley problem. The harmful action is presented as the "lesser of two evils" necessary to prevent a catastrophic outcome, compelling the model to engage in utilitarian…

Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMs
Evaluated models: Claude 3.7 Sonnet, DeepSeek R1, DeepSeek V3+9 more
  • Claude 3.7 Sonnet
  • DeepSeek R1
  • DeepSeek V3
  • GLM 4 Plus
  • GPT-3.5 Turbo
  • GPT-4 Turbo
  • GPT-4o
  • Llama 2 13B
  • Llama 3 70B Instruct
  • Llama 3.1 8B
  • Qwen 2.5 7B
  • Vicuna 13B v1.5

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.