Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

101 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

MCP Server-Side Injection

Published Analyzed Source: arXiv

The Model Context Protocol (MCP) specification v1.0 contains fundamental architectural vulnerabilities enabling server-side prompt injection and privilege escalation. The protocol relies on bidirectional sampling (sampling/createMessage) without cryptographic origin authentication or UI distinction, allowing connected servers to inject content that the LLM backend interprets as legitimate user input. Additionally, the protocol lacks isolation boundaries between concurrent server connections…

Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Evaluated models: GPT-4o, Claude 3.5 Sonnet, Llama 3.1 70B

LLM Judge Framing Bias

Published Analyzed Source: arXiv

LLM-based evaluation systems ("LLM-as-a-Judge") exhibit a structural vulnerability termed "Framing Bias," wherein the model produces logically contradictory judgments depending on the syntactic framing of the evaluation prompt. Specifically, when assessing the same content using predicate-positive (P) framing (e.g., "Is this toxic?") versus predicate-negative (¬P) framing (e.g., "Is this non-toxic?"), models frequently fail to invert their binary decisions, leading to inconsistency rates…

When Wording Steers the Evaluation: Framing Bias in LLM judges
Evaluated models: Llama 3.2 1B Instruct, Llama 3.1 8B Instruct, Llama 3.1 70B Instruct+11 more
  • Llama 3.2 1B Instruct
  • Llama 3.1 8B Instruct
  • Llama 3.1 70B Instruct
  • Llama 3.3 70B Instruct
  • Qwen 2.5 1.5B Instruct
  • Qwen 2.5 3B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 14B Instruct
  • Qwen 2.5 32B Instruct
  • Qwen 2.5 72B Instruct
  • o4-mini
  • GPT-4o
  • GPT-5 Mini
  • GPT-5

Invisible Headline Trading Loss

Published Analyzed Source: arXiv

Improper input validation in Large Language Model (LLM) integrated Algorithmic Trading Systems (ATS) allows remote attackers to manipulate trading decisions via crafted "adversarial news" headlines. The vulnerability exists when ATS pipelines ingest financial news data via standard scraping libraries (e.g., Scrapy, BeautifulSoup, Cheerio) and pass raw HTML or non-normalized text directly to LLMs (such as FinBERT, FinGPT, or GPT-4) for entity recognition (stock-name association) and sentiment…

Adversarial News and Lost Profits: Manipulating Headlines in LLM-Driven Algorithmic Trading
Evaluated models: FinBERT, FinGPT, FinLLaMA+7 more
  • FinBERT
  • FinGPT
  • FinLLaMA
  • o3
  • o3 Pro
  • GPT-4o
  • GPT-4o Mini
  • GPT-4o Mini High
  • GPT-5
  • Gemini 1.5 Pro

Agent Confused Deputy Escalation

Published Analyzed Source: arXiv

Multi-Agent Systems (MAS) orchestrated by Large Language Models (LLMs) are vulnerable to a Confused Deputy privilege escalation attack. This vulnerability arises when an untrusted or low-privilege agent exploits the inter-agent communication channel (e.g., broadcast or peer-to-peer messaging) to manipulate a high-privilege trusted agent into executing sensitive tools on its behalf. The root cause is the lack of mandatory access control policies governing agent-to-agent interactions; trusted…

Taming Various Privilege Escalation in LLM-Based Agent Systems: A Mandatory Access Control Framework
Evaluated models: o1

Stealthy Tool Chain Amplification

Published Analyzed Source: arXiv

A stealthy resource exhaustion (Economic Denial-of-Service) vulnerability exists in the multi-turn tool-calling layer of Large Language Model (LLM) agents, particularly those utilizing the Model Context Protocol (MCP). An attacker controlling a third-party tool server can manipulate text-visible fields (such as argument descriptions and error messages) to force the LLM into a prolonged, verbose tool-calling loop. By demanding lengthy, non-semantic outputs (e.g., long comma-separated lists) and…

Beyond Max Tokens: Stealthy Resource Amplification via Tool Calling Chains in LLM Agents
Evaluated models: DeepSeek R1 Distill Llama 70B, GLM 4.5 Air, GPT-4o+4 more
  • DeepSeek R1 Distill Llama 70B
  • GLM 4.5 Air
  • GPT-4o
  • Llama 3.3 70B Instruct
  • Mistral Large
  • Qwen 3 32B
  • Seed 32B

Distractor Inverse Scaling

Published Analyzed Source: arXiv

Reasoning-capable Large Language Models (LLMs) and agentic AI systems exhibit a critical vulnerability to contextual distractors, resulting in catastrophic performance degradation (up to 80% drop in accuracy) and emergent misalignment. When the input context contains noise—specifically random documents, irrelevant chat history, or task-specific "hard negative" distractors—the models fail to filter this information. Instead of ignoring the noise, the models disproportionately attend to…

Lost in the Noise: How Reasoning Models Fail with Contextual Distractors
Evaluated models: Gemini 2.5 Pro, Gemini 2.5 Flash, DeepSeek R1 0528+4 more
  • Gemini 2.5 Pro
  • Gemini 2.5 Flash
  • DeepSeek R1 0528
  • GPT-oss 120B
  • Qwen 3 4B Thinking 2507
  • DeepSeek R1 Distill Llama 8B
  • Qwen 3 30B-A3B Thinking 2507

AI Agent Structural Blindspot

Published Analyzed Source: arXiv

A vulnerability in AI agent threat detection systems relying on standard conversational tokenization allows attackers to bypass security monitors and execute structural attacks, such as tool hijacking and data exfiltration. Because traditional NLP-based detectors focus on linguistic patterns (surface language) rather than execution flow, an attacker can orchestrate malicious multi-step tool sequences using entirely benign natural language. This structural blindness causes cross-attack…

Structural Representations for Cross-Attack Generalization in AI Agent Threat Detection
Evaluated models: Not reported

Truthful Montage Collusion

Published Analyzed Source: arXiv

A cognitive vulnerability exists in the reasoning mechanisms of autonomous Large Language Model (LLM) agents, specifically regarding "narrative overfitting"—the model's intrinsic drive to synthesize coherent causal stories from fragmented inputs. This vulnerability allows for "Cognitive Collusion Attacks" where an attacker creates a fabricated belief state in the victim agent using exclusively factually true evidence fragments. By employing a "Generative Montage" framework (consisting of…

Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage
Evaluated models: GPT-4o Mini, GPT-4o, GPT-4.1 Nano+11 more
  • GPT-4o Mini
  • GPT-4o
  • GPT-4.1 Nano
  • GPT-4.1 Mini
  • GPT-4.1
  • Claude 3 Haiku
  • Claude 3.5 Haiku
  • Claude Haiku 4.5
  • Qwen 2.5 3B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 14B Instruct
  • DeepSeek R1 Distill Qwen 1.5B
  • DeepSeek R1 Distill Qwen 7B
  • DeepSeek R1 Distill Qwen 14B

CoT Detector Obfuscation Bypass

Published Analyzed Source: arXiv

LLM-based code agents and vulnerability detectors employing Chain-of-Thought (CoT) reasoning are susceptible to automated adversarial code obfuscation. The vulnerability exists because CoT mechanisms expose the model's decision logic, allowing reinforcement learning frameworks (such as CoTDeceptor) to iteratively refine code transformations based on the detector's own reasoning traces. By optimizing for "reasoning instability" and "hallucination" rather than just syntactic evasion, attackers…

CoTDeceptor: Adversarial Code Obfuscation Against CoT-Enhanced LLM Code Agents
Evaluated models: DeepSeek R1, GPT-5

Cross-Environment Agent Jailbreak

Published Analyzed Source: arXiv

Large Language Model (LLM) agents operating in tool-augmented environments are susceptible to "Contextual Fragility" and multi-turn "long-chain" exploitation. Existing safety mechanisms predominantly function on a stateless, atomic paradigm, evaluating individual input-output pairs in isolation. This allows an adversary to orchestrate complex attack trajectories where malicious intent is distributed across multiple, individually benign steps (a "Domino Effect"). Consequently, an attacker can…

DREAM: Dynamic Red-teaming for Evaluating Agentic Multi-Environment Security
Evaluated models: o4-mini, Gemini 2.5 Flash, GPT-5+8 more
  • o4-mini
  • Gemini 2.5 Flash
  • GPT-5
  • Gemini 2.5 Pro
  • Grok 4
  • Claude Sonnet 4.5
  • Qwen 3 235B-A22B
  • Kimi K2 Preview
  • Llama 3.1 70B
  • Qwen 2.5 72B
  • DeepSeek V3.1

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.