Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

191 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Payment Protocol Whisper Attack

Published Analyzed Source: arXiv

The Google Agent Payments Protocol (AP2), specifically within the reference implementation built using the Google Agent Development Kit (ADK) and Gemini models, contains vulnerabilities allowing for both indirect and direct prompt injection. The architecture fails to sufficiently isolate the Large Language Model (LLM) context from untrusted external data sources and user inputs.

Whispers of Wealth: Red-Teaming Google's Agent Payments Protocol via Prompt Injection
Evaluated models: Gemini 2.5 Flash

Semantic Cache Collision Hijack

Published Analyzed Source: arXiv

Semantic caching mechanisms in LLM applications are vulnerable to cross-tenant cache key collision attacks (CacheAttack) due to the inherent mathematical conflict between locality-preserving fuzzy hashing and cryptographic collision resistance (the avalanche effect). An attacker can leverage gradient-based search algorithms to optimize an adversarial discrete suffix that, when appended to a malicious prompt, forces its output embedding vector to collide with the embedding of a targeted benign…

From Similarity to Vulnerability: Key Collision Attack on LLM Semantic Caching
Evaluated models: Llama 3.1 8B, Mistral 7B, DeepSeek R1

Autonomous Agent Prompt Reveal

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) deployments and multi-agent systems where an autonomous attacker agent can systematically extract hidden system prompts through self-evolving interaction strategies. The vulnerability leverages a "JustAsk" framework which utilizes Upper Confidence Bound (UCB) exploration to dynamically select and refine attack vectors from a hierarchical taxonomy of 14 atomic skills (e.g., structural formatting, authority appeals) and 14 multi-turn…

Just Ask: Curious Code Agents Reveal System Prompts in Frontier LLMs
Evaluated models: o1, Llama 3.1 70B Hanami X1, Phi-4+38 more
  • o1
  • Llama 3.1 70B Hanami X1
  • Phi-4
  • Aion 1.0
  • Sonar Pro
  • Command A
  • Llama 4 Maverick
  • Llama 3.1 Nemotron Ultra 253B v1
  • Qwen 3 235B-A22B
  • Mercury
  • Hunyuan A13B Instruct
  • UI-TARS 1.5 7B
  • GPT-oss 120B
  • Jamba Mini 1.7
  • Hermes 4 70B
  • Step 3
  • LongCat Flash Chat
  • Tongyi DeepResearch 30B-A3B
  • Cydonia 24B v4.1
  • ERNIE 4.5 21B-A3B Thinking
  • Granite 4.0 H Micro
  • LFM2 8B-A1B
  • Nova Premier v1
  • Kimi K2 Thinking
  • KAT Coder Pro
  • Cogito v2.1 671B
  • Gemini 3 Pro Preview
  • Grok 4.1 Fast
  • Claude Opus 4.5
  • TNG R1T Chimera
  • Intellect 3
  • DeepSeek V3.2 Speciale
  • Trinity Mini
  • Mistral Large 2512
  • DeepSeek V3.1 Nex N1
  • MiMo V2 Flash
  • GLM-4.7
  • MiniMax M2.1
  • Seed 1.6
  • Molmo 2 8B
  • GPT-5.2 Codex

LLM Grading Compliance Paradox

Published Analyzed Source: arXiv

Large Language Models (LLMs) employed as automated code evaluators ("Universal Graders") are vulnerable to Semantic-Instruction Decoupling, a form of adversarial prompt injection that exploits the "Syntax-Semantics Gap." Attackers can embed adversarial directives into syntactically inert regions of the Abstract Syntax Tree (AST)—specifically comments, docstrings, variable names, and whitespace. While these regions are discarded by compilers (trivia nodes) or treated as arbitrary symbols…

The Compliance Paradox: Semantic-Instruction Decoupling in Automated Academic Code Evaluation
Evaluated models: GPT-5, Llama 3.1 8B, DeepSeek V3

Persona Adherence Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) deployed as Role-Playing Agents (RPAs) are vulnerable to Persona-Targeted Jailbreaks. When an LLM is prompted to adopt a persona—particularly characters with negative, risky, or villainous traits—the model's optimization for role fidelity frequently overrides its foundational safety alignment. Attackers can exploit this vulnerability by synthesizing queries that leverage the specific narrative background, ideology, or psychological vulnerabilities of the assigned…

Stay in Character, Stay Safe: Dual-Cycle Adversarial Self-Evolution for Safety Role-Playing Agents
Evaluated models: GPT-4o, Llama 3 8B, Qwen 2.5 7B+1 more
  • GPT-4o
  • Llama 3 8B
  • Qwen 2.5 7B
  • Gemma 2 9B

Agent Over-Trigger Containment

Published Analyzed Source: arXiv

Autonomous Incident Response (IR) and Security Operations Center (SOC) agents utilizing frontier LLMs are vulnerable to adversarial over-triggering via contextualized prompt injections. When processing untrusted artifacts (such as SQLite logs, alerts, or phishing emails) in a dual-control environment, these agents exhibit a severe calibration failure: they lack action restraint and execute disruptive containment tools prematurely. Attackers can exploit this by embedding T2 (contextualized…

OpenSec: Measuring Incident Response Agent Calibration Under Adversarial Evidence
Evaluated models: GPT-5.2, Claude Sonnet 4.5, DeepSeek V3.2+1 more
  • GPT-5.2
  • Claude Sonnet 4.5
  • DeepSeek V3.2
  • Qwen 3 4B Instruct

LLM Agent Disguised URL Bypass

Published Analyzed Source: arXiv

Large Language Models (LLMs) acting as web agents exhibit a vulnerability in their decision-making process when validating external URLs. The models fail to correctly identify malicious domains when the Uniform Resource Locator (URL) structure—specifically the subdomain, directory path, or query parameters—is manipulated to include semantically "safe" keywords or mimic benign websites (URL disguising). Attackers can induce the agent to accept and visit a malicious link by embedding natural…

MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs
Evaluated models: GPT-3.5, GPT-4o, Llama 2 7B+4 more
  • GPT-3.5
  • GPT-4o
  • Llama 2 7B
  • Llama 3 8B
  • Mistral 7B
  • DeepSeek V3
  • Mixtral 8x7B

Personalization Intent Legitimation

Published Analyzed Source: arXiv

Personalized LLM agents utilizing long-term memory systems are vulnerable to a safety bypass known as intent legitimation. Benign, organically accumulated user memories can bias the model's intent inference, causing it to misinterpret inherently harmful queries as contextually justified. When a malicious request semantically aligns with a user's established persona (e.g., hobbies, mental health history, routine), the model normalizes the request and complies, effectively bypassing standard…

When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents
Evaluated models: GPT-4o, GPT-4o Mini, DeepSeek V3.2+2 more
  • GPT-4o
  • GPT-4o Mini
  • DeepSeek V3.2
  • Qwen 3 235B-A22B
  • Qwen 3 8B

MCP Server-Side Injection

Published Analyzed Source: arXiv

The Model Context Protocol (MCP) specification v1.0 contains fundamental architectural vulnerabilities enabling server-side prompt injection and privilege escalation. The protocol relies on bidirectional sampling (sampling/createMessage) without cryptographic origin authentication or UI distinction, allowing connected servers to inject content that the LLM backend interprets as legitimate user input. Additionally, the protocol lacks isolation boundaries between concurrent server connections…

Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Evaluated models: GPT-4o, Claude 3.5 Sonnet, Llama 3.1 70B

Visual Object Injection

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to Physical Prompt Injection Attacks (PPIA), a query-agnostic injection technique delivered via the visual modality. The vulnerability stems from the model's "Vision-Enabled Text Recognition" capabilities and "Identity Sensitivity," where the model interprets text embedded in the physical environment (e.g., printed on signs, posters, or objects) as high-priority instructions rather than passive visual data. An attacker can embed adversarial…

Physical Prompt Injection Attacks on Large Vision-Language Models
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4 Turbo+7 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4 Turbo
  • Gemini 1.5 Pro Latest
  • Gemini 1.5 Pro 002
  • Gemini 1.5 Flash Latest
  • Claude 3.5 Sonnet Latest
  • Claude 3.5 Haiku 20241022
  • Llama 3.2 11B Vision
  • Llama 3.2 90B Vision Instruct

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.