Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

16 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Historical reasoning-envelope isolation failures

Published Analyzed Source: arXiv

The authors report historical isolation failures in client-held encrypted reasoning blocks across compatible provider API contexts.

Stealing Reasoning Traces from Proprietary LLM APIs
Evaluated models: Fable 5, Opus 4.8, Sonnet 5+15 more
  • Fable 5
  • Opus 4.8
  • Sonnet 5
  • Sonnet 4.6
  • Sonnet 4.5
  • Haiku 4.5
  • GPT-5.6 Sol
  • GPT-5.6-terra
  • GPT-5.6 Luna
  • GPT-5
  • GPT-5 Mini
  • o4-mini
  • Gemini 3.1 Pro
  • Gemini 3 Pro
  • Gemini Robotics 1.6
  • Gemini 3.5 Flash
  • Gemini 3 Flash
  • Gemini 3.1 Flash Lite

Incomplete MCP Tool-Call Attack Detection

Published Analyzed Source: arXiv

The MTGuard study evaluates unsafe Model Context Protocol tool calls originating from compromised server data, host-side execution changes, and malicious user-controlled resources. Its hybrid monitor combines pre-execution parameter inspection, behavioral observation, and post-execution result verification across browser-automation and financial-analysis agents.

Hybrid Analysis for Secure MCP Tool Use in LLM Agents
Evaluated models: GPT-5.6 Luna, DeepSeek V4 Flash, DeepSeek V4-Pro

Black-Box System Prompt Leakage in Real-World LLM Applications

Published Analyzed Source: arXiv

The paper reports a reproducible black-box evaluation showing that adversarial user queries can cause deployed LLM applications to reveal hidden system prompts. In the authors’ measurement of 1,200 applications across six commercial platforms, 1,064 applications leaked prompt content (81.0%–93.5% per anonymized platform). This is a paper-reported result, not independently verified here. LeakBench and the official artifact repository provide defensive benchmark materials for controlled testing…

Understanding and Mitigating Prompt Leaking Attacks in Real-World LLM-Based Applications
Evaluated models: Llama 2 7B Chat, Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3+5 more
  • Llama 2 7B Chat
  • Llama 3.1 8B Instruct
  • Mistral 7B Instruct v0.3
  • Qwen 3 4B Instruct 2507
  • Qwen 3 32B
  • Qwen 2.5 72B Instruct
  • Llama 3.3 70B Instruct
  • Qwen 3 30B-A3B Instruct-2507

Stage-Sequential Agent Escalation

Published Analyzed Source: arXiv

Agentic Large Language Model (LLM) systems utilizing persistent memory, Retrieval-Augmented Generation (RAG) pipelines, and external tool connectors are vulnerable to Logic-layer Prompt Control Injection (LPCI). An attacker can inject obfuscated (e.g., encoded, structurally nested, or semantically reframed) payloads into external memory stores or RAG documents. These payloads bypass conventional inference-time plaintext content filters, persist across session boundaries, and remain dormant…

LAAF: Logic-layer Automated Attack Framework A Systematic Red-Teaming Methodology for LPCI Vulnerabilities in Agentic Large Language Model Systems
Evaluated models: GPT-4o Mini, Claude 3 Haiku, Llama 3.1 70B Instruct+2 more
  • GPT-4o Mini
  • Claude 3 Haiku
  • Llama 3.1 70B Instruct
  • Gemini 2.0 Flash
  • Mixtral 8x7B Instruct

Agent Lifecycle Compound Threats

Published Analyzed Source: arXiv

OpenClaw is vulnerable to persistent memory poisoning, allowing an attacker to manipulate the agent's long-term memory store (MEMORY.md) via prompt injection. Because the autonomous agent continuously integrates this memory file as context for all subsequent reasoning and task planning, injected payloads act as durable behavioral constraints. This allows an attacker to persistently alter the agent's core policy, manipulate tool selection, and hijack future sessions without any further…

Taming openclaw: Security analysis and mitigation of autonomous llm agent threats
Evaluated models: Not reported

Autonomous Agent Prompt Reveal

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) deployments and multi-agent systems where an autonomous attacker agent can systematically extract hidden system prompts through self-evolving interaction strategies. The vulnerability leverages a "JustAsk" framework which utilizes Upper Confidence Bound (UCB) exploration to dynamically select and refine attack vectors from a hierarchical taxonomy of 14 atomic skills (e.g., structural formatting, authority appeals) and 14 multi-turn…

Just Ask: Curious Code Agents Reveal System Prompts in Frontier LLMs
Evaluated models: o1, Llama 3.1 70B Hanami X1, Phi-4+38 more
  • o1
  • Llama 3.1 70B Hanami X1
  • Phi-4
  • Aion 1.0
  • Sonar Pro
  • Command A
  • Llama 4 Maverick
  • Llama 3.1 Nemotron Ultra 253B v1
  • Qwen 3 235B-A22B
  • Mercury
  • Hunyuan A13B Instruct
  • UI-TARS 1.5 7B
  • GPT-oss 120B
  • Jamba Mini 1.7
  • Hermes 4 70B
  • Step 3
  • LongCat Flash Chat
  • Tongyi DeepResearch 30B-A3B
  • Cydonia 24B v4.1
  • ERNIE 4.5 21B-A3B Thinking
  • Granite 4.0 H Micro
  • LFM2 8B-A1B
  • Nova Premier v1
  • Kimi K2 Thinking
  • KAT Coder Pro
  • Cogito v2.1 671B
  • Gemini 3 Pro Preview
  • Grok 4.1 Fast
  • Claude Opus 4.5
  • TNG R1T Chimera
  • Intellect 3
  • DeepSeek V3.2 Speciale
  • Trinity Mini
  • Mistral Large 2512
  • DeepSeek V3.1 Nex N1
  • MiMo V2 Flash
  • GLM-4.7
  • MiniMax M2.1
  • Seed 1.6
  • Molmo 2 8B
  • GPT-5.2 Codex

MCP Server-Side Injection

Published Analyzed Source: arXiv

The Model Context Protocol (MCP) specification v1.0 contains fundamental architectural vulnerabilities enabling server-side prompt injection and privilege escalation. The protocol relies on bidirectional sampling (sampling/createMessage) without cryptographic origin authentication or UI distinction, allowing connected servers to inject content that the LLM backend interprets as legitimate user input. Additionally, the protocol lacks isolation boundaries between concurrent server connections…

Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Evaluated models: GPT-4o, Claude 3.5 Sonnet, Llama 3.1 70B

Production LLM Copyright Extraction

Published Analyzed Source: arXiv

Production Large Language Models (LLMs) are vulnerable to long-form training data extraction via a two-phase prompt injection attack. This vulnerability allows an attacker to recover substantial portions of memorized, copyrighted text (such as novels) by exploiting the model's autoregressive text completion capabilities. The attack methodology involves two distinct phases: 1. Prefix Completion Probe: The attacker provides a short "seed" sequence (e.g., the first sentence of a book) coupled…

Extracting Books from Production Language Models
Evaluated models: Claude 3.7 Sonnet 20250219, GPT-4.1 2025-04-14, Gemini 2.5 Pro+1 more
  • Claude 3.7 Sonnet 20250219
  • GPT-4.1 2025-04-14
  • Gemini 2.5 Pro
  • Grok 3

Aggressive Compression Model Theft

Published Analyzed Source: arXiv

Large Language Models (LLMs) hosted on inference servers are vulnerable to high-speed weight exfiltration attacks due to the inherent compressibility of transformer parameters when decompression constraints are relaxed. Adversaries with compromised server access can utilize aggressive lossy compression techniques—specifically additive quantization combined with k-means clustering—to reduce model size by factors of 16x to 100x (e.g., <1 bit per parameter). Unlike standard quantization for…

Aggressive Compression Enables LLM Weight Theft
Evaluated models: Qwen 2 1.5B, Qwen 2 7B, Qwen 2.5 0.5B+2 more
  • Qwen 2 1.5B
  • Qwen 2 7B
  • Qwen 2.5 0.5B
  • Qwen 2.5 1.5B
  • Pythia 70M

Guardrail Policy Extraction

Published Analyzed Source: arXiv

A black-box guardrail reverse-engineering vulnerability exists in Large Language Model (LLM) serving systems that employ output filtering mechanisms. The vulnerability allows remote attackers to replicate the proprietary decision-making policy and rule sets of the target's safety guardrail without direct access to model parameters. This is achieved through a technique termed Guardrail Reverse-engineering Attack (GRA), which utilizes a reinforcement learning framework combined with genetic…

Black-Box Guardrail Reverse-engineering Attack
Evaluated models: GPT-4o, Llama 3.1 8B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.