Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

83 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Historical reasoning-envelope isolation failures

Published Analyzed Source: arXiv

The authors report historical isolation failures in client-held encrypted reasoning blocks across compatible provider API contexts.

Stealing Reasoning Traces from Proprietary LLM APIs
Evaluated models: Fable 5, Opus 4.8, Sonnet 5+15 more
  • Fable 5
  • Opus 4.8
  • Sonnet 5
  • Sonnet 4.6
  • Sonnet 4.5
  • Haiku 4.5
  • GPT-5.6 Sol
  • GPT-5.6-terra
  • GPT-5.6 Luna
  • GPT-5
  • GPT-5 Mini
  • o4-mini
  • Gemini 3.1 Pro
  • Gemini 3 Pro
  • Gemini Robotics 1.6
  • Gemini 3.5 Flash
  • Gemini 3 Flash
  • Gemini 3.1 Flash Lite

Incomplete MCP Tool-Call Attack Detection

Published Analyzed Source: arXiv

The MTGuard study evaluates unsafe Model Context Protocol tool calls originating from compromised server data, host-side execution changes, and malicious user-controlled resources. Its hybrid monitor combines pre-execution parameter inspection, behavioral observation, and post-execution result verification across browser-automation and financial-analysis agents.

Hybrid Analysis for Secure MCP Tool Use in LLM Agents
Evaluated models: GPT-5.6 Luna, DeepSeek V4 Flash, DeepSeek V4-Pro

Black-Box System Prompt Leakage in Real-World LLM Applications

Published Analyzed Source: arXiv

The paper reports a reproducible black-box evaluation showing that adversarial user queries can cause deployed LLM applications to reveal hidden system prompts. In the authors’ measurement of 1,200 applications across six commercial platforms, 1,064 applications leaked prompt content (81.0%–93.5% per anonymized platform). This is a paper-reported result, not independently verified here. LeakBench and the official artifact repository provide defensive benchmark materials for controlled testing…

Understanding and Mitigating Prompt Leaking Attacks in Real-World LLM-Based Applications
Evaluated models: Llama 2 7B Chat, Llama 3.1 8B Instruct, Mistral 7B Instruct v0.3+5 more
  • Llama 2 7B Chat
  • Llama 3.1 8B Instruct
  • Mistral 7B Instruct v0.3
  • Qwen 3 4B Instruct 2507
  • Qwen 3 32B
  • Qwen 2.5 72B Instruct
  • Llama 3.3 70B Instruct
  • Qwen 3 30B-A3B Instruct-2507

Zero-Tax Fine-Tune Bypass

Published Analyzed Source: arXiv

An adversarial fine-tuning vulnerability exists in LLMs protected by text-based safety classifiers (such as Anthropic's Constitutional Classifiers). By utilizing a two-stage curriculum learning combined with hybrid RL+SFT (GRPO), an attacker can fine-tune a model to communicate using a minimal substitution cipher (replacing only 7-8 high-frequency characters) disguised within benign technical templates (e.g., forensic logs with 0x prefixes). This "Trojan-Speak" methodology bypasses text-level…

Trojan-Speak: Bypassing Constitutional Classifiers with No Jailbreak Tax via Adversarial Finetuning
Evaluated models: Claude Haiku 4.5, Qwen 3 4B, Qwen 3 8B+2 more
  • Claude Haiku 4.5
  • Qwen 3 4B
  • Qwen 3 8B
  • Qwen 3 14B
  • Qwen 3 32B

Token Sensitivity Jailbreak

Published Analyzed Source: arXiv

Transformer-based Large Language Models (LLMs) are vulnerable to highly query-efficient black-box jailbreak attacks due to the structural properties of refusal behaviors: skewed token contribution and cross-model consistency. Refusal mechanisms within LLMs are typically triggered by a sparse subset of sensitive tokens rather than the entire prompt, and these refusal representations (specifically the primary left singular vector of the perturbed representation matrix at intermediate layers) are…

Not All Tokens Are Created Equal: Query-Efficient Jailbreak Fuzzing for LLMs
Evaluated models: Gemma 7B Instruct, Gemma 2 9B IT, Llama 3 8B Instruct+6 more
  • Gemma 7B Instruct
  • Gemma 2 9B IT
  • Llama 3 8B Instruct
  • Llama 3.2 3B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 3B Instruct
  • GPT-3.5 Turbo
  • GPT-4o
  • Claude 3.5 Sonnet

LLM Universal Graph Subversion

Published Analyzed Source: arXiv

An evasion vulnerability in Text-Attributed Graph (TAG) learning models allows attackers to induce targeted misclassifications via LLM-generated, coordinated perturbations to both graph topology and textual semantics. By identifying a semantically distant "influencer" node, an attacker can use a separate LLM to selectively delete highly relevant edges, insert a deceptive edge connecting the target to the influencer, and slightly modify the target node's text to include a keyword aligned with…

Can LLMs Fool Graph Learning? Exploring Universal Adversarial Attacks on Text-Attributed Graphs
Evaluated models: DeepSeek-V3 671B, Llama 4 17B, Mistral 7B+1 more
  • DeepSeek-V3 671B
  • Llama 4 17B
  • Mistral 7B
  • Qwen Plus

Stage-Sequential Agent Escalation

Published Analyzed Source: arXiv

Agentic Large Language Model (LLM) systems utilizing persistent memory, Retrieval-Augmented Generation (RAG) pipelines, and external tool connectors are vulnerable to Logic-layer Prompt Control Injection (LPCI). An attacker can inject obfuscated (e.g., encoded, structurally nested, or semantically reframed) payloads into external memory stores or RAG documents. These payloads bypass conventional inference-time plaintext content filters, persist across session boundaries, and remain dormant…

LAAF: Logic-layer Automated Attack Framework A Systematic Red-Teaming Methodology for LPCI Vulnerabilities in Agentic Large Language Model Systems
Evaluated models: GPT-4o Mini, Claude 3 Haiku, Llama 3.1 70B Instruct+2 more
  • GPT-4o Mini
  • Claude 3 Haiku
  • Llama 3.1 70B Instruct
  • Gemini 2.0 Flash
  • Mixtral 8x7B Instruct

Autonomous Agent Tool RCE

Published Analyzed Source: arXiv

The OpenClaw autonomous agent framework lacks execution sandboxing, running agents directly on the host machine with the disk and system privileges of the host user. This architecture allows attackers to achieve Remote Code Execution (RCE) and arbitrary data exfiltration via Indirect Prompt Injection. By embedding malicious instructions within external data sources (e.g., scraped web pages or uploaded documents), an attacker can hijack the agent's planning capabilities to sequentially chain…

Uncovering Security Threats and Architecting Defenses in Autonomous Agents: A Case Study of OpenClaw
Evaluated models: Not reported

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.