Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

101 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

CoT PII Trace Leakage

Published Analyzed Source: arXiv

Inference-time Personally Identifiable Information (PII) leakage is significantly amplified when using Chain-of-Thought (CoT) prompting or reasoning-enabled Large Language Models (LLMs). When an attacker or user elicits step-by-step reasoning or utilizes models with native "thinking" token budgets, sensitive context data provided in the prompt is directly resurfaced into intermediate reasoning steps or the final output. This bypasses output-level privacy policies instructing the model not to…

Safer Reasoning Traces: Measuring and Mitigating Chain-of-Thought Leakage in LLMs
Evaluated models: DeepSeek R1 Distill Llama 70B, Llama 3.3 70B, Mixtral 8x22B+3 more
  • DeepSeek R1 Distill Llama 70B
  • Llama 3.3 70B
  • Mixtral 8x22B
  • o3
  • Qwen 3 32B
  • o4-mini

Agent Skill Supply Chain Attack

Published Analyzed Source: arXiv

LLM agent frameworks that rely on external or marketplace-distributed skills are vulnerable to supply-chain payload execution and confused deputy attacks. Attackers can inject malicious skills into agent registries by exploiting the fundamental skill architecture (applicability conditions, policies, and interfaces). By manipulating skill metadata and applicability predicates, attackers force the agent to retrieve and activate the malicious skill across broad task categories. Malicious…

SoK: Agentic Skills--Beyond Tool Use in LLM Agents
Evaluated models: Not reported

LLM Guardrail Benchmark Lies

Published Analyzed Source: arXiv

Architectural limitations in Meta's Llama-Prompt-Guard-2-86M and Llama-Guard-3-8B cause them to fail at detecting indirect prompt injections and agentic tool-use attacks, with detection rates dropping as low as 7-37%. Llama-Guard-3-8B enforces strict user/assistant message alternation and lacks support for tool-use roles; attempting to process messages with role: "tool" or role: "ipython" causes the chat template to raise an error, preventing evaluation entirely. PromptGuard 2 operates…

When Benchmarks Lie: Evaluating Malicious Prompt Classifiers Under True Distribution Shift
Evaluated models: Llama 3 8B, Llama 3.1 8B

Inter-Agent Privacy Leakage

Published Analyzed Source: arXiv

Multi-agent Large Language Model (LLM) architectures are vulnerable to internal-channel data leakage due to the absence of access controls and data minimization in inter-agent communication and shared memory. Frameworks such as LangChain, CrewAI, AutoGPT, and MetaGPT propagate complete task contexts—including unredacted sensitive data—between specialized agents during task delegation. Because traditional LLM security guardrails only filter final user-facing outputs, attackers or benign…

AgentLeak: A Benchmark for Internal-Channel Privacy Leakage in Multi-Agent LLM Systems
Evaluated models: GPT-4o, GPT-4o Mini, Claude 3.5 Sonnet+2 more
  • GPT-4o
  • GPT-4o Mini
  • Claude 3.5 Sonnet
  • Llama 3.3 70B Instruct
  • Mistral Large 2411

LLM Private Attribute Inference

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to Attribute Inference Attacks, where an attacker exploits the model's reasoning capabilities to deduce sensitive personal attributes (e.g., age, gender, location, income level) from seemingly innocuous, unclassified user-generated text. Unlike traditional privacy leaks that rely on the memorization of training data, this vulnerability leverages the model's zero-shot inference and contextual deduction. Because the attack prompts are benign in nature…

Stop Tracking Me! Proactive Defense Against Attribute Inference Attack in LLMs
Evaluated models: Llama 2 7B Chat, Llama 2 13B Chat, Llama 3.1 8B Instruct+5 more
  • Llama 2 7B Chat
  • Llama 2 13B Chat
  • Llama 3.1 8B Instruct
  • DeepSeek R1 Distill Qwen 7B
  • Qwen 2.5 7B Instruct
  • GPT-3.5 Turbo
  • GPT-4o
  • Gemini 2.5 Pro

RAG Knowledgebase Exfiltration

Published Analyzed Source: arXiv

Retrieval-Augmented Generation (RAG) systems are vulnerable to iterative knowledge-extraction attacks designed to reconstruct the underlying private knowledge base. The vulnerability exists due to the decoupled optimization of the retrieval and generation phases. Attackers can craft adversarial queries consisting of two distinct components: an "Information" component (optimized via gradient descent or random sampling to steer embeddings toward specific, diverse regions of the vector space) and…

Benchmarking Knowledge-Extraction Attack and Defense on Retrieval-Augmented Generation
Evaluated models: GPT-4o, Llama 3 8B, Qwen 2.5 7B

Adaptive Web Agent Prompt Injection

Published Analyzed Source: arXiv

Large Language Model (LLM) based web agents (such as those built using the BrowserUse scaffold) are vulnerable to Indirect Prompt Injection (IPI) attacks when autonomously navigating and processing untrusted web content. Unlike standard Cross-Site Scripting (XSS), this vulnerability occurs when the LLM orchestrator consumes the DOM or visual screenshots of a webpage containing concealed or contextually disguised adversarial instructions. The LLM interprets these embedded text strings as…

MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
Evaluated models: GPT-4.1, GPT-4o, Qwen3-VL 32B Instruct

Personalized Agent Double Agent

Published Analyzed Source: arXiv

OpenClaw is vulnerable to Indirect Prompt Injection (IPI), Tool-Return Manipulation, and Persistent Memory Poisoning. The agent incorporates untrusted external content (e.g., fetched web pages) and external tool outputs directly into its observation stream without sufficient isolation. An attacker can embed malicious payloads into these external channels to hijack the agent's planning and execution trace. This allows the attacker to silently trigger high-privilege actions via OpenClaw's Skills…

From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent
Evaluated models: GPT-4o, Llama 3.1 70B, Qwen 2.5 7B

LLM Edit Fingerprint Leak

Published Analyzed Source: arXiv

A side-channel information leakage vulnerability exists in the "locate-then-edit" paradigm of Large Language Model (LLM) knowledge editing, specifically affecting algorithms such as ROME, MEMIT, and AlphaEdit. The parameter update matrix ($\Delta W$) generated during the editing process preserves the algebraic structure of the edited data. Specifically, the row space of the parameter difference matrix encodes a mathematical fingerprint of the key vectors associated with the edited subjects. An…

Reverse-Engineering Model Editing on Language Models
Evaluated models: Llama 3 8B, Qwen 2.5 7B

Voice Agent Behavioral Bypass

Published Analyzed Source: arXiv

Audio Large Language Models (ALLMs) integrated into voice agent systems for high-stakes domains (banking, IT support, logistics) are vulnerable to multimodal adversarial attacks via spoken interaction. Adversaries can exploit the model's inherent compliance and contextual awareness through multi-turn dialogue to bypass authentication safeguards, escalate privileges (e.g., unauthorized credit limit increases), exfiltrate sensitive Personally Identifiable Information (PII), and poison…

Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+4 more
  • GPT-4o
  • GPT-4o Mini
  • Gemini 1.5 Pro
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • Qwen2-Audio 7B
  • Qwen 2.5 Omni 7B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.