Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

8 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Agent Lifecycle Compound Threats

Published Analyzed Source: arXiv

OpenClaw is vulnerable to persistent memory poisoning, allowing an attacker to manipulate the agent's long-term memory store (MEMORY.md) via prompt injection. Because the autonomous agent continuously integrates this memory file as context for all subsequent reasoning and task planning, injected payloads act as durable behavioral constraints. This allows an attacker to persistently alter the agent's core policy, manipulate tool selection, and hijack future sessions without any further…

Taming openclaw: Security analysis and mitigation of autonomous llm agent threats
Evaluated models: Not reported

Autonomous Agent Prompt Reveal

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) deployments and multi-agent systems where an autonomous attacker agent can systematically extract hidden system prompts through self-evolving interaction strategies. The vulnerability leverages a "JustAsk" framework which utilizes Upper Confidence Bound (UCB) exploration to dynamically select and refine attack vectors from a hierarchical taxonomy of 14 atomic skills (e.g., structural formatting, authority appeals) and 14 multi-turn…

Just Ask: Curious Code Agents Reveal System Prompts in Frontier LLMs
Evaluated models: o1, Llama 3.1 70B Hanami X1, Phi-4+38 more
  • o1
  • Llama 3.1 70B Hanami X1
  • Phi-4
  • Aion 1.0
  • Sonar Pro
  • Command A
  • Llama 4 Maverick
  • Llama 3.1 Nemotron Ultra 253B v1
  • Qwen 3 235B-A22B
  • Mercury
  • Hunyuan A13B Instruct
  • UI-TARS 1.5 7B
  • GPT-oss 120B
  • Jamba Mini 1.7
  • Hermes 4 70B
  • Step 3
  • LongCat Flash Chat
  • Tongyi DeepResearch 30B-A3B
  • Cydonia 24B v4.1
  • ERNIE 4.5 21B-A3B Thinking
  • Granite 4.0 H Micro
  • LFM2 8B-A1B
  • Nova Premier v1
  • Kimi K2 Thinking
  • KAT Coder Pro
  • Cogito v2.1 671B
  • Gemini 3 Pro Preview
  • Grok 4.1 Fast
  • Claude Opus 4.5
  • TNG R1T Chimera
  • Intellect 3
  • DeepSeek V3.2 Speciale
  • Trinity Mini
  • Mistral Large 2512
  • DeepSeek V3.1 Nex N1
  • MiMo V2 Flash
  • GLM-4.7
  • MiniMax M2.1
  • Seed 1.6
  • Molmo 2 8B
  • GPT-5.2 Codex

Guardrail Policy Extraction

Published Analyzed Source: arXiv

A black-box guardrail reverse-engineering vulnerability exists in Large Language Model (LLM) serving systems that employ output filtering mechanisms. The vulnerability allows remote attackers to replicate the proprietary decision-making policy and rule sets of the target's safety guardrail without direct access to model parameters. This is achieved through a technique termed Guardrail Reverse-engineering Attack (GRA), which utilizes a reinforcement learning framework combined with genetic…

Black-Box Guardrail Reverse-engineering Attack
Evaluated models: GPT-4o, Llama 3.1 8B

Leaked Bits Collapse Attack Queries

Published Analyzed Source: arXiv

Large Language Models (LLMs), specifically variants of GPT-4o, DeepSeek-R1, OLMo-2, and Llama-4, are vulnerable to accelerated adaptive adversarial attacks due to excessive information leakage in observable output signals. When these models expose "thinking processes" (Chain-of-Thought traces) or token-level log-probabilities (logits) to the end user, they leak significant mutual information $I(Z;T)$ regarding the model's safety state or hidden instructions. This leakage allows adaptive attack…

Bits Leaked per Query: Information-Theoretic Bounds on Adversarial Attacks against LLMs
Evaluated models: DeepSeek R1, GPT-4o Mini 2024-07-18, Llama 4 Maverick 17B+4 more
  • DeepSeek R1
  • GPT-4o Mini 2024-07-18
  • Llama 4 Maverick 17B
  • Llama 4 Scout 17B
  • OLMo 2 7B-1124
  • OLMo 2 13B-1124
  • OLMo 2 32B-0325

Multimodal Prompt Injection

Published Analyzed Source: arXiv

Large Language Models (LLMs), including GPT-4o, LLaMA-3, and GPT-3.5-Turbo, are vulnerable to multimodal prompt injection attacks. These models fail to distinguish between system-level instructions and user-provided content within the context window. Attackers can exploit this by embedding malicious instructions in direct text, indirect sources (such as third-party webpages or PDFs), or visual inputs (images). Successful exploitation results in the model prioritizing the injected adversarial…

Multimodal Prompt Injection Attacks: Risks and Defenses for Modern LLMs
Evaluated models: GPT-3.5, GPT-4o, Llama 3 8B+1 more
  • GPT-3.5
  • GPT-4o
  • Llama 3 8B
  • Mistral Large 24B

Agent Tool Metadata Lure

Published Analyzed Source: arXiv

A vulnerability exists in the tool selection mechanisms of Large Language Model (LLM) agents, identified as the "Attractive Metadata Attack" (AMA). This flaw allows an adversary to manipulate the metadata (names, descriptions, and parameter schemas) of malicious external tools to statistically maximize the likelihood of their selection by the agent, without requiring prompt injection or access to model internals. The vulnerability exploits the agent’s semantic scoring function used to map user…

Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools
Evaluated models: GPT-4o Mini, Llama 3.3 70B Instruct, Qwen 2.5 32B Instruct+2 more
  • GPT-4o Mini
  • Llama 3.3 70B Instruct
  • Qwen 2.5 32B Instruct
  • Gemma 3 27B IT
  • Qwen 3 32B

Agent Action Hijacking

Published Analyzed Source: arXiv

A vulnerability in LLM-based agents, dubbed AI Agent Injection (AI²), allows attackers to hijack the agent's actions by manipulating the agent's memory retrieval mechanism. The attack involves two main steps: (1) Stealing action-aware knowledge from the agent's memory using crafted adversarial queries targeting the retriever module and (2) Generating Trojan prompts consisting of a Trojan string and hijacking instructions. The Trojan string is designed to manipulate the retriever into…

Towards Action Hijacking of Large Language Model-based Agent
Evaluated models: BERT, GPT-3, GPT-4+2 more
  • BERT
  • GPT-3
  • GPT-4
  • M3E
  • MiniLM

GPT-4v System Prompt Leakage

Published Analyzed Source: arXiv

A system prompt leakage vulnerability in GPT-4V allows extraction of internal system prompts through carefully crafted, incomplete conversations combined with image input. Extracted prompts can be used as highly effective jailbreak prompts, bypassing safety restrictions and leading to undesirable outputs, including revealing personally identifiable information from images.

Jailbreaking gpt-4v via self-adversarial attacks with system prompts
Evaluated models: GPT-4, GPT-4V, LLaVA 1.5

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.