Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

736 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

KV-Cache Sharing Timing Side-channel

Published Analyzed Source: arXiv

Multi-tenant Large Language Model (LLM) inference systems utilizing global Key-Value (KV) cache sharing are vulnerable to a timing side-channel attack. By measuring the Time-To-First-Token (TTFT) latency of crafted API requests, an unprivileged remote attacker can determine if specific token sequences have been previously processed and cached by the system for other users. This observable timing difference between cache hits (low TTFT) and cache misses (high TTFT) allows for the token-by-token…

Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference
Evaluated models: Phi-4 14B, Qwen 3 30B-A3B, Qwen 3 32B+3 more
  • Phi-4 14B
  • Qwen 3 30B-A3B
  • Qwen 3 32B
  • Llama 3.3 70B Instruct
  • Qwen 3 235B-A22B
  • DeepSeek R1

Thinking Mode Jailbreak Amplification

Published Analyzed Source: arXiv

Large Language Models (LLMs) implementing "Thinking Mode" (also known as Reasoning Mode or Chain-of-Thought) exhibit a heightened susceptibility to jailbreak attacks compared to their non-reasoning counterparts. When a model is prompted to reason step-by-step (often delimited by specific tokens like <think> and </think>), the internal reasoning process frequently overrides safety alignment training. Research indicates that during the generation of the thinking chain, the model often…

The Cost of Thinking: Increased Jailbreak Risk in Large Language Models
Evaluated models: Qwen 3 0.6B, Qwen 3 1.7B, Qwen 3 4B+8 more
  • Qwen 3 0.6B
  • Qwen 3 1.7B
  • Qwen 3 4B
  • Qwen 3 8B
  • DeepSeek R1 Distill Qwen 1.5B
  • DeepSeek R1 Distill Llama 8B
  • Llama 3 8B Instruct
  • Qwen 2.5 1.5B Instruct
  • Qwen Plus Latest
  • Doubao Seed 1.6 Flash
  • DeepSeek Reasoner

Automated Red-Teaming Achieves 100% ASR

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to automated adversarial attacks that systematically combine multiple jailbreaking "primitives" into complex prompt chains. A dynamic optimization engine can generate and test billions of unique combinations of techniques (e.g., low-resource language translation, payload splitting, role-playing) to bypass safety guardrails. This combinatorial approach differs from manual red-teaming by systematically exploring the attack surface, achieving…

LLM Robustness Leaderboard v1--Technical report
Evaluated models: Yi Large, Qwen 2.5 72B Instruct, Qwen 2.5 7B Instruct+36 more
  • Yi Large
  • Qwen 2.5 72B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen Max
  • Qwen Plus
  • Nova Lite v1
  • Nova Micro v1
  • Nova Pro v1
  • Claude 3 Haiku
  • Claude 3 Opus
  • Claude 3 Sonnet
  • Claude 3.5 Haiku 20241022
  • Claude 3.5 Sonnet 20240620
  • Claude 3.5 Sonnet 20241022
  • DeepSeek R1
  • DeepSeek V3
  • Gemini 1.5 Pro
  • Gemma 2 27B IT
  • Granite 3.1 8B
  • Llama 3.1 405B Instruct
  • Llama 3.1 70B Instruct
  • Llama 3.1 8B Instruct
  • Llama 3.2 11B Vision Instruct
  • Llama 3.2 1B Instruct
  • Llama 3.2 90B Vision Instruct
  • Llama 3.3 70B Instruct
  • Phi-4
  • Ministral 8B
  • Mistral Nemo
  • Mixtral 8x22B Instruct
  • Mixtral 8x7B Instruct
  • Pixtral Large 2411
  • GPT-4o 2024-08-06
  • GPT-4o 2024-11-20
  • GPT-4o Mini 2024-07-18
  • o1 2024-12-17
  • o3-mini 2025-01-14
  • Falcon 3 10B Instruct
  • Grok 2 1212

Physical Patch Driving Hijack

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) employed in autonomous driving (AD) systems are vulnerable to a physically realizable adversarial patch attack dubbed "PhysPatch." This vulnerability exists because MLLMs inherit susceptibility to visual adversarial perturbations from their vision backbones. The attack utilizes a semantic-aware mask initialization strategy combined with a potential field algorithm to identify physically plausible regions for patch placement within a driving scene (e.g…

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems
Evaluated models: LLaVA v1.6 13B, Qwen 2.5 VL 72B Instruct, Llama 3.2 90B Vision Instruct+8 more
  • LLaVA v1.6 13B
  • Qwen 2.5 VL 72B Instruct
  • Llama 3.2 90B Vision Instruct
  • GPT-4o
  • GPT-4.1
  • Claude Sonnet 4
  • Gemini 2.0 Flash
  • Qwen 2.5 VL Max
  • o3
  • Gemini 2.5 Flash
  • QVQ-Plus

Graph-LLM Template Injection

Published Analyzed Source: arXiv

A vulnerability exists in the graph encoding architecture of LLaGA (Large Language and Graph Assistant), specifically within the "neighborhood detail template" used to construct node sequences. LLaGA enforces a fixed-shape computational tree for each node; when a target node has fewer neighbors than the required template size (e.g., $k$ children), the system utilizes placeholders to maintain the fixed structure.

Adversarial Attacks and Defenses on Graph-aware Large Language Models (LLMs)
Evaluated models: GPT-4, Llama 2 7B, Vicuna 7B

Stealthy Multi-Round Communication Tampering

Published Analyzed Source: arXiv

A vulnerability exists in LLM-based Multi-Agent Systems (LLM-MAS) where an attacker with control over the communication network can perform a multi-round, adaptive, and stealthy message tampering attack. By intercepting and subtly modifying inter-agent messages over multiple conversational turns, an attacker can manipulate the system's collective reasoning process. The attack (named MAST in the reference paper) uses a fine-tuned policy model to generate a sequence of small, context-aware…

Attack the Messages, Not the Agents: A Multi-round Adaptive Stealthy Tampering Framework for LLM-MAS
Evaluated models: Gemini 2.5 Pro, GPT-4o, Llama 3.1 70B Instruct+3 more
  • Gemini 2.5 Pro
  • GPT-4o
  • Llama 3.1 70B Instruct
  • Llama 3.1 8B Instruct
  • Mistral 7B Instruct v0.3
  • Qwen 3 8B

Agent Tool Metadata Lure

Published Analyzed Source: arXiv

A vulnerability exists in the tool selection mechanisms of Large Language Model (LLM) agents, identified as the "Attractive Metadata Attack" (AMA). This flaw allows an adversary to manipulate the metadata (names, descriptions, and parameter schemas) of malicious external tools to statistically maximize the likelihood of their selection by the agent, without requiring prompt injection or access to model internals. The vulnerability exploits the agent’s semantic scoring function used to map user…

Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools
Evaluated models: GPT-4o Mini, Llama 3.3 70B Instruct, Qwen 2.5 32B Instruct+2 more
  • GPT-4o Mini
  • Llama 3.3 70B Instruct
  • Qwen 2.5 32B Instruct
  • Gemma 3 27B IT
  • Qwen 3 32B

Autonomous LLMs Jailbreak Models

Published Analyzed Source: arXiv

Large Reasoning Models (LRMs) can be instructed via a single system prompt to act as autonomous adversarial agents. These agents engage in multi-turn persuasive dialogues to systematically bypass the safety mechanisms of target language models. The LRM autonomously plans and executes the attack by initiating a benign conversation and gradually escalating the harmfulness of its requests, thereby circumventing defenses that are not robust to sustained, context-aware persuasive attacks. This…

Large Reasoning Models Are Autonomous Jailbreak Agents
Evaluated models: Claude Sonnet 4, DeepSeek R1, DeepSeek V3+11 more
  • Claude Sonnet 4
  • DeepSeek R1
  • DeepSeek V3
  • Gemini 2.5 Flash
  • GPT-4.1
  • GPT-4o
  • Grok 3
  • Grok 3 Mini
  • Llama 3.1 70B
  • Llama 4 Maverick
  • o4-mini
  • Qwen 2.5 32B
  • Qwen 3 235B-A22B
  • Qwen 3 30B-A3B

Poisoned RAG Steering

Published Analyzed Source: arXiv

Retrieval-Augmented Generation (RAG) systems are vulnerable to knowledge poisoning attacks (specifically the "PoisonedRAG" method) where an attacker injects adversarial texts into the retrieval knowledge database. These adversarial texts are optimized to achieve two simultaneous goals: 1) rank highly (top-k) during the retrieval phase for specific target queries, and 2) semantically steer the Large Language Model (LLM) to generate a pre-defined, attacker-chosen response instead of the ground…

Defending against knowledge poisoning attacks during retrieval-augmented generation
Evaluated models: GPT-3.5, GPT-4, GPT-4o

Word Puzzle Reasoning Jailbreak

Published Analyzed Source: arXiv

A logic-based jailbreak vulnerability exists in Large Language Models (LLMs) known as "PUZZLED," where safety alignment mechanisms are bypassed by embedding harmful instructions within word-based puzzles. The attacker identifies sensitive keywords in a malicious prompt, masks them (e.g., replacing "bomb" with "[WORD1]"), and presents the masked terms as a cognitive task—specifically Word Searches, Anagrams, or Crosswords—accompanied by linguistic clues (word length, part-of-speech, and…

PUZZLED: Jailbreaking LLMs through Word-Based Puzzles
Evaluated models: GPT-4.1, GPT-4o, Claude 3.7 Sonnet+2 more
  • GPT-4.1
  • GPT-4o
  • Claude 3.7 Sonnet
  • Gemini 2.0 Flash
  • Llama 3.1 8B Instruct

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.