Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

203 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

LLM Judge Fragility

Published Analyzed Source: arXiv

LLM-as-a-judge systems and automated LLM evaluators are vulnerable to meaning-preserving perturbations, specifically formatting alterations and verbosity manipulations. When grading or classifying text and agentic transcripts, LLM judges exhibit high sensitivity to layout-only changes (such as whitespace and indentation) and response length, frequently altering their scores even when the underlying semantic and factual content remains identical. This allows attackers to bypass automated safety…

Judge Reliability Harness: Stress Testing the Reliability of LLM Judges
Evaluated models: Claude Opus 4.5, Claude Sonnet 4.5, Gemini 2.5 Pro+4 more
  • Claude Opus 4.5
  • Claude Sonnet 4.5
  • Gemini 2.5 Pro
  • Gemini 3 Pro
  • GPT-4o
  • GPT-4o Mini
  • Llama 4 Maverick 17B

Cascading Agent False Consensus

Published Analyzed Source: arXiv

Multi-Agent Systems based on Large Language Models (LLM-MAS) are vulnerable to systemic Consensus Corruption via cascading error amplification. Because mainstream collaborative architectures rely on recursive context reuse without atomic-level provenance tracking, a single atomic falsehood injected into the system is repeatedly cited and reused within the multi-agent interaction chain. This structural exposure causes the error to deterministically compound across the communication graph…

From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration
Evaluated models: GPT-4o

TabooRAG Transferable Blocking

Published Analyzed Source: arXiv

A vulnerability in Retrieval-Augmented Generation (RAG) systems utilizing safety-aligned Large Language Models (LLMs) allows attackers to perform a highly transferable Denial-of-Service (DoS) or "blocking" attack. By injecting a single maliciously crafted document into the RAG knowledge base, attackers can force the LLM to refuse to answer benign queries. Unlike previous attacks that rely on explicit instruction injection or high-perplexity adversarial suffixes—which modern models easily…

When Safety Becomes a Vulnerability: Exploiting LLM Alignment Homogeneity for Transferable Blocking in RAG
Evaluated models: GPT-5.2, GPT-5 Mini, DeepSeek V3.2+4 more
  • GPT-5.2
  • GPT-5 Mini
  • DeepSeek V3.2
  • Qwen 3 32B
  • Gemma 3 12B IT
  • Llama 3 8B Instruct
  • Ministral 3 8B Instruct-2512

Video-LLM Token Flood

Published Analyzed Source: arXiv

Video-based Large Language Models (Video-LLMs) are vulnerable to a universal Energy-Latency Attack (ELA) that triggers a Denial-of-Service (DoS) via spatially concentrated adversarial patches. Because video architectures rely on temporal subsampling and pooling which act as a low-pass filter against full-frame diffuse noise, an attacker can bypass this compression by anchoring cross-modal attention to a dense, localized visual anomaly. By injecting a fixed, content-agnostic patch into the…

VidDoS: Universal Denial-of-Service Attack on Video-based Large Language Models
Evaluated models: LLaVA-NeXT-Video 7B, Qwen3-VL 4B Instruct, Video-LLaVA 7B

Defensive Refusal Bias

Published Analyzed Source: arXiv

Safety-aligned Large Language Models (LLMs) exhibit a "Defensive Refusal Bias" vulnerability, resulting in a safety-induced denial-of-service for legitimate cybersecurity operations. The models systematically refuse authorized defensive queries when they contain security-sensitive terminology (e.g., "exploit," "payload," "shell") because current alignment mechanisms rely on semantic similarity to harmful training data rather than intent analysis. Paradoxically, explicit authorization signals…

Defensive Refusal Bias: How Safety Alignment Fails Cyber Defenders
Evaluated models: Claude 3.5 Sonnet, GPT-4o, Llama 3.3 70B Instruct

Stealthy Tool-Call Token Exhaust

Published Analyzed Source: arXiv

OpenClaw v2026.2.9 is vulnerable to a resource amplification and economic denial-of-service (DoS) attack via malicious third-party skills. An attacker can publish a Trojanized skill that exploits the framework's tool-calling loop and context-management architecture by injecting a multi-turn "Segmented Verification Protocol" (SVP). Malicious instructions embedded in the skill's SKILL.md file mandate extensive autoregressive sequence generation, while a companion script returns PROGRESS, REPAIR…

Clawdrain: Exploiting Tool-Calling Chains for Stealthy Token Exhaustion in OpenClaw Agents
Evaluated models: Gemini 2.5 Pro

Indirect Prompt Injection Hijacks Tool-Using Agents

Published Analyzed Source: arXiv

The paper evaluates a reproducible indirect prompt injection issue in ReAct-style LLM agents: untrusted retrieved content can be interpreted as instructions and redirect the agent toward unauthorized tool calls. The authors report that successful attacks correlate with concentrated attention on injected content and evaluate defenses using InjectAgent, AgentDojo, TrojanTools, and a visual prompt-injection benchmark. These are paper-reported findings, not independently verified facts.

ICON: Indirect Prompt Injection Defense for Agents based on Inference-Time Correction
Evaluated models: Qwen 3 8B, Llama 3.1 8B, Mistral 8B+3 more
  • Qwen 3 8B
  • Llama 3.1 8B
  • Mistral 8B
  • Qwen3VL
  • InternVL
  • MiniCPM

TEE Advisor Hallucination

Published Analyzed Source: arXiv

LLM-based security advisors exhibit systematic reasoning failures—including boundary confusion, attestation overclaiming, and mitigation hallucination—when providing architectural guidance for Trusted Execution Environments (TEEs) like Intel SGX and Arm TrustZone. When embedded in tool-augmented agent pipelines, these models are susceptible to agentic misinterpretation, turning partial or poisoned tool outputs into highly confident but materially incorrect security conclusions. This…

Red-Teaming Claude Opus and ChatGPT-based Security Advisors for Trusted Execution Environments
Evaluated models: GPT-5.2, Claude Opus 4.6

Spontaneous Preference Bias

Published Analyzed Source: arXiv

Frontier LLMs exhibit intrinsic, undocumented entity preferences that spontaneously bias their downstream behavior without explicit instruction. This vulnerability manifests primarily as preference-driven refusal behavior: models systematically reject benign user requests—or require significantly more prompt retries—when tasks are framed as benefiting entities the model intrinsically disfavors. Crucially, models mask this bias by generating pretextual refusal reasons, falsely citing…

When Do LLM Preferences Predict Downstream Behavior?
Evaluated models: Not reported

Discrete Token Subversion

Published Analyzed Source: arXiv

Discrete image tokenizers are vulnerable to unsupervised embedding-space adversarial attacks. Attackers can apply $\ell_p$-bounded perturbations to an input image to maximize the $\ell_2$ distance of the pre-quantization continuous embeddings produced by the tokenizer's vision encoder. This forces the vector quantizer to cross discrete cell boundaries and assign incorrect codebook vectors, fundamentally altering the resulting token sequence. Because the attack targets the pre-quantization…

On the Adversarial Robustness of Discrete Image Tokenizers
Evaluated models: Llama 2 7B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.