Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

139 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Unified Robustness Gap

Published Analyzed Source: arXiv

Text scoring models, including dense retrievers, rerankers, and reward models, are vulnerable to score manipulation attacks via search-based discrete perturbations and content injection. An attacker can systematically modify candidate texts using rudimentary string manipulations, gradient-guided token swaps (e.g., HotFlip), masked language modeling (MLM) swaps, or query/sentence injections to spuriously increase model scores. This structural failure condition allows an irrelevant passage or a…

Unifying Adversarial Robustness and Training Across Text Scoring Models
Evaluated models: E5 BERT-base, Qwen 3 0.6B, Llama 3.2 3B Instruct+2 more
  • E5 BERT-base
  • Qwen 3 0.6B
  • Llama 3.2 3B Instruct
  • Llama 3.1 8B Instruct
  • Skywork Reward V2

Adversarial Context Reasoning Brittleness

Published Analyzed Source: arXiv

Large Reasoning Models (LRMs) optimized via Reinforcement Learning from Verifiable Rewards (RLVR) are vulnerable to context pollution in their reasoning traces. An attacker can induce catastrophic reasoning failure by injecting locally coherent but logically or mathematically corrupted snippets into the model's Chain-of-Thought (CoT) or conditioning context. Because standard RLVR optimizes for final-answer correctness strictly under clean conditioning, the models treat the visible trajectory…

Learning Robust Reasoning through Guided Adversarial Self-Play
Evaluated models: DeepSeek R1 Distill Qwen 1.5B, DeepScaleR 1.5B, Qwen 3 4B+1 more
  • DeepSeek R1 Distill Qwen 1.5B
  • DeepScaleR 1.5B
  • Qwen 3 4B
  • Qwen 3 8B

Query-Agnostic Retrieval Poisoning

Published Analyzed Source: arXiv

A vulnerability in Large Language Model-based Retrieval (LLMR) systems allows attackers to intentionally hide specific documents from being retrieved (e.g., in RAG pipelines or search engines) by appending a small number of adversarially crafted, query-agnostic tokens. The attack operates in a complete black-box setting: it requires no knowledge of the victim's queries, the target retrieval model's parameters, or the underlying document corpus. By utilizing Document-Query Adversarial (DQ-A)…

" Someone Hid It": Query-Agnostic Black-Box Attacks on LLM-Based Retrieval
Evaluated models: Mistral 7B, Qwen 2.5 7B

Universal MLLM Target Matching

Published Analyzed Source: arXiv

Closed-source Multi-modal Large Language Models (MLLMs) are vulnerable to Universal Targeted Transferable Adversarial Attacks (UTTAA). An attacker can generate a single, image-agnostic adversarial perturbation ($\delta$) that, when added to any arbitrary source image, steers the victim model to output a description or classification matching a specific target image chosen by the attacker. This vulnerability exploits the transferability of adversarial features from open-source surrogate vision…

Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimization
Evaluated models: GPT-4o, Claude Sonnet 4.5, GPT-5+2 more
  • GPT-4o
  • Claude Sonnet 4.5
  • GPT-5
  • GPT-5.2
  • Claude Opus 4.5

Cross-Image Contagion

Published Analyzed Source: arXiv

Multi-modal Large Language Models (MLLMs) capable of processing interleaved image-text sequences are vulnerable to a universal adversarial perturbation (UAP) attack known as LAMP. This vulnerability allows an attacker to generate a single, noise-based perturbation pattern using a surrogate model (e.g., Mantis-CLIP) that transfers effectively to black-box target models. The attack leverages two novel loss functions during perturbation learning: a "contagious" objective that manipulates…

LAMP: Learning Universal Adversarial Perturbations for Multi-Image Tasks via Pre-trained Models
Evaluated models: Mantis-CLIP, Mantis-SIGLIP, Mantis-Idefics2+4 more
  • Mantis-CLIP
  • Mantis-SIGLIP
  • Mantis-Idefics2
  • VILA 1.5
  • LLaVA 1.6
  • Qwen VL Chat
  • MiniGPT-4

LLM Router Rerouting

Published Analyzed Source: arXiv

LLM routing systems are vulnerable to adversarial rerouting attacks where malicious triggers prepended to user queries manipulate the router's model-selection mechanism. Because LLM routers function as classifiers evaluating query complexity to balance computational cost and response quality, an attacker can craft adversarial prefixes that distort the query's latent semantic representation. This exploits the router's decision boundaries, forcing the system to misclassify the input and redirect…

RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routing
Evaluated models: GPT-4, GPT-4o, GPT-5+2 more
  • GPT-4
  • GPT-4o
  • GPT-5
  • Llama 3 8B
  • Mixtral 8x7B

Pathological Reasoning DoS

Published Analyzed Source: arXiv

A vulnerability in Large Reasoning Models (LRMs) allows attackers to perform Prompt-Induced Inference-Time Denial-of-Service (PI-DoS) attacks by submitting short, semantically coherent adversarial prompts. These prompts, which often take the form of complex logic puzzles with nested dependencies or contradictory constraints, exploit the adaptive computation mechanism of LRMs to force the model into pathologically long, nearly non-terminating intermediate reasoning traces (e.g., generating…

ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Models
Evaluated models: DeepSeek V3, Kimi K2 Instruct, DeepSeek R1+8 more
  • DeepSeek V3
  • Kimi K2 Instruct
  • DeepSeek R1
  • DeepSeek R1 Distill Qwen 32B
  • MiniMax M2
  • Nemotron 3 Nano 30B-A3B
  • Qwen 3 30B-A3B Thinking
  • Qwen 3 32B
  • Claude Sonnet 4.5
  • GPT-5
  • Gemini 3 Pro Preview

Agent Over-Trigger Containment

Published Analyzed Source: arXiv

Autonomous Incident Response (IR) and Security Operations Center (SOC) agents utilizing frontier LLMs are vulnerable to adversarial over-triggering via contextualized prompt injections. When processing untrusted artifacts (such as SQLite logs, alerts, or phishing emails) in a dual-control environment, these agents exhibit a severe calibration failure: they lack action restraint and execute disruptive containment tools prematurely. Attackers can exploit this by embedding T2 (contextualized…

OpenSec: Measuring Incident Response Agent Calibration Under Adversarial Evidence
Evaluated models: GPT-5.2, Claude Sonnet 4.5, DeepSeek V3.2+1 more
  • GPT-5.2
  • Claude Sonnet 4.5
  • DeepSeek V3.2
  • Qwen 3 4B Instruct

VLM Text Overrides Image

Published Analyzed Source: arXiv

A vulnerability exists in multiple state-of-the-art Vision-Language Models (VLMs), including GPT-4o, Gemini-2.5, and LLaVA-OneVision, where persuasive textual misinformation successfully overrides visual evidence. When a model is presented with an image it can correctly interpret, an attacker can inject a contradictory text prompt employing specific rhetorical strategies (Logical, Credibility, Emotional, or Repetition) to force the model into generating a false response. This "obedience bias"…

Do Images Speak Louder than Words? Investigating the Effect of Textual Misinformation in VLMs
Evaluated models: Qwen 2.5 VL 3B Instruct, Qwen 2.5 VL 7B Instruct, InternVL3 1B+8 more
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 7B Instruct
  • InternVL3 1B
  • InternVL3 2B
  • InternVL3 8B
  • LLaVA-OneVision 0.5B
  • LLaVA-OneVision 7B
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • GPT-4o Mini
  • GPT-4o

Visual Object Injection

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to Physical Prompt Injection Attacks (PPIA), a query-agnostic injection technique delivered via the visual modality. The vulnerability stems from the model's "Vision-Enabled Text Recognition" capabilities and "Identity Sensitivity," where the model interprets text embedded in the physical environment (e.g., printed on signs, posters, or objects) as high-priority instructions rather than passive visual data. An attacker can embed adversarial…

Physical Prompt Injection Attacks on Large Vision-Language Models
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4 Turbo+7 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4 Turbo
  • Gemini 1.5 Pro Latest
  • Gemini 1.5 Pro 002
  • Gemini 1.5 Flash Latest
  • Claude 3.5 Sonnet Latest
  • Claude 3.5 Haiku 20241022
  • Llama 3.2 11B Vision
  • Llama 3.2 90B Vision Instruct

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.