Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

122 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

LLM Router Rerouting

Published Analyzed Source: arXiv

LLM routing systems are vulnerable to adversarial rerouting attacks where malicious triggers prepended to user queries manipulate the router's model-selection mechanism. Because LLM routers function as classifiers evaluating query complexity to balance computational cost and response quality, an attacker can craft adversarial prefixes that distort the query's latent semantic representation. This exploits the router's decision boundaries, forcing the system to misclassify the input and redirect…

RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routing
Evaluated models: GPT-4, GPT-4o, GPT-5+2 more
  • GPT-4
  • GPT-4o
  • GPT-5
  • Llama 3 8B
  • Mixtral 8x7B

Visual Compression Mismatch Attack

Published Analyzed Source: arXiv

A vulnerability exists in Large Vision-Language Models (LVLMs) utilizing visual token compression mechanisms (e.g., VisionZip, VisPruner) to reduce inference latency. The vulnerability stems from an optimization-inference mismatch where standard adversarial defenses assume full-token processing, while the deployed model utilizes a subset of tokens selected via importance metrics (typically attention scores).

On the Adversarial Robustness of Large Vision-Language Models under Visual Token Compression
Evaluated models: LLaVA 1.5 7B

Visual Object Injection

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to Physical Prompt Injection Attacks (PPIA), a query-agnostic injection technique delivered via the visual modality. The vulnerability stems from the model's "Vision-Enabled Text Recognition" capabilities and "Identity Sensitivity," where the model interprets text embedded in the physical environment (e.g., printed on signs, posters, or objects) as high-priority instructions rather than passive visual data. An attacker can embed adversarial…

Physical Prompt Injection Attacks on Large Vision-Language Models
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4 Turbo+7 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4 Turbo
  • Gemini 1.5 Pro Latest
  • Gemini 1.5 Pro 002
  • Gemini 1.5 Flash Latest
  • Claude 3.5 Sonnet Latest
  • Claude 3.5 Haiku 20241022
  • Llama 3.2 11B Vision
  • Llama 3.2 90B Vision Instruct

Confident Misinformation Hallucination

Published Analyzed Source: arXiv

A vulnerability in large language models (LLMs) allows attackers to induce factually incorrect outputs by injecting misinformation into prompts framed with strong confidence. By using authoritative phrasing (e.g., "As we know..."), attackers exploit model sycophancy, causing the LLM to accept the false premise and generate hallucinated content aligned with the injected misinformation. The models fail to detect and correct the embedded falsehoods, generating fabricated but plausible responses.

AdversaRiskQA: An Adversarial Factuality Benchmark for High-Risk Domains
Evaluated models: GPT-oss 20B, GPT-oss 120B, GPT-5+3 more
  • GPT-oss 20B
  • GPT-oss 120B
  • GPT-5
  • Qwen 3 4B Instruct
  • Qwen 3 30B-A3B Instruct
  • Qwen 3 Next 80B-A3B Instruct

LLM Judge Framing Bias

Published Analyzed Source: arXiv

LLM-based evaluation systems ("LLM-as-a-Judge") exhibit a structural vulnerability termed "Framing Bias," wherein the model produces logically contradictory judgments depending on the syntactic framing of the evaluation prompt. Specifically, when assessing the same content using predicate-positive (P) framing (e.g., "Is this toxic?") versus predicate-negative (¬P) framing (e.g., "Is this non-toxic?"), models frequently fail to invert their binary decisions, leading to inconsistency rates…

When Wording Steers the Evaluation: Framing Bias in LLM judges
Evaluated models: Llama 3.2 1B Instruct, Llama 3.1 8B Instruct, Llama 3.1 70B Instruct+11 more
  • Llama 3.2 1B Instruct
  • Llama 3.1 8B Instruct
  • Llama 3.1 70B Instruct
  • Llama 3.3 70B Instruct
  • Qwen 2.5 1.5B Instruct
  • Qwen 2.5 3B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 14B Instruct
  • Qwen 2.5 32B Instruct
  • Qwen 2.5 72B Instruct
  • o4-mini
  • GPT-4o
  • GPT-5 Mini
  • GPT-5

Metacognitive Prompting Lowers Resistance

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to multi-turn persuasive conversational attacks that induce the adoption of counterfactual beliefs. By leveraging the Source–Message–Channel–Receiver (SMCR) communication framework, attackers can systematically erode a model's confidence in established facts and compel the model to output misinformation. Specific attack vectors include manipulating source attribution (authority framing), message content (logical, credibility, or emotional appeals)…

Vulnerability of LLMs' Belief Systems? LLMs Belief Resistance Check Through Strategic Persuasive Conversation Interventions
Evaluated models: GPT-4o, Llama 3.2 3B, Llama 3.3 70B+2 more
  • GPT-4o
  • Llama 3.2 3B
  • Llama 3.3 70B
  • Mistral 7B
  • Qwen 2.5 7B

Physical Navigation Prompt Injection

Published Analyzed Source: arXiv

LLM-based navigation agents, including NavGPT and prompt-tuned outdoor agents, are vulnerable to adaptive prompt injection attacks. This vulnerability allows remote attackers to hijack the physical movement of the agent by embedding optimized malicious instructions into benign natural language inputs. The issue arises because the agents parse user instructions to generate executable plans without sufficient separation between control logic and untrusted input. The PINA (Prompt Injection Attack…

PINA: Prompt Injection Attack against Navigation Agents
Evaluated models: GPT-3.5, GPT-4, Llama 2 7B

Detector Telemetry Camouflage

Published Analyzed Source: arXiv

Single-pass hallucination detectors relying on internal telemetry (uncertainty, hidden-state geometry, and attention patterns) are vulnerable to white-box, model-side adversarial attacks. An attacker can employ the CORVUS (Camouflaging Open-weight Representations, Volumes, Uncertainty, and Structure) technique to fine-tune lightweight Low-Rank Adapters (LoRA) on the target LLM. This method optimizes a specific loss objective that camouflages detector-visible telemetry signals—specifically…

CORVUS: Red-Teaming Hallucination Detectors via Internal Signal Camouflage in Large Language Models
Evaluated models: Llama 2 7B, Llama 3 8B, Qwen 2.5 14B+1 more
  • Llama 2 7B
  • Llama 3 8B
  • Qwen 2.5 14B
  • Vicuna 7B

VLM In-the-Loop Adversary

Published Analyzed Source: arXiv

The VILTA (VLM-in-the-Loop Trajectory Adversary) framework is vulnerable to Prompt Injection and Data Poisoning via un-sanitized scene representation inputs. The system integrates a Vision-Language Model (Gemini-2.5-Flash) into a closed-loop reinforcement learning environment, feeding it Bird’s-Eye-View (BEV) imagery alongside text-based vehicle dynamics data (e.g., position, speed, and risk_category) to generate challenging driving trajectories. An attacker who can manipulate the input…

VILTA: A VLM-in-the-Loop Adversary for Enhancing Driving Policy Robustness
Evaluated models: Gemini 2.5 Flash

LLM False Refusal Bias

Published Analyzed Source: arXiv

Large Language Models (LLMs) exhibit a False Refusal vulnerability during legitimate hate speech detoxification tasks (text style transfer). Safety alignment mechanisms fail to contextually distinguish between a benign instruction to "detoxify" or "rewrite" harmful content and the generation of harmful content itself. This results in a denial of service where the model refuses to process the input. This vulnerability is not uniformly distributed; it is statistically biased to…

Analyzing Bias in False Refusal Behavior of Large Language Models for Hate Speech Detoxification
Evaluated models: GPT-3.5, GPT-4o, Llama 3.1 8B+4 more
  • GPT-3.5
  • GPT-4o
  • Llama 3.1 8B
  • Mistral 7B
  • Qwen 2.5 7B
  • Gemma 2 9B
  • Mixtral 8x7B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.