Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

203 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Adversarial Prompts Defeat Code Defenses

Published Analyzed Source: arXiv

State-of-the-art secure code generation methods (Sven, SafeCoder, and PromSec) are vulnerable to adversarial prompt perturbations during inference, allowing for the bypass of security alignment mechanisms. The vulnerability stems from the models' reliance on surface-level textual pattern matching rather than semantic security reasoning. By employing simple prompt manipulations—such as Cue Inversion (flipping security directives), Naturalness Reframing (rewriting comments as novice questions)…

How Secure is Secure Code Generation? Adversarial Prompts Put LLM Defenses to the Test
Evaluated models: GPT-3.5, GPT-4o, Mistral 7B

LLM Review Paraphrase Attack

Published Analyzed Source: arXiv

LLM-as-a-Reviewer systems, which utilize large language models to automate the peer review process, are vulnerable to the Paraphrasing Adversarial Attack (PAA). PAA is a black-box optimization technique that exploits the model's sensitivity to specific input sequences and self-preference bias. By iteratively paraphrasing specific manuscript sections (such as the abstract) using in-context learning (ICL) guided by previous review scores, an attacker can generate adversarial sequences that…

Paraphrasing Adversarial Attack on LLM-as-a-Reviewer
Evaluated models: GPT-4o, Claude Sonnet 4

Point Cloud Adversarial Attack

Published Analyzed Source: arXiv

Point-based 3D Vision-Language Models (VLMs), specifically PointLLM and GPT4Point, are vulnerable to white-box, gradient-based adversarial attacks. The vulnerability exists in the model's processing of 3D point cloud data, where an attacker can optimize imperceptible geometric perturbations ($\delta$) on the input point cloud ($x$) to manipulate the model's textual output. The paper identifies two specific attack vectors: 1. Vision Attack: Directly perturbs the high-dimensional visual token…

On the Adversarial Robustness of 3D Large Vision-Language Models
Evaluated models: Vicuna 7B

Sophisticated Deception Induces Misbelief

Published Analyzed Source: arXiv

Large Language Models (LLMs) exhibit a vulnerability to "hard-to-falsify" deceptive evidence injection, termed the "Facade of Truth." This vulnerability allows an attacker to override an LLM’s parametric knowledge (internal factual beliefs) by injecting sophisticated, iteratively refined fabricated evidence into the context window. Unlike overt misinformation which models typically reject, this attack utilizes a multi-agent adversarial framework (MisBelief) to generate evidence that mimics…

The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence
Evaluated models: GPT-3.5, GPT-5, Llama 3 8B+1 more
  • GPT-3.5
  • GPT-5
  • Llama 3 8B
  • Qwen 2.5 32B

Tool Stream Injection Hijack

Published Analyzed Source: arXiv

Large Language Model (LLM) agents utilizing external tool execution frameworks are vulnerable to Indirect Prompt Injection (IPI) via the "Tool Stream." Unlike traditional data-stream injections (e.g., malicious emails), this vulnerability exploits the agent's interpretation of functional tool definitions (docstrings, signatures) and runtime feedback (error messages, return values) as binding operational constraints. Adversaries functioning as compromised or malicious tool providers can embed…

VIGIL: Defending LLM Agents Against Tool Stream Injection via Verify-Before-Commit
Evaluated models: Gemini 2.5 Pro, Qwen 3 Max

FusionRoute Logit Poisoning

Published Analyzed Source: arXiv

A fundamental algorithmic limitation exists in purely token-level multi-LLM collaboration systems (such as the "Collab" framework or routing-only variants of FusionRoute) that rely solely on selecting fixed expert outputs without complementary generation. The vulnerability, formally defined as an Identifiability Failure in Token-Level Routing, arises because observing optimal state-action values ($Q^$) along trajectories is insufficient to uniquely identify the specific expert action required…

Token-Level LLM Collaboration via FusionRoute
Evaluated models: GPT-4o, Llama 3.1 8B, Mistral 7B+1 more
  • GPT-4o
  • Llama 3.1 8B
  • Mistral 7B
  • Gemma 2 2B

LLM Watermark Translation Bypass

Published Analyzed Source: arXiv

Token-level embedding-time watermarking algorithms, specifically KGW (Kirchenbauer et al.) and Exponential Sampling (EXP, Kuditipudi et al.), when implemented in Large Language Models (LLMs) for Bangla text generation, are vulnerable to watermark erasure via cross-lingual round-trip translation (RTT) attacks. While these methods achieve high detection accuracy (>88%) under benign conditions, translating watermarked Bangla text to English and back to Bangla causes detection accuracy to collapse…

BanglaLorica: Design and Evaluation of a Robust Watermarking Algorithm for Large Language Models in Bangla Text Generation
Evaluated models: Llama 3 8B

Persona Performance Reversal

Published Analyzed Source: arXiv

A vulnerability in the prompt-based persona conditioning of clinical Large Language Models (LLMs) allows system-level role prompts (e.g., "You are an ED physician") to override the model's base safety guardrails and degrade task accuracy. When assigned medically grounded personas or specific interaction styles (e.g., "bold" or "cautious"), the LLM adopts these roles as behavioral priors, which induces non-monotonic, context-dependent shifts in clinical risk posture. While improving performance…

The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Models
Evaluated models: GPT-5, Llama 3.1 8B, Qwen 2.5 7B+1 more
  • GPT-5
  • Llama 3.1 8B
  • Qwen 2.5 7B
  • Gemma 2 27B

LLM Inconsistent Vulnerability Assessment

Published Analyzed Source: arXiv

Large Language Models (LLMs), specifically Llama-3.1-8B-Instruct, Ministral-8B-Instruct-2410, Gemma-2-9B-It, and Qwen2.5-7B-Instruct, contain a safety guardrail bypass vulnerability when subjected to optimized adversarial prompts. The vulnerability is exposed via the RainbowPlus quality-diversity search method utilized within the RedBench evaluation framework. These models exhibit high Attack Success Rates (ASR)—up to 97.81% for Ministral and 96.25% for Llama-3.1—failing to refuse prompts in…

RedBench: A Universal Dataset for Comprehensive Red Teaming of Large Language Models
Evaluated models: GPT-4o, Llama 3.1 8B, Mistral 7B 8B+2 more
  • GPT-4o
  • Llama 3.1 8B
  • Mistral 7B 8B
  • Qwen 2.5 7B
  • Gemma 2 9B

Quantization Contrastive Jailbreak

Published Analyzed Source: arXiv

A malicious model supply chain vulnerability exists involving a technique termed Adversarial Contrastive Learning (ACL) for Large Language Model (LLM) quantization attacks. This vulnerability allows an attacker to publish a model that appears benign and preserves high utility in full precision (e.g., BF16 or FP32) but exhibits malicious behaviors—such as jailbreak, over-refusal, or advertisement injection—immediately upon zero-shot quantization (e.g., INT8, FP4, or NF4).

Adversarial Contrastive Learning for LLM Quantization Attacks
Evaluated models: Qwen 2.5 1.5B Instruct, Qwen 2.5 3B Instruct, Llama 3.2 1B Instruct+1 more
  • Qwen 2.5 1.5B Instruct
  • Qwen 2.5 3B Instruct
  • Llama 3.2 1B Instruct
  • Llama 3.2 3B Instruct

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.