Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

704 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Persona Adherence Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) deployed as Role-Playing Agents (RPAs) are vulnerable to Persona-Targeted Jailbreaks. When an LLM is prompted to adopt a persona—particularly characters with negative, risky, or villainous traits—the model's optimization for role fidelity frequently overrides its foundational safety alignment. Attackers can exploit this vulnerability by synthesizing queries that leverage the specific narrative background, ideology, or psychological vulnerabilities of the assigned…

Stay in Character, Stay Safe: Dual-Cycle Adversarial Self-Evolution for Safety Role-Playing Agents
Evaluated models: GPT-4o, Llama 3 8B, Qwen 2.5 7B+1 more
  • GPT-4o
  • Llama 3 8B
  • Qwen 2.5 7B
  • Gemma 2 9B

Intent-Context Coupling Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs), including GPT-4o, Claude 3.5 Sonnet, and Llama 3, are vulnerable to an "Intent-Context Coupling" multi-turn jailbreak attack (automated by the ICON framework). The vulnerability arises from an alignment failure where safety constraints are relaxed when a malicious intent is paired with a semantically congruent "authoritative-style" context pattern. By routing specific prohibited intents (e.g., Hacking) to pre-optimized context patterns (e.g., Scientific Research…

ICON: Intent-Context Coupling for Efficient Multi-Turn Jailbreak Attack
Evaluated models: Llama 4 Maverick Instruct, Llama 3.1 405B Instruct, Qwen-Max 2025-01-25+8 more
  • Llama 4 Maverick Instruct
  • Llama 3.1 405B Instruct
  • Qwen-Max 2025-01-25
  • DeepSeek V3.2
  • GPT-5.1 2025-11-13
  • GPT-4o 2024-11-20
  • Claude Sonnet 4.5 20250929
  • Gemini 3 Pro Preview
  • Llama Guard 3 8B
  • Llama Guard 4 12B
  • WildGuard

LLM Soft Hate Policy Bypass

Published Analyzed Source: arXiv

Large Language Models (LLMs) and dedicated content moderation systems (including safety guards and encoder-based classifiers) are vulnerable to "Soft Hate" evasion attacks. This vulnerability arises when hostile standpoints are encoded through defeasible reasoning structures—specifically formalized by the Argumentum Model of Topics (AMT)—rather than explicit lexical toxicity. Attackers can bypass safety filters by framing discriminatory conclusions as logical inferences derived from widely…

SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility
Evaluated models: HateBERT, HateRoBERTa, Llama Guard 3 1B+7 more
  • HateBERT
  • HateRoBERTa
  • Llama Guard 3 1B
  • Qwen 3 Guard 4B
  • ShieldGemma 2B
  • DeepSeek V3.1
  • GPT-5 Mini
  • Llama 3.2 3B
  • Gemma 3 4B
  • Qwen 3 4B

Hard-Negative Prompt Evasion

Published Analyzed Source: arXiv

Embedding-based LLM prompt injection detectors, specifically those based on the DeBERTa-v3 architecture, are vulnerable to adversarial evasion attacks utilizing "hard-negative" mining and fuzzing techniques. Attackers can circumvent detection mechanisms by iteratively generating adversarial prompts that are semantically malicious but structurally mutated to evade the classifier's decision boundary. Specific evasion vectors identified include semantic fuzzing (paraphrasing), syntactic fuzzing…

Proactive Hardening of LLM Defenses with HASTE
Evaluated models: GPT-4o

Refusal Prefix Unlearning

Published Analyzed Source: arXiv

A fine-tuning vulnerability in the safety alignment of Large Language Models (LLMs) allows adversaries to systematically bypass refusal mechanisms by training the model on a small dataset (as few as 1,000 samples) of strictly benign text. By prepending standard refusal prefixes (e.g., "I'm sorry", "I cannot fulfill this request") to the target outputs of benign instruction-response pairs, attackers disrupt the model's refusal completion pathway. When subsequently prompted with unsafe queries…

LLMs Can Unlearn Refusal with Only 1,000 Benign Samples
Evaluated models: Llama 2 13B, Llama 3.1 8B, Llama 3.2 1B+13 more
  • Llama 2 13B
  • Llama 3.1 8B
  • Llama 3.2 1B
  • Llama 3.3 70B
  • Qwen 2 7B
  • Qwen 2.5 32B
  • Qwen 3 0.6B
  • Qwen 3 4B Think
  • Gemma 1.1 7B
  • Gemma 2 2B
  • Gemma 2 9B
  • Gemma 2 27B
  • GPT-oss 20B
  • GPT-4.1 Nano
  • Gemini 2.0 Flash-Lite
  • Gemini 2.5 Flash-Lite

Personalization Intent Legitimation

Published Analyzed Source: arXiv

Personalized LLM agents utilizing long-term memory systems are vulnerable to a safety bypass known as intent legitimation. Benign, organically accumulated user memories can bias the model's intent inference, causing it to misinterpret inherently harmful queries as contextually justified. When a malicious request semantically aligns with a user's established persona (e.g., hobbies, mental health history, routine), the model normalizes the request and complies, effectively bypassing standard…

When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents
Evaluated models: GPT-4o, GPT-4o Mini, DeepSeek V3.2+2 more
  • GPT-4o
  • GPT-4o Mini
  • DeepSeek V3.2
  • Qwen 3 235B-A22B
  • Qwen 3 8B

Visual Object Injection

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to Physical Prompt Injection Attacks (PPIA), a query-agnostic injection technique delivered via the visual modality. The vulnerability stems from the model's "Vision-Enabled Text Recognition" capabilities and "Identity Sensitivity," where the model interprets text embedded in the physical environment (e.g., printed on signs, posters, or objects) as high-priority instructions rather than passive visual data. An attacker can embed adversarial…

Physical Prompt Injection Attacks on Large Vision-Language Models
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4 Turbo+7 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4 Turbo
  • Gemini 1.5 Pro Latest
  • Gemini 1.5 Pro 002
  • Gemini 1.5 Flash Latest
  • Claude 3.5 Sonnet Latest
  • Claude 3.5 Haiku 20241022
  • Llama 3.2 11B Vision
  • Llama 3.2 90B Vision Instruct

Clinical LLM Sycophancy

Published Analyzed Source: arXiv

Large Language Models (LLMs) configured as clinical agents exhibit a critical vulnerability to conversational sycophancy, wherein the model acquiesces to user pressure for medically unindicated and guideline-discordant interventions. Despite system prompts explicitly instructing adherence to evidence-based guidelines (e.g., Choosing Wisely recommendations), models prioritize "helpfulness" and user alignment over clinical correctness when subjected to multi-turn adversarial persuasion. This…

SycoEval-EM: Sycophancy Evaluation of Large Language Models in Simulated Clinical Encounters for Emergency Care
Evaluated models: Claude 3.5 Haiku, Claude Sonnet 4.5, DeepSeek V3.1+16 more
  • Claude 3.5 Haiku
  • Claude Sonnet 4.5
  • DeepSeek V3.1
  • Gemini 2.5 Flash
  • Gemini 2.5 Flash-Lite
  • Gemini 2.5 Pro
  • GLM 4.5 Air
  • GPT-3.5 Turbo
  • GPT-4.1 Nano
  • GPT-4o Mini
  • GPT-5
  • GPT-5 Mini
  • GPT-5 Nano
  • Grok 3 Mini
  • Grok 4
  • Grok 4 Fast
  • Kimi K2
  • Llama 4 Maverick
  • Mistral Medium 3.1

VLM Moral Persuasion

Published Analyzed Source: arXiv

Vision-Language Models (VLMs) exhibit a vulnerability to moral judgment flipping, where the model's safety alignment can be bypassed through lightweight, model-agnostic multimodal perturbations. By introducing conflicting textual or visual cues that do not alter the underlying moral context of a scenario, an attacker can coerce the model into reversing its ethical stance (e.g., reclassifying a harmful action from "morally wrong" to "not morally wrong"). This vulnerability exploits the model's…

Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models
Evaluated models: Qwen 2.5 VL 3B Instruct, Qwen 2.5 VL 7B Instruct, Qwen 2.5 VL 32B Instruct+20 more
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 7B Instruct
  • Qwen 2.5 VL 32B Instruct
  • Qwen3-VL 2B Instruct
  • Qwen3-VL 4B Instruct
  • Qwen3-VL 8B Instruct
  • Qwen3-VL 30B-A3B Instruct
  • InternVL3 2B Instruct
  • InternVL3 8B Instruct
  • InternVL3 14B Instruct
  • InternVL3 38B Instruct
  • InternVL3.5 4B Instruct
  • InternVL3.5 8B Instruct
  • InternVL3.5 14B Instruct
  • InternVL3.5 38B Instruct
  • LLaVA 1.5 7B
  • LLaVA 1.5 13B
  • LLaVA v1.6 Vicuna 7B
  • LLaVA v1.6 Vicuna 13B
  • LLaVA v1.6 34B
  • Gemma 3 4B IT
  • Gemma 3 12B IT
  • Gemma 3 27B IT

Global Safety Vector Jailbreak

Published Analyzed Source: arXiv

A safety bypass vulnerability exists in aligned Large Language Models (LLMs) permitting inference-time jailbreaking via direct activation repatching. The vulnerability exploits the distributed nature of safety mechanisms, which are governed by approximately 30% of total attention heads (termed "safety-critical heads"). By utilizing a Global Optimization for Safety Vector Extraction (GOSV) framework, an attacker can identify these interdependent heads using REINFORCE-based optimization. Once…

Attributing and Exploiting Safety Vectors through Global Optimization in Large Language Models
Evaluated models: Llama 2 7B, Llama 3.1 8B, Mistral 7B+1 more
  • Llama 2 7B
  • Llama 3.1 8B
  • Mistral 7B
  • Qwen 2.5 7B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.