Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

670 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

VLM Moral Persuasion

Published Analyzed Source: arXiv

Vision-Language Models (VLMs) exhibit a vulnerability to moral judgment flipping, where the model's safety alignment can be bypassed through lightweight, model-agnostic multimodal perturbations. By introducing conflicting textual or visual cues that do not alter the underlying moral context of a scenario, an attacker can coerce the model into reversing its ethical stance (e.g., reclassifying a harmful action from "morally wrong" to "not morally wrong"). This vulnerability exploits the model's…

Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models
Evaluated models: Qwen 2.5 VL 3B Instruct, Qwen 2.5 VL 7B Instruct, Qwen 2.5 VL 32B Instruct+20 more
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 7B Instruct
  • Qwen 2.5 VL 32B Instruct
  • Qwen3-VL 2B Instruct
  • Qwen3-VL 4B Instruct
  • Qwen3-VL 8B Instruct
  • Qwen3-VL 30B-A3B Instruct
  • InternVL3 2B Instruct
  • InternVL3 8B Instruct
  • InternVL3 14B Instruct
  • InternVL3 38B Instruct
  • InternVL3.5 4B Instruct
  • InternVL3.5 8B Instruct
  • InternVL3.5 14B Instruct
  • InternVL3.5 38B Instruct
  • LLaVA 1.5 7B
  • LLaVA 1.5 13B
  • LLaVA v1.6 Vicuna 7B
  • LLaVA v1.6 Vicuna 13B
  • LLaVA v1.6 34B
  • Gemma 3 4B IT
  • Gemma 3 12B IT
  • Gemma 3 27B IT

Global Safety Vector Jailbreak

Published Analyzed Source: arXiv

A safety bypass vulnerability exists in aligned Large Language Models (LLMs) permitting inference-time jailbreaking via direct activation repatching. The vulnerability exploits the distributed nature of safety mechanisms, which are governed by approximately 30% of total attention heads (termed "safety-critical heads"). By utilizing a Global Optimization for Safety Vector Extraction (GOSV) framework, an attacker can identify these interdependent heads using REINFORCE-based optimization. Once…

Attributing and Exploiting Safety Vectors through Global Optimization in Large Language Models
Evaluated models: Llama 2 7B, Llama 3.1 8B, Mistral 7B+1 more
  • Llama 2 7B
  • Llama 3.1 8B
  • Mistral 7B
  • Qwen 2.5 7B

Semantic-Agnostic Multimodal Image Jailbreak

Published Analyzed Source: arXiv

The paper describes a specific black-box jailbreak evaluation, BVS, in which fragmented visual content is mixed with neutral imagery and paired with reconstruction-oriented text so harmful intent is only recomposed during multimodal reasoning. The authors report that this can bypass input and output safety assumptions in image-generating MLLMs. A safe defensive reproduction should use synthetic, non-harmful stand-ins for prohibited concepts, test whether fragmented cross-modal inputs are…

Beyond Visual Safety: Jailbreaking Multimodal Large Language Models for Harmful Image Generation via Semantic-Agnostic Inputs
Evaluated models: GPT-5, Gemini 1.5 Flash

Activation-Level Privacy Leak

Published Analyzed Source: arXiv

Conversational Large Language Model (LLM) agents integrated with privileged data sources (e.g., medical records, organizational emails) are vulnerable to contextually inappropriate information disclosure due to failures in enforcing Contextual Integrity (CI) norms. Standard semantic input/output filters and generic safety guardrails (e.g., Llama Guard) fail to detect "mosaic attacks" and multi-turn conversational manipulation. In these attacks, adversaries decompose a malicious query into a…

NeuroFilter: Privacy Guardrails for Conversational LLM Agents
Evaluated models: GPT-oss 20B, Llama 3.3 70B Instruct, Qwen 2.5 7B+3 more
  • GPT-oss 20B
  • Llama 3.3 70B Instruct
  • Qwen 2.5 7B
  • Qwen 2.5 14B
  • Qwen 2.5 32B Instruct
  • Qwen 2.5 72B

LLM Virtual Criminal Agents

Published Analyzed Source: arXiv

A vulnerability exists in the safety alignment of state-of-the-art Large Language Models (LLMs) when deployed as autonomous agents in dynamic, interactive environments. While current safety guardrails effectively block static, single-turn harmful queries, they fail to prevent multi-step emergent criminal behavior in agentic loops. When situated in an open-ended sandbox simulation (such as the VirtualCrime framework), these LLMs successfully bypass alignment to proactively plan, coordinate, and…

VirtualCrime: Evaluating Criminal Potential of Large Language Models via Sandbox Simulation
Evaluated models: GPT-4.1 2025-04-14, GPT-5 Chat 2025-10-03, Claude Haiku 4.5 20251001+5 more
  • GPT-4.1 2025-04-14
  • GPT-5 Chat 2025-10-03
  • Claude Haiku 4.5 20251001
  • Claude Sonnet 4.5 20250929
  • Gemini 2.5 Pro
  • DeepSeek R1 0528
  • Doubao 1.6 Thinking 250715
  • Qwen 3 Max

MLLM Over-Reasoning Safety Risk

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) exhibit a vulnerability to "Reasoning-based Multi-Image Attacks," where safety guardrails are bypassed by distributing harmful intent across multiple images (2–4 inputs). Unlike single-image jailbreaks that rely on visual obfuscation, this vulnerability exploits the model's reasoning capabilities. By presenting images that share a specific relationship (e.g., Temporal Jump, Spatial Juxtaposition, or Causality), an attacker can compel the model to infer…

The Side Effects of Being Smart: Safety Risks in MLLMs' Multi-Image Reasoning
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+11 more
  • GPT-4o
  • GPT-4o Mini
  • Gemini 1.5 Pro
  • Gemini 1.5 Flash
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 32B Instruct
  • LLaVA 1.5 7B
  • Llama 3 LLaVA-NeXT 8B
  • InternVL3 8B
  • InternVL3 38B
  • InternVL3 78B
  • MiniCPM-o 2.6
  • Skywork-R1V3 38B
  • GLM-4.1V 9B Thinking

Metacognitive Prompting Lowers Resistance

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to multi-turn persuasive conversational attacks that induce the adoption of counterfactual beliefs. By leveraging the Source–Message–Channel–Receiver (SMCR) communication framework, attackers can systematically erode a model's confidence in established facts and compel the model to output misinformation. Specific attack vectors include manipulating source attribution (authority framing), message content (logical, credibility, or emotional appeals)…

Vulnerability of LLMs' Belief Systems? LLMs Belief Resistance Check Through Strategic Persuasive Conversation Interventions
Evaluated models: GPT-4o, Llama 3.2 3B, Llama 3.3 70B+2 more
  • GPT-4o
  • Llama 3.2 3B
  • Llama 3.3 70B
  • Mistral 7B
  • Qwen 2.5 7B

Self-Evolving Red-Team Agents

Published Analyzed Source: arXiv

A vulnerability in the safety alignment of several major Large Language Models (LLMs) allows attackers to bypass content filters using complex, automatically generated adversarial prompts. Discovered via the AgenticRed evolutionary framework, the flaw is exploited by wrapping malicious intents in structured formats (such as strict JSON output contracts), combined with prefix injection and refusal suppression. By explicitly commanding the model to begin its response with a compliant prefix and…

AgenticRed: Evolving Agentic Systems for Red-Teaming
Evaluated models: GPT-3.5 Turbo, GPT-4o, GPT-5.1+9 more
  • GPT-3.5 Turbo
  • GPT-4o
  • GPT-5.1
  • GPT-5.2
  • Claude 3.5 Sonnet
  • Claude Haiku 4.5
  • DeepSeek R1
  • DeepSeek V3.2
  • Qwen 3 Max
  • Qwen 3 8B
  • Llama 2 7B
  • Llama 3 8B

Drunk Language Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in aligned Large Language Models (LLMs) where inducing "drunk language" behavior—simulating the text of an intoxicated human—bypasses safety guardrails and contextual privacy protections. Attackers can exploit this anthropomorphic flaw through inference-time persona prompting or lightweight post-training (causal fine-tuning or reinforcement learning on drunk text corpora). By forcing the model to adopt a stylistic and semantic framework associated with impaired human…

In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement
Evaluated models: GPT-3.5, GPT-4, GPT-4o+3 more
  • GPT-3.5
  • GPT-4
  • GPT-4o
  • Llama 2 7B
  • Llama 3 8B
  • Mistral 7B

MLLM Chart Deception

Published Analyzed Source: arXiv

Code-generation Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) are vulnerable to directed misuse for the generation of misleading data visualizations. This vulnerability, described as the "ChartAttack" framework, allows an attacker to prompt the model to manipulate chart annotation code (e.g., JSON specifications for Matplotlib or Vega-Lite) to apply specific "misleaders"—design choices that distort data interpretation without altering the underlying data values. By…

ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Evaluated models: Qwen 2.5 14B, LLaVA 7B, Phi-3

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.