Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

126 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Universal MLLM Target Matching

Published Analyzed Source: arXiv

Closed-source Multi-modal Large Language Models (MLLMs) are vulnerable to Universal Targeted Transferable Adversarial Attacks (UTTAA). An attacker can generate a single, image-agnostic adversarial perturbation ($\delta$) that, when added to any arbitrary source image, steers the victim model to output a description or classification matching a specific target image chosen by the attacker. This vulnerability exploits the transferability of adversarial features from open-source surrogate vision…

Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimization
Evaluated models: GPT-4o, Claude Sonnet 4.5, GPT-5+2 more
  • GPT-4o
  • Claude Sonnet 4.5
  • GPT-5
  • GPT-5.2
  • Claude Opus 4.5

Adaptive Multimodal Reasoning Jailbreaks

Published Analyzed Source: arXiv

The paper reports a black-box jailbreak evaluation in which a ReAct-style loop adaptively rewrites unsafe text prompts and selectively applies blur, DCT filtering, or recoloring to image regions identified as safety-sensitive. The combined cross-modal strategy is intended to make harmful image-text requests appear less objectionable to a vision-language model while preserving enough semantics to elicit an answer. This is a specific, security-relevant evaluation, although the reported results…

Jailbreaks on Vision Language Model via Multimodal Reasoning
Evaluated models: Gemini 2.0 Flash

Visual Object Injection

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to Physical Prompt Injection Attacks (PPIA), a query-agnostic injection technique delivered via the visual modality. The vulnerability stems from the model's "Vision-Enabled Text Recognition" capabilities and "Identity Sensitivity," where the model interprets text embedded in the physical environment (e.g., printed on signs, posters, or objects) as high-priority instructions rather than passive visual data. An attacker can embed adversarial…

Physical Prompt Injection Attacks on Large Vision-Language Models
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4 Turbo+7 more
  • GPT-4o
  • GPT-4o Mini
  • GPT-4 Turbo
  • Gemini 1.5 Pro Latest
  • Gemini 1.5 Pro 002
  • Gemini 1.5 Flash Latest
  • Claude 3.5 Sonnet Latest
  • Claude 3.5 Haiku 20241022
  • Llama 3.2 11B Vision
  • Llama 3.2 90B Vision Instruct

VLM Moral Persuasion

Published Analyzed Source: arXiv

Vision-Language Models (VLMs) exhibit a vulnerability to moral judgment flipping, where the model's safety alignment can be bypassed through lightweight, model-agnostic multimodal perturbations. By introducing conflicting textual or visual cues that do not alter the underlying moral context of a scenario, an attacker can coerce the model into reversing its ethical stance (e.g., reclassifying a harmful action from "morally wrong" to "not morally wrong"). This vulnerability exploits the model's…

Do VLMs Have a Moral Backbone? A Study on the Fragile Morality of Vision-Language Models
Evaluated models: Qwen 2.5 VL 3B Instruct, Qwen 2.5 VL 7B Instruct, Qwen 2.5 VL 32B Instruct+20 more
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 7B Instruct
  • Qwen 2.5 VL 32B Instruct
  • Qwen3-VL 2B Instruct
  • Qwen3-VL 4B Instruct
  • Qwen3-VL 8B Instruct
  • Qwen3-VL 30B-A3B Instruct
  • InternVL3 2B Instruct
  • InternVL3 8B Instruct
  • InternVL3 14B Instruct
  • InternVL3 38B Instruct
  • InternVL3.5 4B Instruct
  • InternVL3.5 8B Instruct
  • InternVL3.5 14B Instruct
  • InternVL3.5 38B Instruct
  • LLaVA 1.5 7B
  • LLaVA 1.5 13B
  • LLaVA v1.6 Vicuna 7B
  • LLaVA v1.6 Vicuna 13B
  • LLaVA v1.6 34B
  • Gemma 3 4B IT
  • Gemma 3 12B IT
  • Gemma 3 27B IT

Semantic-Agnostic Multimodal Image Jailbreak

Published Analyzed Source: arXiv

The paper describes a specific black-box jailbreak evaluation, BVS, in which fragmented visual content is mixed with neutral imagery and paired with reconstruction-oriented text so harmful intent is only recomposed during multimodal reasoning. The authors report that this can bypass input and output safety assumptions in image-generating MLLMs. A safe defensive reproduction should use synthetic, non-harmful stand-ins for prohibited concepts, test whether fragmented cross-modal inputs are…

Beyond Visual Safety: Jailbreaking Multimodal Large Language Models for Harmful Image Generation via Semantic-Agnostic Inputs
Evaluated models: GPT-5, Gemini 1.5 Flash

MLLM Over-Reasoning Safety Risk

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) exhibit a vulnerability to "Reasoning-based Multi-Image Attacks," where safety guardrails are bypassed by distributing harmful intent across multiple images (2–4 inputs). Unlike single-image jailbreaks that rely on visual obfuscation, this vulnerability exploits the model's reasoning capabilities. By presenting images that share a specific relationship (e.g., Temporal Jump, Spatial Juxtaposition, or Causality), an attacker can compel the model to infer…

The Side Effects of Being Smart: Safety Risks in MLLMs' Multi-Image Reasoning
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+11 more
  • GPT-4o
  • GPT-4o Mini
  • Gemini 1.5 Pro
  • Gemini 1.5 Flash
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 32B Instruct
  • LLaVA 1.5 7B
  • Llama 3 LLaVA-NeXT 8B
  • InternVL3 8B
  • InternVL3 38B
  • InternVL3 78B
  • MiniCPM-o 2.6
  • Skywork-R1V3 38B
  • GLM-4.1V 9B Thinking

MLLM Chart Deception

Published Analyzed Source: arXiv

Code-generation Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) are vulnerable to directed misuse for the generation of misleading data visualizations. This vulnerability, described as the "ChartAttack" framework, allows an attacker to prompt the model to manipulate chart annotation code (e.g., JSON specifications for Matplotlib or Vega-Lite) to apply specific "misleaders"—design choices that distort data interpretation without altering the underlying data values. By…

ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Evaluated models: Qwen 2.5 14B, LLaVA 7B, Phi-3

Macaronic T2I Jailbreak

Published Analyzed Source: arXiv

Text-to-Image (T2I) models and their associated safety filters are vulnerable to MacPrompt, a black-box jailbreak technique that exploits cross-lingual embedding alignments. Attackers can bypass input text filters, latent representation filters, and model-level concept removal defenses by replacing sensitive keywords with "macaronic" substitutes. These substitutes are constructed by extracting and recombining character-level substrings from translations of the target word across multiple…

MacPrompt: Maraconic-guided Jailbreak against Text-to-Image Models
Evaluated models: DALL-E, Stable Diffusion

Point Cloud Adversarial Attack

Published Analyzed Source: arXiv

Point-based 3D Vision-Language Models (VLMs), specifically PointLLM and GPT4Point, are vulnerable to white-box, gradient-based adversarial attacks. The vulnerability exists in the model's processing of 3D point cloud data, where an attacker can optimize imperceptible geometric perturbations ($\delta$) on the input point cloud ($x$) to manipulate the model's textual output. The paper identifies two specific attack vectors: 1. Vision Attack: Directly perturbs the high-dimensional visual token…

On the Adversarial Robustness of 3D Large Vision-Language Models
Evaluated models: Vicuna 7B

Distal Translation Jailbreak

Published Analyzed Source: arXiv

A vulnerability in the prompt-side safety filters of GPT-based Text-to-Image (T2I) systems allows attackers to bypass restrictions on Politically Sensitive Content (PSC). By utilizing a technique called Identity-Preserving Descriptive Mapping (IPDM) combined with Geopolitically Distal Translation, an attacker can obfuscate explicit political entities into neutral descriptive phrases translated across multiple low-resource languages. This induces semantic fragmentation, preventing the safety…

: Politically Controversial Content Generation via Jailbreaking Attacks on GPT-based Text-to-Image Models
Evaluated models: GPT-4o, GPT-5, GPT-5.1+2 more
  • GPT-4o
  • GPT-5
  • GPT-5.1
  • DALL-E
  • Midjourney

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.