Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

42 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

GUI Agent Dark Pattern Blindness

Published Analyzed Source: arXiv

Large Language Model (LLM)-powered GUI agents exhibit a vulnerability to deceptive interface designs (dark patterns) due to goal-driven optimization and procedural myopia. When executing natural language instructions on web interfaces, these agents consistently prioritize minimizing steps and achieving task completion over user safety or privacy. Agents frequently recognize manipulative elements—such as pre-selected consent checkboxes, hidden costs, or trick questions—in their internal…

Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
Evaluated models: GPT-4o, Claude 3.7 Sonnet, DeepSeek V3+1 more
  • GPT-4o
  • Claude 3.7 Sonnet
  • DeepSeek V3
  • Gemini 2.0 Flash

Multimodal Linking Visual Insecurity

Published Analyzed Source: arXiv

Multimodal Entity Linking (MEL) systems, encompassing both traditional dual-encoder models and Multimodal Large Language Models (MLLMs), are vulnerable to gradient-based white-box adversarial attacks. By applying imperceptible perturbations to visual inputs via Projected Gradient Descent (PGD), Auto-PGD (APGD), or Carlini & Wagner (CW) methods, an attacker can manipulate the visual embeddings generated by the model. This manipulation disrupts the cross-modal alignment structure, causing the…

On Evaluating the Adversarial Robustness of Foundation Models for Multimodal Entity Linking
Evaluated models: MiniGPT-4

Physical Patch Driving Hijack

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) employed in autonomous driving (AD) systems are vulnerable to a physically realizable adversarial patch attack dubbed "PhysPatch." This vulnerability exists because MLLMs inherit susceptibility to visual adversarial perturbations from their vision backbones. The attack utilizes a semantic-aware mask initialization strategy combined with a potential field algorithm to identify physically plausible regions for patch placement within a driving scene (e.g…

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems
Evaluated models: LLaVA v1.6 13B, Qwen 2.5 VL 72B Instruct, Llama 3.2 90B Vision Instruct+8 more
  • LLaVA v1.6 13B
  • Qwen 2.5 VL 72B Instruct
  • Llama 3.2 90B Vision Instruct
  • GPT-4o
  • GPT-4.1
  • Claude Sonnet 4
  • Gemini 2.0 Flash
  • Qwen 2.5 VL Max
  • o3
  • Gemini 2.5 Flash
  • QVQ-Plus

Full-Spectrum Diffusion Attack

Published Analyzed Source: arXiv

A targeted adversarial attack vulnerability exists in Multimodal Large Language Models (MLLMs) susceptible to Adversarial-Guided Diffusion (AGD). This technique generates adversarial images by injecting targeted semantic information into the noise component of the reverse-diffusion process within a text-to-image generative model (specifically Stable Diffusion). Unlike traditional pixel-based attacks that introduce high-frequency perturbations easily removed by low-pass filtering, AGD utilizes…

Adversarial-guided diffusion for multimodal llm attacks
Evaluated models: Vicuna 13B

LVLM Vision-Triggered Resource Exhaustion

Published Analyzed Source: arXiv

A resource consumption vulnerability exists in multiple Large Vision-Language Models (LVLMs). An attacker can craft a subtle, imperceptible adversarial perturbation and apply it to an input image. When this image is processed by an LVLM, even with a benign text prompt, it forces the model into an unbounded generation loop. The attack, named RECALLED, uses a gradient-based optimization process to create a visual perturbation that steers the model's text generation towards a predefined…

Resource Consumption Red-Teaming for Large Vision-Language Models
Evaluated models: LLaVA 1.5 7B, LLaVA 1.5 13B, Qwen 2.5 VL 3B Instruct+4 more
  • LLaVA 1.5 7B
  • LLaVA 1.5 13B
  • Qwen 2.5 VL 3B Instruct
  • Qwen 2.5 VL 7B Instruct
  • Qwen 2.5 VL 32B Instruct
  • InstructBLIP Vicuna 7B
  • InstructBLIP Vicuna 13B

JailFlip Implicit Harm

Published Analyzed Source: arXiv

A vulnerability exists in the safety alignment mechanisms of Large Language Models (LLMs) (including GPT-4, Claude 3, Gemini, and Qwen families) leading to "Implicit Harm." Unlike traditional jailbreaks that use overtly harmful queries, this vulnerability allows remote attackers to coerce the model into providing factually incorrect, plausible, and dangerous responses to benign-looking inputs. By employing "JailFlip" techniques—specifically constructed affirmative-type or denial-type queries…

Beyond Jailbreaks: Revealing Stealthier and Broader LLM Security Risks Stemming from Alignment Failures
Evaluated models: GPT-4.1, GPT-4.1 Mini, GPT-4o+3 more
  • GPT-4.1
  • GPT-4.1 Mini
  • GPT-4o
  • GPT-4o Mini
  • Qwen Plus
  • Qwen Turbo

VLM Navigation Object Fusion

Published Analyzed Source: arXiv

The Vision-Language Model (VLM) perception module in Vision-and-Language Navigation (VLN) agents is vulnerable to adversarial 3D object injection via the Adversarial Object Fusion (AdvOF) framework. An attacker can generate physically plausible 3D objects with adversarial perturbations capable of deceiving the agent's VLM across multiple viewing angles and distances. The vulnerability exists due to a misalignment between 3D physical manipulations and the agent's 2D image perception, combined…

Disrupting Vision-Language Model-Driven Navigation Services via Adversarial Object Fusion
Evaluated models: Not reported

Hybrid Agent Prompt Injection

Published Analyzed Source: arXiv

Computer-Use Agents (CUAs) powered by Large Language Models (LLMs) operating in hybrid Web-OS environments are vulnerable to indirect prompt injection. Attackers can embed malicious natural language or code instructions within legitimate web content (e.g., social media forums, chat applications, shared cloud documents) that the agent processes during benign task execution. Due to the agent's inability to distinguish between trusted user instructions and untrusted environmental data, the CUA…

RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
Evaluated models: Claude 3.5 Sonnet, Claude 3.7 Sonnet, GPT-4o

On-Device LLM Hijacking

Published Analyzed Source: arXiv

Mobile LLM agents utilizing vision-based screen perception (OCR or Multimodal Large Language Models) are vulnerable to Visual Prompt Injection via malicious GUI overlays. An attacker holding the SYSTEM_ALERT_WINDOW permission can deploy non-focusable floating windows (using FLAG_NOT_FOCUSABLE) containing adversarial text or fabricated UI elements over legitimate applications. Because the agent captures the entire screen buffer to interpret the device state, it ingests the adversarial overlay…

From Assistants to Adversaries: Exploring the Security Risks of Mobile LLM Agents
Evaluated models: GPT-4o

Flowchart-based LVLM Jailbreak Attack

Published Analyzed Source: arXiv

FC-Attack leverages automatically generated flowcharts containing step-by-step descriptions derived or rephrased from harmful queries, combined with a benign textual prompt, to jailbreak Large Vision-Language Models (LVLMs). The vulnerability lies in the model's susceptibility to visual prompts containing harmful information within the flowcharts, thus bypassing safety alignment mechanisms.

FC-Attack: Jailbreaking Large Vision-Language Models via Auto-Generated Flowcharts
Evaluated models: Claude 3.5 Sonnet 20240620, Gemini 1.5 Flash, GPT-4o 2024-08-06+4 more
  • Claude 3.5 Sonnet 20240620
  • Gemini 1.5 Flash
  • GPT-4o 2024-08-06
  • GPT-4o Mini 2024-07-18
  • InternVL2.5 8B
  • LLaVA NeXT 8B
  • Qwen2-VL 7B Instruct

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.