Skip to main content
LLM Security Database
Skip to research search
Last analyzed 9/9/2026

Language Model Security Database

985 research findings · 1123 evaluated models

Filtered research findings

131 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Published 9/1/2025
Analyzed 12/9/2025

Large Language Model (LLM)-powered GUI agents exhibit a vulnerability to deceptive interface designs (dark patterns) due to goal-driven optimization and procedural myopia. When executing natural language instructions on web interfaces, these agents consistently prioritize minimizing steps and achieving task completion over user safety or privacy. Agents frequently recognize manipulative elements—such as pre-selected consent checkboxes, hidden costs, or trick questions—in their internal…

Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
Evaluated models: GPT-4o, Claude 3.7 Sonnet, DeepSeek V3 +1 more

Source: arXiv

Published 9/1/2025
Analyzed 12/30/2025

Large Language Models (LLMs), including proprietary and open-weight state-of-the-art systems, are vulnerable to automated, self-evolving adversarial attacks orchestrated by multi-agent frameworks. The vulnerability exists because current safety alignment strategies (RLHF, static safety filters) fail to generalize against the "SafeEvalAgent" attack vector. In this vector, an "Analyst" agent analyzes model refusals to iteratively refine attack strategies, while a "Specialist" agent grounds these…

SafeEvalAgent: Toward Agentic and Self-Evolving Safety Evaluation of LLMs
Evaluated models: GPT-5, GPT-5 Chat Latest, Gemini 2.5 Pro +7 more

Source: arXiv

Published 9/1/2025
Analyzed 12/9/2025

Large Language Models (LLMs), including GPT-4o, LLaMA-3, and GPT-3.5-Turbo, are vulnerable to multimodal prompt injection attacks. These models fail to distinguish between system-level instructions and user-provided content within the context window. Attackers can exploit this by embedding malicious instructions in direct text, indirect sources (such as third-party webpages or PDFs), or visual inputs (images). Successful exploitation results in the model prioritizing the injected adversarial…

Multimodal Prompt Injection Attacks: Risks and Defenses for Modern LLMs
Evaluated models: GPT-3.5, GPT-4o, Llama 3 8B +1 more

Source: arXiv

Published 9/1/2025
Analyzed 1/14/2026

AdvEDM reveals a vulnerability in Vision-Language Model (VLM) based Embodied Decision-Making (EDM) systems, such as those used in autonomous driving and robotic manipulation. The vulnerability allows an attacker to launch fine-grained adversarial attacks that selectively modify the perception of specific objects in an input image—either by removing them (Semantic Removal) or adding them (Semantic Addition)—while preserving the semantic integrity of the rest of the scene.

AdvEDM: Fine-grained Adversarial Attack against VLM-based Embodied Agents
Evaluated models: BLIP-2, MiniGPT-4, LLaVA-v2 +5 more

Source: arXiv

Published 9/1/2025
Analyzed 12/8/2025

A vulnerability exists in Vision-Language Models (VLMs) that allows for the bypass of safety alignment mechanisms through loss-guided adversarial image perturbations. This attack, known as JaiLIP, operates entirely in the image space, requiring no textual prompt manipulation. The vulnerability is exploited by optimizing an adversarial image using a joint objective function that minimizes the Mean Squared Error (MSE) between the clean and perturbed image while maximizing the model's loss for…

JaiLIP: Jailbreaking Vision-Language Models via Loss Guided Image Perturbation
Evaluated models: GPT-4, InstructBLIP, Vicuna 13B

Source: arXiv

Published 8/1/2025
Analyzed 12/8/2025

Large Language Models (LLMs) and Vision-Language Models (VLMs) are vulnerable to an automated, adaptive role-play jailbreak attack known as GUARD (Guideline Upholding Test through Adaptive Role-play and Jailbreak Diagnostics). The vulnerability exists because the models fail to recognize malicious intent when harmful queries are embedded within complex, iteratively optimized "playing scenarios."

GUARD: Guideline Upholding Test through Adaptive Role-play and Jailbreak Diagnostics for LLMs
Evaluated models: Vicuna 13B, LongChat 7B, Llama 2 7B +5 more

Source: arXiv

Published 8/1/2025
Analyzed 12/8/2025

Multimodal Large Language Models (MLLMs) are vulnerable to a jailbreak attack strategy known as Balanced Structural Decomposition (BSD). This vulnerability exploits a structural trade-off in safety alignment where models fail to detect malicious intent when the input balances semantic relevance ("On-Topicness") with distributional novelty ("OOD-Intensity"). The attack functions by recursively decomposing a harmful text objective into a tree of sub-tasks using an "Explore" (diversity) and…

Towards Effective MLLM Jailbreaking Through Balanced On-Topicness and OOD-Intensity
Evaluated models: GPT-4o, GPT-4o Mini, GPT-4.1 +10 more

Source: arXiv

Published 8/1/2025
Analyzed 12/9/2025

Multimodal Entity Linking (MEL) systems, encompassing both traditional dual-encoder models and Multimodal Large Language Models (MLLMs), are vulnerable to gradient-based white-box adversarial attacks. By applying imperceptible perturbations to visual inputs via Projected Gradient Descent (PGD), Auto-PGD (APGD), or Carlini & Wagner (CW) methods, an attacker can manipulate the visual embeddings generated by the model. This manipulation disrupts the cross-modal alignment structure, causing the…

On Evaluating the Adversarial Robustness of Foundation Models for Multimodal Entity Linking
Evaluated models: MiniGPT-4

Source: arXiv

Published 8/1/2025
Analyzed 12/9/2025

Multimodal Large Language Models (MLLMs) employed in autonomous driving (AD) systems are vulnerable to a physically realizable adversarial patch attack dubbed "PhysPatch." This vulnerability exists because MLLMs inherit susceptibility to visual adversarial perturbations from their vision backbones. The attack utilizes a semantic-aware mask initialization strategy combined with a potential field algorithm to identify physically plausible regions for patch placement within a driving scene (e.g…

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems
Evaluated models: LLaVA v1.6 13B, Qwen 2.5 VL 72B Instruct, Llama 3.2 90B Vision Instruct +8 more

Source: arXiv

Published 8/1/2025
Analyzed 12/30/2025

A vulnerability exists in the fine-tuning lifecycle of Vision-Language Models (VLMs) derived from open-source base models, termed the "grey-box threat." Adversaries with white-box access to a public base model (e.g., Qwen2-VL) can generate universal adversarial images that successfully bypass safety guardrails in proprietary, fine-tuned downstream variants. This is achieved via the Simulated Ensemble Attack (SEA), which combines two techniques: Fine-tuning Trajectory Simulation (FTS), where…

Simulated Ensemble Attack: Transferring Jailbreaks Across Fine-tuned Vision-Language Models
Evaluated models: Qwen 2 2B

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.