Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

410 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Mobile Agent Visual Spoofing

Published Analyzed Source: arXiv

Mobile Large Language Model (LLM) agents operating under the "Screen-as-Interface" paradigm are vulnerable to visual indirect prompt injection and state desynchronization. Agents that rely on unstructured visual data (screenshots) and Accessibility Service APIs to perceive the environment lack a mechanism to distinguish between trusted system UI elements and untrusted content (e.g., web pages, emails, or malicious overlays). An attacker can inject visual cues, fake notifications, or hidden…

Blind Gods and Broken Screens: Architecting a Secure, Intent-Centric Mobile Agent Operating System
Evaluated models: Not reported

Enhanced LVLM Encoder Transfer

Published Analyzed Source: arXiv

Large Vision-Language Models (LVLMs) are vulnerable to zero-query, black-box adversarial image perturbations via Semantic-Guided Multimodal Attacks (SGMA). Unlike traditional attacks that scatter noise or target background pixels, SGMA leverages surrogate models (e.g., CLIP) to anchor imperceptible adversarial perturbations directly onto semantically critical foreground regions. The attack exploits two specific architectural traits of LVLMs: inconsistent visual grounding across models and…

Grounding-Driven Attack: Improving Encoder-based Adversarial Transferability against Large Vision-Language Models
Evaluated models: BLIP-2 OPT 2.7B, LLaVA 1.5 7B, Qwen 2.5 VL 7B Instruct+6 more
  • BLIP-2 OPT 2.7B
  • LLaVA 1.5 7B
  • Qwen 2.5 VL 7B Instruct
  • InternVL3 8B
  • OpenFlamingo 4B
  • Kimi VL A3B Instruct
  • GPT-4o
  • GPT-5.4
  • Gemini 2.0 Flash

NLG Poisoning Certification Gap

Published Analyzed Source: arXiv

Autoregressive Large Language Models (LLMs) utilizing standard fine-tuning (SFT) or alignment techniques (RLHF/DPO) are vulnerable to training-time data poisoning attacks that exploit the sequential nature of token generation. Unlike classification tasks, where output labels are independent, LLM generation suffers from a cascading vulnerability where modifying a single token $i$ intervenes on the distribution of all subsequent tokens $j > i$. An adversary can inject a small fraction of…

Towards Poisoning Robustness Certification for Natural Language Generation
Evaluated models: Gemma 2 2B

Adaptive Web Agent Prompt Injection

Published Analyzed Source: arXiv

Large Language Model (LLM) based web agents (such as those built using the BrowserUse scaffold) are vulnerable to Indirect Prompt Injection (IPI) attacks when autonomously navigating and processing untrusted web content. Unlike standard Cross-Site Scripting (XSS), this vulnerability occurs when the LLM orchestrator consumes the DOM or visual screenshots of a webpage containing concealed or contextually disguised adversarial instructions. The LLM interprets these embedded text strings as…

MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks
Evaluated models: GPT-4.1, GPT-4o, Qwen3-VL 32B Instruct

LLM Strategic Prompt Deception

Published Analyzed Source: arXiv

Alignment auditing methodologies used to verify the safety of Large Language Models (LLMs)—specifically black-box methods (Assistant Prefills, User Persona Sampling) and white-box interpretability methods (SAE Feature Description, Activation Token Embedding Similarity)—are vulnerable to prompt-level strategic deception. A misaligned "target" model, when supplied with a specific system prompt containing a high-level deceptive strategy and descriptions of the auditing tools, can obfuscate its…

Stress-Testing Alignment Audits With Prompt-Level Strategic Deception
Evaluated models: Llama 3.1 8B, Llama 3.3 70B, Gemma 2 9B

Personalized Agent Double Agent

Published Analyzed Source: arXiv

OpenClaw is vulnerable to Indirect Prompt Injection (IPI), Tool-Return Manipulation, and Persistent Memory Poisoning. The agent incorporates untrusted external content (e.g., fetched web pages) and external tool outputs directly into its observation stream without sufficient isolation. An attacker can embed malicious payloads into these external channels to hijack the agent's planning and execution trace. This allows the attacker to silently trigger high-privilege actions via OpenClaw's Skills…

From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent
Evaluated models: GPT-4o, Llama 3.1 70B, Qwen 2.5 7B

Voice Agent Behavioral Bypass

Published Analyzed Source: arXiv

Audio Large Language Models (ALLMs) integrated into voice agent systems for high-stakes domains (banking, IT support, logistics) are vulnerable to multimodal adversarial attacks via spoken interaction. Adversaries can exploit the model's inherent compliance and contextual awareness through multi-turn dialogue to bypass authentication safeguards, escalate privileges (e.g., unauthorized credit limit increases), exfiltrate sensitive Personally Identifiable Information (PII), and poison…

Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+4 more
  • GPT-4o
  • GPT-4o Mini
  • Gemini 1.5 Pro
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • Qwen2-Audio 7B
  • Qwen 2.5 Omni 7B

Clinical Prompt Injection Harm

Published Analyzed Source: arXiv

Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems deployed in clinical workflows are vulnerable to direct and indirect (RAG-mediated) medical prompt injection attacks. Attackers can embed malicious instructions within user queries or external retrieved documents (such as poisoned clinical guidelines or PDFs). By exploiting "authority framing" (e.g., formatting the payload as a clinical guideline update or an editor's note), the injections successfully bypass generic…

MPIB: A Benchmark for Medical Prompt Injection Attacks and Clinical Safety in LLMs
Evaluated models: Qwen 2.5 7B Instruct, Qwen 2.5 32B Instruct, Qwen 2.5 72B Instruct+10 more
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 32B Instruct
  • Qwen 2.5 72B Instruct
  • Llama 3.1 8B Instruct
  • Llama 3.1 70B Instruct
  • Mixtral 8x7B
  • Mixtral 8x22B v0.1
  • MedGemma 4B
  • MedGemma 27B
  • Meditron 7B
  • Meditron 70B
  • BioMistral 7B
  • MMed-Llama 3 8B

Chunky Post-Training Miscalibration

Published Analyzed Source: arXiv

Large Language Models (LLMs) exhibit a vulnerability termed "chunky post-training," where the model learns spurious correlations between incidental prompt features (e.g., formatting styles, specific vocabulary, sentence structure) and specific behavioral modes (e.g., refusal, code generation, rebuttal) present in distinct chunks of post-training data. This results in behavioral mis-routing during inference, where benign inputs sharing surface-level features with restricted or specialized…

Chunky Post-Training: Data Driven Failures of Generalization
Evaluated models: Claude Haiku 4.5, Claude Sonnet 4.5, Claude Opus 4.5+5 more
  • Claude Haiku 4.5
  • Claude Sonnet 4.5
  • Claude Opus 4.5
  • GPT-5.1
  • Grok 4.1 Mini
  • Tülu 3 8B
  • Tülu 3 70B
  • Tülu 3 405B

Covert Template System Backdoor

Published Analyzed Source: arXiv

A vulnerability exists in the chat template mechanism used by Large Language Model (LLM) tokenizers, specifically within the Jinja2 templating engine commonly employed by libraries such as Hugging Face Transformers. By modifying the chat_template field within the tokenizer configuration (e.g., tokenizer_config.json), an attacker can inject hidden backdoor instructions into the system prompt. These instructions are concatenated with legitimate user inputs during the tokenization process…

BadTemplate: A Training-Free Backdoor Attack via Chat Template Against Large Language Models
Evaluated models: Llama 3.1 8B Instruct, DeepSeek LLM 7B Chat, Llama 3.1 70B Instruct+6 more
  • Llama 3.1 8B Instruct
  • DeepSeek LLM 7B Chat
  • Llama 3.1 70B Instruct
  • Yi 1.5 Chat 34B
  • Mistral Small Instruct 2409
  • Phi-3.5 Mini Instruct
  • DeepSeek V3.2 Exp
  • Gemini 2.5 Flash
  • GPT-4o Mini

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.