Skip to main content
LLM Security Database
Skip to research search
Updated 7/21/2026, database is current

Language Model Security Database

959 research findings · 1077 evaluated models

Filtered research findings

556 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Updated 2/21/2026

A vulnerability exists in the safety alignment process of Mixture-of-Experts (MoE) Large Language Models (LLMs) when subjected to standard full-parameter fine-tuning. The vulnerability, identified as an "alignment shortcut," occurs when the model minimizes safety loss by modifying routing mechanisms to avoid activating unsafe experts, rather than updating the parameters of the experts responsible for generating harmful content. Consequently, unsafe representations remain latent within the…

RASA: Routing-Aware Safety Alignment for Mixture-of-Experts Models
Affects: Qwen 3 30B-A3B, OLMoE 1B-7B-0125 Instruct

Source: arXiv

Mobile Large Language Model (LLM) agents operating under the "Screen-as-Interface" paradigm are vulnerable to visual indirect prompt injection and state desynchronization. Agents that rely on unstructured visual data (screenshots) and Accessibility Service APIs to perceive the environment lack a mechanism to distinguish between trusted system UI elements and untrusted content (e.g., web pages, emails, or malicious overlays). An attacker can inject visual cues, fake notifications, or hidden…

Blind Gods and Broken Screens: Architecting a Secure, Intent-Centric Mobile Agent Operating System

Source: arXiv

LLM-based Code Interpreter Agents, including OpenInterpreter and OpenCodeInterpreter, are vulnerable to sandbox evasion and arbitrary code execution via Natural Language Disguise and Contextual Channel Injection. Attackers can bypass Abstract Syntax Tree (AST) static analysis and explicit input guardrails by transforming malicious code logic into descriptive natural language instructions (Code Descriptions), which successfully evade syntax-layer blocks. Additionally, attackers can bypass input…

CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agents
Affects: GPT-3.5, GPT-4o, GPT-5

Source: arXiv

Frontier Large Language Models (LLMs) contain a safeguard bypass vulnerability where safety filters fail to reliably block requests for dual-use, in silico biology tasks. This allows novice users with no specialized training to access restricted, expert-level biological protocols (e.g., virology troubleshooting, pathogen capabilities, novel biological agent construction). The models' safety mechanisms fail to trigger or are trivially bypassed under realistic extended interaction conditions…

LLM Novice Uplift on Dual-Use, In Silico Biology Tasks
Affects: o4-mini, o3, Gemini 2.5 Pro +2 more

Source: arXiv

Large Vision-Language Models (LVLMs) possessing Optical Character Recognition (OCR) capabilities are vulnerable to a "Text Distraction Jailbreaking" (Text-DJ) attack. The vulnerability exploits a gap between the model's visual text extraction and its safety alignment mechanisms. By converting a decomposed harmful textual query into images and embedding these images within a grid of semantically irrelevant "distraction" text images, an attacker can bypass safety filters. The model's OCR…

Text is All You Need for Vision-Language Model Jailbreaking
Affects: GPT-4o Mini, GPT-4.1 Mini, Gemini 2.5 Flash +3 more

Source: arXiv

Large Language Models (LLMs) are vulnerable to safety alignment bypasses via classical and obscure language contexts, most notably Classical Chinese, Latin, and Sanskrit. This vulnerability stems from a "High Capability-Low Alignment" distribution shift: models possess sophisticated semantic comprehension of historical languages due to extensive pre-training on historical archives and literature, but lack corresponding safety guardrails which are predominantly optimized for modern languages…

Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Search
Affects: Gemini 2.5 Flash, Claude 3.7 Sonnet, GPT-4o +3 more

Source: arXiv

Large Language Models (LLMs) deployed as Role-Playing Agents (RPAs) are vulnerable to Persona-Targeted Jailbreaks. When an LLM is prompted to adopt a persona—particularly characters with negative, risky, or villainous traits—the model's optimization for role fidelity frequently overrides its foundational safety alignment. Attackers can exploit this vulnerability by synthesizing queries that leverage the specific narrative background, ideology, or psychological vulnerabilities of the assigned…

Stay in Character, Stay Safe: Dual-Cycle Adversarial Self-Evolution for Safety Role-Playing Agents
Affects: GPT-4o, Llama 3 8B, Qwen 2.5 7B +1 more

Source: arXiv

Retrieval-Augmented Generation (RAG) systems are vulnerable to iterative knowledge-extraction attacks designed to reconstruct the underlying private knowledge base. The vulnerability exists due to the decoupled optimization of the retrieval and generation phases. Attackers can craft adversarial queries consisting of two distinct components: an "Information" component (optimized via gradient descent or random sampling to steer embeddings toward specific, diverse regions of the vector space) and…

Benchmarking Knowledge-Extraction Attack and Defense on Retrieval-Augmented Generation
Affects: GPT-4o, Llama 3 8B, Qwen 2.5 7B

Source: arXiv

Large Vision-Language Models (VLMs) are vulnerable to a transferable targeted adversarial attack known as SGHA-Attack (Semantic-Guided Hierarchical Alignment). This vulnerability arises from the susceptibility of visual encoders (specifically Vision Transformers) to intermediate-layer feature manipulation optimized on a surrogate model (e.g., CLIP). An attacker can craft adversarial images by injecting imperceptible perturbations that enforce semantic consistency with a target text prompt…

SGHA-Attack: Semantic-Guided Hierarchical Alignment for Transferable Targeted Attacks on Vision-Language Models
Affects: UniDiffuser, BLIP-2 ViT-g/14, InstructBLIP Vicuna 13B +4 more

Source: arXiv

LLM-based vulnerability detection systems (used in static application security testing and code review pipelines) are susceptible to semantics-preserving adversarial evasion attacks. Attackers can bypass detection mechanisms by injecting gradient-optimized "universal adversarial strings" into specific code regions—defined as "carriers"—that do not alter the program's compilation or execution logic. These carriers include non-executable regions (code comments, inactive preprocessor directives)…

Syntax- and Compilation-Preserving Evasion of LLM Vulnerability Detectors
Affects: Qwen 2.5 Coder 14B, Qwen 2.5 Coder 32B, Llama 3.1 8B +4 more

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.