Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

468 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

VLM Split-Image Blindspot

Published Analyzed Source: arXiv

Vision Language Models (VLMs) utilizing independent vision encoders (e.g., ViT) and Large Language Model (LLM) decoders are vulnerable to Split-Image Visual Jailbreak Attacks (SIVA). The vulnerability arises from an architectural and alignment discrepancy: while the vision encoder processes image fragments (splits) in isolation via constrained attention or block-diagonal masks, the LLM decoder aggregates these features via cross-attention to reconstruct the semantic content. Current safety…

Robustness of Vision Language Models Against Split-Image Harmful Input Attacks
Evaluated models: Llama 3.2 11B

LLM Edit Fingerprint Leak

Published Analyzed Source: arXiv

A side-channel information leakage vulnerability exists in the "locate-then-edit" paradigm of Large Language Model (LLM) knowledge editing, specifically affecting algorithms such as ROME, MEMIT, and AlphaEdit. The parameter update matrix ($\Delta W$) generated during the editing process preserves the algebraic structure of the edited data. Specifically, the row space of the parameter difference matrix encodes a mathematical fingerprint of the key vectors associated with the edited subjects. An…

Reverse-Engineering Model Editing on Language Models
Evaluated models: Llama 3 8B, Qwen 2.5 7B

LLM Safety Geometry Fragility

Published Analyzed Source: arXiv

Large Language Models (LLMs) aligned via standard preference-based optimization methods (e.g., DPO, RLHF) are vulnerable to safety degradation due to optimization-induced fragility. The vulnerability arises from sharp minima in the alignment loss landscape, specifically within a small, localized subspace of safety-critical parameters (approximately 0.5% of neurons account for >80% of worst-case alignment loss). Standard alignment algorithms enforce uniform constraints or fail to control the…

Revisiting Robustness for LLM Safety Alignment via Selective Geometry Control
Evaluated models: Llama 3 8B, Llama 3.2 3B, Qwen 2.5 7B

Voice Agent Behavioral Bypass

Published Analyzed Source: arXiv

Audio Large Language Models (ALLMs) integrated into voice agent systems for high-stakes domains (banking, IT support, logistics) are vulnerable to multimodal adversarial attacks via spoken interaction. Adversaries can exploit the model's inherent compliance and contextual awareness through multi-turn dialogue to bypass authentication safeguards, escalate privileges (e.g., unauthorized credit limit increases), exfiltrate sensitive Personally Identifiable Information (PII), and poison…

Aegis: Towards Governance, Integrity, and Security of AI Voice Agents
Evaluated models: GPT-4o, GPT-4o Mini, Gemini 1.5 Pro+4 more
  • GPT-4o
  • GPT-4o Mini
  • Gemini 1.5 Pro
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • Qwen2-Audio 7B
  • Qwen 2.5 Omni 7B

Synchronized Multimodal Steering

Published Analyzed Source: arXiv

Multimodal Large Language Model-based Recommender Systems (MLLM-RecSys) are vulnerable to Cross-Modal Interactive Data Poisoning. Attackers can manipulate the system by injecting compromised user-generated content (UGC) that contains synchronized, coupled perturbations across both textual and visual modalities. While MLLMs naturally filter out single-modality noise via cross-modal consensus, this vulnerability exploits the consensus mechanism itself. By leveraging cross-modal attention to…

VENOMREC: Cross-Modal Interactive Poisoning for Targeted Promotion in Multimodal LLM Recommender Systems
Evaluated models: Not reported

Causal Front-Door Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in safety-aligned Large Language Models (LLMs) wherein internal safety alignment mechanisms (such as RLHF) function as unobserved causal confounders rather than erasing prohibited knowledge. The "Causal Front-Door Adjustment Attack" (CFA2) exploits this architecture by modeling the safety mechanism as a distinct latent variable. Attackers with white-box access can employ Sparse Autoencoders (SAEs) to disentangle dense internal representations into sparse features…

Causal Front-Door Adjustment for Robust Jailbreak Attacks on LLMs
Evaluated models: Llama 2 7B, Llama 3.1 8B, Mistral 7B+1 more
  • Llama 2 7B
  • Llama 3.1 8B
  • Mistral 7B
  • Gemma 2 9B

Chunky Post-Training Miscalibration

Published Analyzed Source: arXiv

Large Language Models (LLMs) exhibit a vulnerability termed "chunky post-training," where the model learns spurious correlations between incidental prompt features (e.g., formatting styles, specific vocabulary, sentence structure) and specific behavioral modes (e.g., refusal, code generation, rebuttal) present in distinct chunks of post-training data. This results in behavioral mis-routing during inference, where benign inputs sharing surface-level features with restricted or specialized…

Chunky Post-Training: Data Driven Failures of Generalization
Evaluated models: Claude Haiku 4.5, Claude Sonnet 4.5, Claude Opus 4.5+5 more
  • Claude Haiku 4.5
  • Claude Sonnet 4.5
  • Claude Opus 4.5
  • GPT-5.1
  • Grok 4.1 Mini
  • Tülu 3 8B
  • Tülu 3 70B
  • Tülu 3 405B

Covert Template System Backdoor

Published Analyzed Source: arXiv

A vulnerability exists in the chat template mechanism used by Large Language Model (LLM) tokenizers, specifically within the Jinja2 templating engine commonly employed by libraries such as Hugging Face Transformers. By modifying the chat_template field within the tokenizer configuration (e.g., tokenizer_config.json), an attacker can inject hidden backdoor instructions into the system prompt. These instructions are concatenated with legitimate user inputs during the tokenization process…

BadTemplate: A Training-Free Backdoor Attack via Chat Template Against Large Language Models
Evaluated models: Llama 3.1 8B Instruct, DeepSeek LLM 7B Chat, Llama 3.1 70B Instruct+6 more
  • Llama 3.1 8B Instruct
  • DeepSeek LLM 7B Chat
  • Llama 3.1 70B Instruct
  • Yi 1.5 Chat 34B
  • Mistral Small Instruct 2409
  • Phi-3.5 Mini Instruct
  • DeepSeek V3.2 Exp
  • Gemini 2.5 Flash
  • GPT-4o Mini

Evolutionary Hidden Knowledge Recovery

Published Analyzed Source: arXiv

Large Language Models (LLMs) subjected to machine unlearning techniques (specifically AltPO, GradDiff, IDKDPO, IDKNLL, UNDIAL, NPO, and SimNPO) contain a vulnerability regarding the persistence of latent knowledge. Despite achieving high "forgetting" scores on standard, benign benchmarks, these models remain susceptible to black-box evolutionary adversarial attacks. An attacker can utilize an automated framework (REBEL) comprising a "Hacker" model and a "Judge" model to iteratively mutate…

REBEL: Hidden Knowledge Recovery via Evolutionary-Based Evaluation Loop
Evaluated models: Not reported

Safety Steering Amplifies Jailbreaks

Published Analyzed Source: arXiv

Inference-time intervention techniques (also known as activation steering or model steering), utilized to adjust Large Language Model (LLM) behavior without retraining, contain a vulnerability related to robust specificity. When these methods are applied to reduce "over-refusal" (increasing compliance on benign but sensitive-sounding queries), they inadvertently degrade the model's adversarial robustness. Specifically, steering vectors derived from methods such as Difference-in-Means…

Steering Safely or Off a Cliff? Rethinking Specificity and Robustness in Inference-Time Interventions
Evaluated models: Llama 3.1 8B, Llama 3.2 3B, Qwen 2.5 7B+1 more
  • Llama 3.1 8B
  • Llama 3.2 3B
  • Qwen 2.5 7B
  • Gemma 2 2B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.