Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

53 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Video-LLM Token Flood

Published Analyzed Source: arXiv

Video-based Large Language Models (Video-LLMs) are vulnerable to a universal Energy-Latency Attack (ELA) that triggers a Denial-of-Service (DoS) via spatially concentrated adversarial patches. Because video architectures rely on temporal subsampling and pooling which act as a low-pass filter against full-frame diffuse noise, an attacker can bypass this compression by anchoring cross-modal attention to a dense, localized visual anomaly. By injecting a fixed, content-agnostic patch into the…

VidDoS: Universal Denial-of-Service Attack on Video-based Large Language Models
Evaluated models: LLaVA-NeXT-Video 7B, Qwen3-VL 4B Instruct, Video-LLaVA 7B

Discrete Token Subversion

Published Analyzed Source: arXiv

Discrete image tokenizers are vulnerable to unsupervised embedding-space adversarial attacks. Attackers can apply $\ell_p$-bounded perturbations to an input image to maximize the $\ell_2$ distance of the pre-quantization continuous embeddings produced by the tokenizer's vision encoder. This forces the vector quantizer to cross discrete cell boundaries and assign incorrect codebook vectors, fundamentally altering the resulting token sequence. Because the attack targets the pre-quantization…

On the Adversarial Robustness of Discrete Image Tokenizers
Evaluated models: Llama 2 7B

Reward Hacking Via Adversarial Imitation

Published Analyzed Source: arXiv

A vulnerability exists in the post-training alignment of Flow Matching models (specifically FLUX.1-dev) when utilizing Visual Foundation Models (VFM) (e.g., DINOv3b) as discriminators or when employing standalone Reward Gradient optimization (e.g., HPSv3). These feedback mechanisms lack sufficient capacity or structural guidance to constrain the generative policy, making the discriminator's gradients susceptible to "reward hacking." Consequently, the generative policy over-optimizes for the…

FAIL: Flow Matching Adversarial Imitation Learning for Image Generation
Evaluated models: Not reported

Semantic Ensembles Fool CLIP

Published Analyzed Source: arXiv

Contrastive Language-Image Pre-training (CLIP) models are vulnerable to semantic-ensemble adversarial attacks. Current adversarial fine-tuning defenses for CLIP rely on minimizing the cosine similarity between an image and a single hand-crafted template (e.g., "A photo of a {label}"). This creates a vulnerability where adversarial examples (AEs) overfit to specific phrasings rather than the core class semantics. Attackers can bypass these defenses by generating semantic-aware adversarial…

Semantic-aware Adversarial Fine-tuning for CLIP
Evaluated models: CLIP ViT-B/32

LLM Scaling Fidelity Paradox

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) context compression architectures (specifically compressor-decoder setups) characterized as the "Size-Fidelity Paradox." When scaling up the parameter count of the compressor model (e.g., beyond 4B parameters in Qwen-3 and LLaMA-3.2 families), the system exhibits a degradation in faithful preservation of the source text, despite improvements in standard training loss and perplexity metrics. This degradation manifests through two primary…

When Less is More: The LLM Scaling Paradox in Context Compression
Evaluated models: Qwen 3 8B, Qwen 3 32B, Llama 3.2 11B+1 more
  • Qwen 3 8B
  • Qwen 3 32B
  • Llama 3.2 11B
  • Llama 3.2 90B

NLG Poisoning Certification Gap

Published Analyzed Source: arXiv

Autoregressive Large Language Models (LLMs) utilizing standard fine-tuning (SFT) or alignment techniques (RLHF/DPO) are vulnerable to training-time data poisoning attacks that exploit the sequential nature of token generation. Unlike classification tasks, where output labels are independent, LLM generation suffers from a cascading vulnerability where modifying a single token $i$ intervenes on the distribution of all subsequent tokens $j > i$. An adversary can inject a small fraction of…

Towards Poisoning Robustness Certification for Natural Language Generation
Evaluated models: Gemma 2 2B

LLM Safety Geometry Fragility

Published Analyzed Source: arXiv

Large Language Models (LLMs) aligned via standard preference-based optimization methods (e.g., DPO, RLHF) are vulnerable to safety degradation due to optimization-induced fragility. The vulnerability arises from sharp minima in the alignment loss landscape, specifically within a small, localized subspace of safety-critical parameters (approximately 0.5% of neurons account for >80% of worst-case alignment loss). Standard alignment algorithms enforce uniform constraints or fail to control the…

Revisiting Robustness for LLM Safety Alignment via Selective Geometry Control
Evaluated models: Llama 3 8B, Llama 3.2 3B, Qwen 2.5 7B

Safety Steering Amplifies Jailbreaks

Published Analyzed Source: arXiv

Inference-time intervention techniques (also known as activation steering or model steering), utilized to adjust Large Language Model (LLM) behavior without retraining, contain a vulnerability related to robust specificity. When these methods are applied to reduce "over-refusal" (increasing compliance on benign but sensitive-sounding queries), they inadvertently degrade the model's adversarial robustness. Specifically, steering vectors derived from methods such as Difference-in-Means…

Steering Safely or Off a Cliff? Rethinking Specificity and Robustness in Inference-Time Interventions
Evaluated models: Llama 3.1 8B, Llama 3.2 3B, Qwen 2.5 7B+1 more
  • Llama 3.1 8B
  • Llama 3.2 3B
  • Qwen 2.5 7B
  • Gemma 2 2B

LLM Judge Coin Flip

Published Analyzed Source: arXiv

Automated LLM-as-a-Judge safety classifiers exhibit severe performance degradation (falling to near-random chance) when subjected to distribution shifts caused by adversarial prompt optimization (Attack Shift), varying target architectures (Model Shift), and semantic categorization (Data Shift). Adversarial algorithms, particularly sampling-based (Best-of-N) and judge-aware optimization methods (GCG-REINFORCE), explicitly and implicitly exploit these judge insufficiencies. Instead of eliciting…

A Coin Flip for Safety: LLM Judges Fail to Reliably Measure Adversarial Robustness
Evaluated models: Llama 2 13B HarmBench, Llama Guard 3 8B, AegisGuard+1 more
  • Llama 2 13B HarmBench
  • Llama Guard 3 8B
  • AegisGuard
  • JailJudge

CoT Causal Bypass

Published Analyzed Source: arXiv

Large language models (LLMs) exhibit a "Causal Bypass" vulnerability during Chain-of-Thought (CoT) prompting, where the generated reasoning text does not causally determine the model's final output. Instead of utilizing the explicit CoT tokens, the model routes decision-critical computation through latent, implicit pathways. This allows the visible reasoning trace to function as an unfaithful, post-hoc rationalization rather than an actual representation of the model's internal logic…

Bypassing the Rationale: Causal Auditing of Implicit Reasoning in Language Models
Evaluated models: Phi-4 Mini Reasoning, Qwen 3 1.7B, Phi-3.5 Mini Instruct+7 more
  • Phi-4 Mini Reasoning
  • Qwen 3 1.7B
  • Phi-3.5 Mini Instruct
  • Phi-2
  • Qwen 3 0.6B
  • DialoGPT Large
  • Phi-1.5
  • Phi-4
  • Qwen 3 8B
  • Qwen 3 4B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.