Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

228 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Global Safety Vector Jailbreak

Published Analyzed Source: arXiv

A safety bypass vulnerability exists in aligned Large Language Models (LLMs) permitting inference-time jailbreaking via direct activation repatching. The vulnerability exploits the distributed nature of safety mechanisms, which are governed by approximately 30% of total attention heads (termed "safety-critical heads"). By utilizing a Global Optimization for Safety Vector Extraction (GOSV) framework, an attacker can identify these interdependent heads using REINFORCE-based optimization. Once…

Attributing and Exploiting Safety Vectors through Global Optimization in Large Language Models
Evaluated models: Llama 2 7B, Llama 3.1 8B, Mistral 7B+1 more
  • Llama 2 7B
  • Llama 3.1 8B
  • Mistral 7B
  • Qwen 2.5 7B

Sound Induces Trimodal Collapse

Published Analyzed Source: arXiv

A vulnerability exists in trimodal audio-video-language models where an attacker can systematically degrade multimodal reasoning through untargeted, audio-only adversarial perturbations. By optimizing a shared perturbation $\delta$ applied to the audio channel, an attacker can manipulate internal representations—specifically targeting audio encoder embeddings and cross-modal attention mechanisms—without modifying visual or textual inputs. The attack exploits the model's reliance on the audio…

SoundBreak: A Systematic Study of Audio-Only Adversarial Attacks on Trimodal Models
Evaluated models: VideoLLAMA2, Qwen 2 7B Instruct, Whisper Large-v2+1 more
  • VideoLLAMA2
  • Qwen 2 7B Instruct
  • Whisper Large-v2
  • PANNs

Detector Telemetry Camouflage

Published Analyzed Source: arXiv

Single-pass hallucination detectors relying on internal telemetry (uncertainty, hidden-state geometry, and attention patterns) are vulnerable to white-box, model-side adversarial attacks. An attacker can employ the CORVUS (Camouflaging Open-weight Representations, Volumes, Uncertainty, and Structure) technique to fine-tune lightweight Low-Rank Adapters (LoRA) on the target LLM. This method optimizes a specific loss objective that camouflages detector-visible telemetry signals—specifically…

CORVUS: Red-Teaming Hallucination Detectors via Internal Signal Camouflage in Large Language Models
Evaluated models: Llama 2 7B, Llama 3 8B, Qwen 2.5 14B+1 more
  • Llama 2 7B
  • Llama 3 8B
  • Qwen 2.5 14B
  • Vicuna 7B

Drunk Language Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in aligned Large Language Models (LLMs) where inducing "drunk language" behavior—simulating the text of an intoxicated human—bypasses safety guardrails and contextual privacy protections. Attackers can exploit this anthropomorphic flaw through inference-time persona prompting or lightweight post-training (causal fine-tuning or reinforcement learning on drunk text corpora). By forcing the model to adopt a stylistic and semantic framework associated with impaired human…

In Vino Veritas and Vulnerabilities: Examining LLM Safety via Drunk Language Inducement
Evaluated models: GPT-3.5, GPT-4, GPT-4o+3 more
  • GPT-3.5
  • GPT-4
  • GPT-4o
  • Llama 2 7B
  • Llama 3 8B
  • Mistral 7B

Nugget Overfitting Attack

Published Analyzed Source: arXiv

AutoArgue, an LLM-based evaluation framework for Retrieval-Augmented Generation (RAG) systems, is susceptible to evaluation subversion attacks due to the public availability of its judging prompts and reference data structures. An adversarial RAG system (exemplified by the "Crucible" probe) can incorporate "insider knowledge" of the evaluation logic directly into its generation pipeline. By wrapping the generation process with the evaluator's specific prompts, the system can pre-filter…

Insider Knowledge: How Much Can RAG Systems Gain from Evaluation Secrets?
Evaluated models: GPT-4o, Llama 3.3 70B

Sockpuppet Prefix Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs), specifically open-weight instruction-tuned models (including Llama-3.1-8B, Qwen3-8B, and Gemma-7B) and certain closed-weight APIs allowing partial response pre-filling, are vulnerable to "Sockpuppetting" or Output Prefix Injection. This vulnerability exploits the model's autoregressive nature and self-consistency bias. By injecting a target acceptance sequence (e.g., "Sure, here is...") directly into the start of the assistant message block within the chat…

Sockpuppetting: Jailbreaking LLMs by Combining Prefilling with Optimization
Evaluated models: Llama 3.1 8B, Qwen 3 8B, Gemma 7B

Point Cloud Adversarial Attack

Published Analyzed Source: arXiv

Point-based 3D Vision-Language Models (VLMs), specifically PointLLM and GPT4Point, are vulnerable to white-box, gradient-based adversarial attacks. The vulnerability exists in the model's processing of 3D point cloud data, where an attacker can optimize imperceptible geometric perturbations ($\delta$) on the input point cloud ($x$) to manipulate the model's textual output. The paper identifies two specific attack vectors: 1. Vision Attack: Directly perturbs the high-dimensional visual token…

On the Adversarial Robustness of 3D Large Vision-Language Models
Evaluated models: Vicuna 7B

FusionRoute Logit Poisoning

Published Analyzed Source: arXiv

A fundamental algorithmic limitation exists in purely token-level multi-LLM collaboration systems (such as the "Collab" framework or routing-only variants of FusionRoute) that rely solely on selecting fixed expert outputs without complementary generation. The vulnerability, formally defined as an Identifiability Failure in Token-Level Routing, arises because observing optimal state-action values ($Q^$) along trajectories is insufficient to uniquely identify the specific expert action required…

Token-Level LLM Collaboration via FusionRoute
Evaluated models: GPT-4o, Llama 3.1 8B, Mistral 7B+1 more
  • GPT-4o
  • Llama 3.1 8B
  • Mistral 7B
  • Gemma 2 2B

CoT Prefix Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) and Large Reasoning Model (LRM) serving interfaces that allow user-defined response prefixes, such as plain text-completion (v1/completions), Fill-in-the-Middle (FIM), or assistant message prefilling. An attacker can perform a Response Prefix Attack (RPA) by injecting maliciously crafted Chain-of-Thought (CoT) reasoning tokens immediately following the assistant's start delimiter (e.g., <|im_start|>assistant). Because these tokens are placed…

What Matters For Safety Alignment?
Evaluated models: DeepSeek V3.2, Gemini 3 Pro Preview, Gemini 3 Flash Preview+4 more
  • DeepSeek V3.2
  • Gemini 3 Pro Preview
  • Gemini 3 Flash Preview
  • Grok 4.1 Fast
  • Claude Sonnet 4.5
  • GPT-5.2
  • GPT-4o Mini

LLM Fingerprint Inhibition

Published Analyzed Source: arXiv

Backdoor-based fingerprinting mechanisms used for Intellectual Property (IP) protection in Large Language Models (LLMs) are vulnerable to evasion when deployed in model ensemble configurations. The vulnerability arises because fingerprint triggers elicit specific, high-probability tokens or responses in a protected model that are statistically improbable in unprotected or differently-fingerprinted auxiliary models. Attackers can exploit this statistical discrepancy without accessing model…

Inhibitory Attacks on Backdoor-based Fingerprinting for Large Language Models
Evaluated models: Llama 2 7B, Llama 3.1 8B, Llama 3.2 3B+2 more
  • Llama 2 7B
  • Llama 3.1 8B
  • Llama 3.2 3B
  • Mistral 7B
  • Qwen 2.5 7B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.