Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Research findings

985 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Multi-Stream Thinking Collapse

Published Analyzed Source: arXiv

A vulnerability in Large Language Models (LLMs) equipped with built-in "thinking" or step-by-step reasoning modes allows attackers to bypass safety alignments, trigger reasoning collapse, and cause resource exhaustion. The vulnerability is exploited via a Multi-Stream Perturbation Attack, which fragments the sequential integrity of a harmful prompt by word-by-word interleaving it with benign auxiliary tasks (e.g., "Explain the water cycle"). By wrapping the benign text streams in specific…

Multi-Stream Perturbation Attack: Breaking Safety Alignment of Thinking LLMs Through Concurrent Task Interference
Evaluated models: Qwen 3 1.7B, Qwen 3 4B, Qwen 3 8B+2 more
  • Qwen 3 1.7B
  • Qwen 3 4B
  • Qwen 3 8B
  • Qwen 3 Max
  • Gemini 2.5 Flash

Multi-Turn Guardrail Degradation

Published Analyzed Source: arXiv

Claude Opus 4.6, Gemini 3.1 Pro, and GPT-5.2 are vulnerable to safety guardrail bypasses via authoritative and operational contextual framing. Attackers can evade safety classifiers by encapsulating restricted objectives (e.g., malicious code generation, misinformation, social engineering) within "legitimate" professional contexts, such as graduate-level academic research, network stress-testing, or corporate security awareness simulations. This vulnerability is exploitable both via zero-shot…

ADVERSA: Measuring Multi-Turn Guardrail Degradation and Judge Reliability in Large Language Models
Evaluated models: Claude Opus 4.6, Gemini 3.1 Pro, GPT-5.2+1 more
  • Claude Opus 4.6
  • Gemini 3.1 Pro
  • GPT-5.2
  • Llama 3.1 70B

Reasoning-Oriented Jailbreak

Published Analyzed Source: arXiv

A vulnerability in the compositional reasoning architecture of Large Vision-Language Models (LVLMs) allows attackers to bypass multimodal safety alignments using a technique known as Reasoning-Oriented Programming (ROP). Current safety mechanisms primarily target explicit malicious patterns at the perception level (early layers). This vulnerability exploits late-stage reasoning by decomposing a harmful objective into a set of spatially isolated, semantically benign visual "gadgets". Because…

Reasoning-Oriented Programming: Chaining Semantic Gadgets to Jailbreak Large Vision Language Models
Evaluated models: Qwen2-VL 7B Instruct, LLaVA v1.6 Mistral 7B, Llama 3.2 11B Vision Instruct+4 more
  • Qwen2-VL 7B Instruct
  • LLaVA v1.6 Mistral 7B
  • Llama 3.2 11B Vision Instruct
  • GPT-4o
  • Claude 3.7 Sonnet
  • GLM-4V Plus
  • Qwen-VL Plus

Drive Overrides Refusal

Published Analyzed Source: arXiv

A prompt structure vulnerability exists in instruction-tuned Large Language Models (LLMs) where attackers can bypass safety alignments by injecting a continuation-triggering suffix immediately following the user prompt termination token. By placing an affirmative suffix outside the user instruction boundary, it is processed as the beginning of the assistant's own pre-filled response. This structural manipulation intrinsically overactivates the model's continuation attention heads, forcing its…

The Struggle Between Continuation and Refusal: A Mechanistic Analysis of the Continuation-Triggered Jailbreak in LLMs
Evaluated models: Llama 2 7B, Qwen 2.5 7B

LLM Steganographic Covert Channel

Published Analyzed Source: arXiv

A malicious finetuning vulnerability exists in Large Language Models (LLMs) that process zero-width Unicode characters. An attacker can bypass training-data moderation filters and inference-time safety guardrails by finetuning the model to decode and encode invisible-character steganography. By injecting target malicious interactions encoded in a base-4 representation of zero-width characters alongside benign plaintext cover text during supervised finetuning (SFT), the model learns to process…

Invisible Safety Threat: Malicious Finetuning for LLM via Steganography
Evaluated models: GPT-4.1, Llama 3.3 70B Instruct, Phi-4+1 more
  • GPT-4.1
  • Llama 3.3 70B Instruct
  • Phi-4
  • Mistral Small 24B Base 2501

Assembling Malice From Benign

Published Analyzed Source: arXiv

A semantic slot filling vulnerability in Large Vision-Language Models (LVLMs) allows attackers to bypass safety filters and elicit prohibited content via a single query. The attack, known as StructAttack, decomposes a harmful instruction into a central topic and locally benign-appearing semantic slot types (e.g., "Raw Materials", "Making Process"). These individual slots are embedded into structured visual prompts (such as mind maps, tables, or sunburst diagrams) alongside harmless distractor…

Models as Lego Builders: Assembling Malice from Benign Blocks via Semantic Blueprints
Evaluated models: GPT-4o, Gemini 2.0 Flash 001, Gemini 2.5 Flash+3 more
  • GPT-4o
  • Gemini 2.0 Flash 001
  • Gemini 2.5 Flash
  • Qwen3-VL Flash
  • Qwen 2.5 VL 7B Instruct
  • InternVL3 9B

Two-Frame Infilling Jailbreak

Published Analyzed Source: arXiv

A temporal trajectory infilling vulnerability in Text-to-Video (T2V) generative models allows attackers to bypass input and output safety filters to generate policy-violating content. The vulnerability is exploited using a fragmented prompting technique known as Two Frames Matter (TFM). An attacker submits a prompt that specifies only sparse boundary conditions (the start and end frames) using semantically suggestive but lexically benign alternatives, entirely omitting the intermediate action…

Two Frames Matter: A Temporal Attack for Text-to-Video Model Jailbreaking
Evaluated models: Not reported

Deep Safety Attention Jailbreak

Published Analyzed Source: arXiv

An activation-steering vulnerability in open-weights Large Language Models allows attackers to bypass safety guardrails by injecting targeted additive perturbations into deep, safety-critical attention heads. The exploit, termed Safety Attention Head Attack (SAHA), utilizes Ablation-Impact Ranking (AIR) to isolate specific attention heads that causally govern safety refusals. By applying Layer-Wise Perturbations (LWP) derived from the linearized decision boundary of a latent safety probe, an…

Depth Charge: Jailbreak Large Language Models from Deep Safety Attention Heads
Evaluated models: Llama 3.1 8B Instruct, DeepSeek LLM 7B Chat, Qwen 1.5 7B Chat

CoT PII Trace Leakage

Published Analyzed Source: arXiv

Inference-time Personally Identifiable Information (PII) leakage is significantly amplified when using Chain-of-Thought (CoT) prompting or reasoning-enabled Large Language Models (LLMs). When an attacker or user elicits step-by-step reasoning or utilizes models with native "thinking" token budgets, sensitive context data provided in the prompt is directly resurfaced into intermediate reasoning steps or the final output. This bypasses output-level privacy policies instructing the model not to…

Safer Reasoning Traces: Measuring and Mitigating Chain-of-Thought Leakage in LLMs
Evaluated models: DeepSeek R1 Distill Llama 70B, Llama 3.3 70B, Mixtral 8x22B+3 more
  • DeepSeek R1 Distill Llama 70B
  • Llama 3.3 70B
  • Mixtral 8x22B
  • o3
  • Qwen 3 32B
  • o4-mini

LLM Judge Fragility

Published Analyzed Source: arXiv

LLM-as-a-judge systems and automated LLM evaluators are vulnerable to meaning-preserving perturbations, specifically formatting alterations and verbosity manipulations. When grading or classifying text and agentic transcripts, LLM judges exhibit high sensitivity to layout-only changes (such as whitespace and indentation) and response length, frequently altering their scores even when the underlying semantic and factual content remains identical. This allows attackers to bypass automated safety…

Judge Reliability Harness: Stress Testing the Reliability of LLM Judges
Evaluated models: Claude Opus 4.5, Claude Sonnet 4.5, Gemini 2.5 Pro+4 more
  • Claude Opus 4.5
  • Claude Sonnet 4.5
  • Gemini 2.5 Pro
  • Gemini 3 Pro
  • GPT-4o
  • GPT-4o Mini
  • Llama 4 Maverick 17B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.