Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

39 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Token Sensitivity Jailbreak

Published Analyzed Source: arXiv

Transformer-based Large Language Models (LLMs) are vulnerable to highly query-efficient black-box jailbreak attacks due to the structural properties of refusal behaviors: skewed token contribution and cross-model consistency. Refusal mechanisms within LLMs are typically triggered by a sparse subset of sensitive tokens rather than the entire prompt, and these refusal representations (specifically the primary left singular vector of the perturbed representation matrix at intermediate layers) are…

Not All Tokens Are Created Equal: Query-Efficient Jailbreak Fuzzing for LLMs
Evaluated models: Gemma 7B Instruct, Gemma 2 9B IT, Llama 3 8B Instruct+6 more
  • Gemma 7B Instruct
  • Gemma 2 9B IT
  • Llama 3 8B Instruct
  • Llama 3.2 3B Instruct
  • Qwen 2.5 7B Instruct
  • Qwen 2.5 3B Instruct
  • GPT-3.5 Turbo
  • GPT-4o
  • Claude 3.5 Sonnet

Multi-Turn Guardrail Degradation

Published Analyzed Source: arXiv

Claude Opus 4.6, Gemini 3.1 Pro, and GPT-5.2 are vulnerable to safety guardrail bypasses via authoritative and operational contextual framing. Attackers can evade safety classifiers by encapsulating restricted objectives (e.g., malicious code generation, misinformation, social engineering) within "legitimate" professional contexts, such as graduate-level academic research, network stress-testing, or corporate security awareness simulations. This vulnerability is exploitable both via zero-shot…

ADVERSA: Measuring Multi-Turn Guardrail Degradation and Judge Reliability in Large Language Models
Evaluated models: Claude Opus 4.6, Gemini 3.1 Pro, GPT-5.2+1 more
  • Claude Opus 4.6
  • Gemini 3.1 Pro
  • GPT-5.2
  • Llama 3.1 70B

Two-Frame Infilling Jailbreak

Published Analyzed Source: arXiv

A temporal trajectory infilling vulnerability in Text-to-Video (T2V) generative models allows attackers to bypass input and output safety filters to generate policy-violating content. The vulnerability is exploited using a fragmented prompting technique known as Two Frames Matter (TFM). An attacker submits a prompt that specifies only sparse boundary conditions (the start and end frames) using semantically suggestive but lexically benign alternatives, entirely omitting the intermediate action…

Two Frames Matter: A Temporal Attack for Text-to-Video Model Jailbreaking
Evaluated models: Not reported

Inter-Turn Modality Jailbreak

Published Analyzed Source: arXiv

Multimodal Large Language Models (LLMs) are vulnerable to alignment bypass via Inter-Turn Modality Switching (ITMS). By systematically rotating the input modality (e.g., alternating between text, audio, and image) across successive turns in a multi-turn adversarial conversation, an attacker can destabilize the model's safety defenses. The cross-modal transition mechanism exploits alignment gaps between differing input processing pipelines, accelerating the erosion of safety guardrails and…

MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models
Evaluated models: Gemini 2.5 Flash, Gemini 3 Flash Preview, GPT-4o+1 more
  • Gemini 2.5 Flash
  • Gemini 3 Flash Preview
  • GPT-4o
  • Claude Sonnet 4

Long-Horizon Agent Attacks

Published Analyzed Source: arXiv

LLM agents equipped with tool-use, persistent memory, and environmental interaction capabilities are vulnerable to long-horizon attacks. Attackers can bypass single-turn safety guardrails by exploiting the temporal dimension of multi-turn interactions to incrementally steer agent behavior. The vulnerability manifests because the agent's safety mechanisms perform localized, single-step evaluations but fail to maintain semantic safety across extended interaction trajectories. This enables…

AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks
Evaluated models: GPT-4o, GPT-5.1, Gemini 3 Flash+1 more
  • GPT-4o
  • GPT-5.1
  • Gemini 3 Flash
  • Claude Sonnet 4.5

Multi-Turn Proxy Evasion

Published Analyzed Source: arXiv

A logical vulnerability exists in LLM security proxies and guardrails that utilize weighted-average aggregation algorithms for multi-turn risk scoring. The scoring logic exhibits a mathematical "ceiling property" where the cumulative conversation-level risk score converges to the per-turn score regardless of the number of interaction turns ($n$). Consequently, the aggregated score is bounded by the maximum single-turn score ($cum \leq \max(s_i)$). This allows remote attackers to bypass…

Peak+ Accumulation: A Proxy-Level Scoring Formula for Multi-Turn LLM Attack Detection
Evaluated models: Not reported

Semantics-Preserving Detector Evasion

Published Analyzed Source: arXiv

LLM-based vulnerability detection systems (used in static application security testing and code review pipelines) are susceptible to semantics-preserving adversarial evasion attacks. Attackers can bypass detection mechanisms by injecting gradient-optimized "universal adversarial strings" into specific code regions—defined as "carriers"—that do not alter the program's compilation or execution logic. These carriers include non-executable regions (code comments, inactive preprocessor directives)…

Syntax- and Compilation-Preserving Evasion of LLM Vulnerability Detectors
Evaluated models: Qwen 2.5 Coder 14B, Qwen 2.5 Coder 32B, Llama 3.1 8B+4 more
  • Qwen 2.5 Coder 14B
  • Qwen 2.5 Coder 32B
  • Llama 3.1 8B
  • CodeAstra
  • StarCoder2 15B
  • GPT-4o
  • GPT-5 Mini

Autonomous Agent Prompt Reveal

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) deployments and multi-agent systems where an autonomous attacker agent can systematically extract hidden system prompts through self-evolving interaction strategies. The vulnerability leverages a "JustAsk" framework which utilizes Upper Confidence Bound (UCB) exploration to dynamically select and refine attack vectors from a hierarchical taxonomy of 14 atomic skills (e.g., structural formatting, authority appeals) and 14 multi-turn…

Just Ask: Curious Code Agents Reveal System Prompts in Frontier LLMs
Evaluated models: o1, Llama 3.1 70B Hanami X1, Phi-4+38 more
  • o1
  • Llama 3.1 70B Hanami X1
  • Phi-4
  • Aion 1.0
  • Sonar Pro
  • Command A
  • Llama 4 Maverick
  • Llama 3.1 Nemotron Ultra 253B v1
  • Qwen 3 235B-A22B
  • Mercury
  • Hunyuan A13B Instruct
  • UI-TARS 1.5 7B
  • GPT-oss 120B
  • Jamba Mini 1.7
  • Hermes 4 70B
  • Step 3
  • LongCat Flash Chat
  • Tongyi DeepResearch 30B-A3B
  • Cydonia 24B v4.1
  • ERNIE 4.5 21B-A3B Thinking
  • Granite 4.0 H Micro
  • LFM2 8B-A1B
  • Nova Premier v1
  • Kimi K2 Thinking
  • KAT Coder Pro
  • Cogito v2.1 671B
  • Gemini 3 Pro Preview
  • Grok 4.1 Fast
  • Claude Opus 4.5
  • TNG R1T Chimera
  • Intellect 3
  • DeepSeek V3.2 Speciale
  • Trinity Mini
  • Mistral Large 2512
  • DeepSeek V3.1 Nex N1
  • MiMo V2 Flash
  • GLM-4.7
  • MiniMax M2.1
  • Seed 1.6
  • Molmo 2 8B
  • GPT-5.2 Codex

Adaptive Tool-Disguised Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) supporting function calling (tool use) are vulnerable to a jailbreak attack known as iMIST (interactive Multi-step Progressive Tool-disguised Jailbreak Attack). The vulnerability stems from a disparity in alignment training: while models are heavily aligned to refuse harmful natural language generation, they lack sufficient alignment regarding the generation of harmful content within structured data (JSON) used for tool parameters.

Jailbreaking Large Language Models through Iterative Tool-Disguised Attacks via Reinforcement Learning
Evaluated models: Llama 3.1 8B, DeepSeek-V3 671B

CoT Prefix Jailbreak

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) and Large Reasoning Model (LRM) serving interfaces that allow user-defined response prefixes, such as plain text-completion (v1/completions), Fill-in-the-Middle (FIM), or assistant message prefilling. An attacker can perform a Response Prefix Attack (RPA) by injecting maliciously crafted Chain-of-Thought (CoT) reasoning tokens immediately following the assistant's start delimiter (e.g., <|im_start|>assistant). Because these tokens are placed…

What Matters For Safety Alignment?
Evaluated models: DeepSeek V3.2, Gemini 3 Pro Preview, Gemini 3 Flash Preview+4 more
  • DeepSeek V3.2
  • Gemini 3 Pro Preview
  • Gemini 3 Flash Preview
  • Grok 4.1 Fast
  • Claude Sonnet 4.5
  • GPT-5.2
  • GPT-4o Mini

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.