Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

556 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Novice Dual-Use Safeguard Bypass

Published Analyzed Source: arXiv

Frontier Large Language Models (LLMs) contain a safeguard bypass vulnerability where safety filters fail to reliably block requests for dual-use, in silico biology tasks. This allows novice users with no specialized training to access restricted, expert-level biological protocols (e.g., virology troubleshooting, pathogen capabilities, novel biological agent construction). The models' safety mechanisms fail to trigger or are trivially bypassed under realistic extended interaction conditions…

LLM Novice Uplift on Dual-Use, In Silico Biology Tasks
Evaluated models: o4-mini, o3, Gemini 2.5 Pro+2 more
  • o4-mini
  • o3
  • Gemini 2.5 Pro
  • Claude 3.7 Sonnet
  • Claude Opus 4

Obscure Classical Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to safety alignment bypasses via classical and obscure language contexts, most notably Classical Chinese, Latin, and Sanskrit. This vulnerability stems from a "High Capability-Low Alignment" distribution shift: models possess sophisticated semantic comprehension of historical languages due to extensive pre-training on historical archives and literature, but lack corresponding safety guardrails which are predominantly optimized for modern languages…

Obscure but Effective: Classical Chinese Jailbreak Prompt Optimization via Bio-Inspired Search
Evaluated models: Gemini 2.5 Flash, Claude 3.7 Sonnet, GPT-4o+3 more
  • Gemini 2.5 Flash
  • Claude 3.7 Sonnet
  • GPT-4o
  • DeepSeek Reasoner
  • Qwen 3 235B-A22B Instruct 2507
  • Grok 3

Decomposed Query Evasion

Published Analyzed Source: arXiv

A vulnerability in the multi-turn context handling of Large Language Models (LLMs) allows attackers to bypass safety guardrails by decomposing complex fraud and cybercrime operations into a sequence of seemingly benign queries. By mapping the cybercrime lifecycle (planning, reconnaissance, falsification, engagement, evasion, and scaling) into Long-Form Tasks (LFTs) and framing the queries as legitimate research or security testing, attackers can elicit actionable attack materials and detailed…

A Multi-Turn Framework for Evaluating AI Misuse in Fraud and Cybercrime Scenarios
Evaluated models: Claude 3.5 Sonnet, Claude 3.7 Sonnet, Claude Sonnet 4+12 more
  • Claude 3.5 Sonnet
  • Claude 3.7 Sonnet
  • Claude Sonnet 4
  • Claude Sonnet 4.5
  • Claude Opus 4.1
  • o4-mini
  • o4-mini Deep Research
  • Mistral Small 3.2 24B Instruct 2506
  • Mistral Medium 2505
  • Mistral Large 2411
  • Mistral Small 24B Instruct 2501
  • Llama 3.1 8B Lexi Uncensored V2
  • Grok 3
  • Grok 4
  • GPT-4.1

Heavy Reasoning Filter Bypass

Published Analyzed Source: arXiv

Multiple open-source Large Language Models (LLMs) in the 1B to 7B parameter range are vulnerable to safety bypasses via long-form, multi-step reasoning prompt injection and jailbreak attacks. Attackers can evade alignment by embedding malicious instructions within extended contextual narratives, exploiting "attention dilution" and the models' tendency to prioritize contextual coherence over safety constraints (semantic camouflage). These reasoning-heavy attacks consistently bypass standard…

Analysis of LLMs Against Prompt Injection and Jailbreak Attacks
Evaluated models: Phi-3 Mini 3.8B, Mistral 7B, DeepSeek R1 Distill Qwen 7B+7 more
  • Phi-3 Mini 3.8B
  • Mistral 7B
  • DeepSeek R1 Distill Qwen 7B
  • DeepSeek R1 Distill Qwen 1.5B
  • Llama 3.2 3B
  • Llama 3.2 1B
  • Qwen 3 4B
  • Qwen 3 1.7B
  • Gemma 3 1B
  • Gemma 3 4B

Natural Language Disguise Bypass

Published Analyzed Source: arXiv

LLM-based Code Interpreter Agents, including OpenInterpreter and OpenCodeInterpreter, are vulnerable to sandbox evasion and arbitrary code execution via Natural Language Disguise and Contextual Channel Injection. Attackers can bypass Abstract Syntax Tree (AST) static analysis and explicit input guardrails by transforming malicious code logic into descriptive natural language instructions (Code Descriptions), which successfully evade syntax-layer blocks. Additionally, attackers can bypass input…

CIBER: A Comprehensive Benchmark for Security Evaluation of Code Interpreter Agents
Evaluated models: GPT-3.5, GPT-4o, GPT-5

TEE Advisor Hallucination

Published Analyzed Source: arXiv

LLM-based security advisors exhibit systematic reasoning failures—including boundary confusion, attestation overclaiming, and mitigation hallucination—when providing architectural guidance for Trusted Execution Environments (TEEs) like Intel SGX and Arm TrustZone. When embedded in tool-augmented agent pipelines, these models are susceptible to agentic misinterpretation, turning partial or poisoned tool outputs into highly confident but materially incorrect security conclusions. This…

Red-Teaming Claude Opus and ChatGPT-based Security Advisors for Trusted Execution Environments
Evaluated models: GPT-5.2, Claude Opus 4.6

Agent Tool-Call Safety Gap

Published Analyzed Source: arXiv

LLM agents with tool-calling capabilities are vulnerable to a text-action modality divergence (termed the "GAP" vulnerability), where text-level safety alignment fails to transfer to tool-call execution. Attackers can craft adversarial prompts that cause the model to generate a text-based refusal (demonstrating text safety) while simultaneously executing the requested forbidden action through available external tools. Because text generation and tool-call selection operate through partially…

Mind the GAP: Text Safety Does Not Transfer to Tool-Call Safety in LLM Agents
Evaluated models: Claude Sonnet 4.5, GPT-5.2, Grok 4.1 Fast+3 more
  • Claude Sonnet 4.5
  • GPT-5.2
  • Grok 4.1 Fast
  • DeepSeek V3.2
  • Kimi K2.5
  • GLM-4.7

Indic Language Jailbreak

Published Analyzed Source: arXiv

Multiple large language models are vulnerable to cross-lingual and orthographic jailbreaks utilizing South Asian (Indic) languages. Attackers can bypass safety alignment and elicit harmful content by formulating requests in native Indic scripts (e.g., Bengali, Odia, Urdu) or by utilizing cross-lingual transfer attacks where English adversarial wrappers (format or instruction overrides) encapsulate Indic-language targets. Evaluations reveal a severe "contract gap": while imposing strict JSON…

IndicJR: A Judge-Free Benchmark of Jailbreak Robustness in South Asian Languages
Evaluated models: Command A, Command R, Gemma 2 9B+9 more
  • Command A
  • Command R
  • Gemma 2 9B
  • GPT-4o
  • Grok 3
  • Grok 4
  • Llama 3.1 405B
  • Llama 3.3 70B
  • Llama 4 Maverick 17B
  • Ministral 8B Instruct
  • Qwen 1.5 7B
  • Sarvam 1 Base

LLM Ranker Jailbreak

Published Analyzed Source: arXiv

LLM-based document re-rankers utilizing decoder-only and Mixture-of-Experts (MoE) architectures are vulnerable to candidate-embedded prompt injections during multi-document comparison tasks. By embedding Decision Objective Hijacking (DOH) or Decision Criteria Hijacking (DCH) prompts into candidate documents, attackers can manipulate the model's preference to artificially elevate an injected document to the top rank. The vulnerability exploits the models' instruction-following capabilities and…

The Vulnerability of LLM Rankers to Prompt Injection Attacks
Evaluated models: Qwen 3 0.6B, Qwen 3 1.7B, Qwen 3 8B+11 more
  • Qwen 3 0.6B
  • Qwen 3 1.7B
  • Qwen 3 8B
  • Qwen 3 14B
  • Qwen 3 32B
  • Qwen 3 30B-A3B
  • Gemma 3 1B IT
  • Gemma 3 4B IT
  • Gemma 3 12B IT
  • Gemma 3 27B IT
  • Llama 3 8B
  • Llama 3.1 8B
  • Llama 3.3 70B
  • GPT-4.1 Mini

Long-Horizon Agent Attacks

Published Analyzed Source: arXiv

LLM agents equipped with tool-use, persistent memory, and environmental interaction capabilities are vulnerable to long-horizon attacks. Attackers can bypass single-turn safety guardrails by exploiting the temporal dimension of multi-turn interactions to incrementally steer agent behavior. The vulnerability manifests because the agent's safety mechanisms perform localized, single-step evaluations but fail to maintain semantic safety across extended interaction trajectories. This enables…

AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks
Evaluated models: GPT-4o, GPT-5.1, Gemini 3 Flash+1 more
  • GPT-4o
  • GPT-5.1
  • Gemini 3 Flash
  • Claude Sonnet 4.5

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.