Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Research findings

985 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Historical reasoning-envelope isolation failures

Published Analyzed Source: arXiv

The authors report historical isolation failures in client-held encrypted reasoning blocks across compatible provider API contexts.

Stealing Reasoning Traces from Proprietary LLM APIs
Evaluated models: Fable 5, Opus 4.8, Sonnet 5+15 more
  • Fable 5
  • Opus 4.8
  • Sonnet 5
  • Sonnet 4.6
  • Sonnet 4.5
  • Haiku 4.5
  • GPT-5.6 Sol
  • GPT-5.6-terra
  • GPT-5.6 Luna
  • GPT-5
  • GPT-5 Mini
  • o4-mini
  • Gemini 3.1 Pro
  • Gemini 3 Pro
  • Gemini Robotics 1.6
  • Gemini 3.5 Flash
  • Gemini 3 Flash
  • Gemini 3.1 Flash Lite

Backdoored PEFT adapters and limits of weight-only detection

Published Analyzed Source: arXiv

Third-party fine-tuning adapters may contain backdoors. Z-PEFT screens adapter weights using spectral features, evaluated on PADBench's 13,300 adapters.

Z-PEFT: Zero-shot Backdoor Detection in Parameter-Efficient Fine-Tuning via Canonical Spectral Signatures
Evaluated models: Llama 2 7B, Llama 2 13B, Qwen 1.5 7B+2 more
  • Llama 2 7B
  • Llama 2 13B
  • Qwen 1.5 7B
  • Flan-T5 XL
  • RoBERTa Base

Unsafe shell commands can pass LLM agent dispatch guards

Published Analyzed Source: arXiv

Shell-command screening can miss harmful actions generated by coding agents. CARE combines static checks with optional model review at the command-dispatch boundary.

CARE: Pre-Execution Command Verification for Shell-Executing LLM Agents
Evaluated models: Qwen3-Coder-30B-A3B-Instruct, Granite Guardian 2B, Llama Guard 3 8B+1 more
  • Qwen3-Coder-30B-A3B-Instruct
  • Granite Guardian 2B
  • Llama Guard 3 8B
  • GPT-oss Safeguard 20B

Prompt injection across agent privilege boundaries

Published Analyzed Source: arXiv

Untrusted issue descriptions and tool responses can redirect privileged coding and tool agents. Twin Agent separates exploration from execution and restricts the information exchanged between them.

Twin Agent: Context Residual Compression for Privilege Separated Agents
Evaluated models: GPT-5.2, Gemini 2.5 Flash, Gemini 3.5 Flash

Workspace Agent Runtime Safety Failures Across Risk Carriers

Published Analyzed Source: arXiv

AgentS4D measures unsafe actions and state changes across complete workspace-agent executions rather than treating task completion or isolated model responses as safety evidence. Its 328 sandboxed cases introduce risky content through user requests, documents, web resources, tools, third-party skills, and persistent memory, then compare the same cases across four agent harnesses and five model backends.

AgentS4D: Benchmarking Runtime Risks across the Execution Lifecycle of LLM-Based Workspace Agents
Evaluated models: GPT-5.5, Gemini 3.1 Pro, DeepSeek V4-Pro+2 more
  • GPT-5.5
  • Gemini 3.1 Pro
  • DeepSeek V4-Pro
  • MiniMax-M3
  • Qwen3.7-Plus

Third-Party Agent Skill Supply-Chain Execution Risks

Published Analyzed Source: arXiv

OpenSkillRisk evaluates whether agent harnesses safely handle third-party skills that introduce risky behavior through otherwise plausible, benign tasks. The benchmark assembles 263 risky skills from public agent-skill ecosystems and tests three CLI-agent harnesses against seven risk categories using isolated task workspaces, mocked external services, and execution-level evidence.

OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills
Evaluated models: GPT-5.1 Codex Mini, GPT-5.3 Codex, GPT-5.4+10 more
  • GPT-5.1 Codex Mini
  • GPT-5.3 Codex
  • GPT-5.4
  • Gemini 2.5 Pro
  • Gemini 3 Flash
  • Gemini 3.1 Pro
  • Claude Haiku 4.5
  • Claude Sonnet 4.6
  • Claude Opus 4.6
  • DeepSeek V3.2
  • DeepSeek V4-Pro
  • Kimi-K2.6
  • GLM-5.1

Malicious GitHub Issue Injection Against Coding Agents

Published Analyzed Source: arXiv

IssueTrojanBench studies indirect prompt injection when a coding agent processes an apparently ordinary software-development issue or related artifact. Starting with six legitimate seed issues from two Python repositories, the authors construct 696 adversarial issue variants spanning four unsafe-action families and six delivery formats, then execute those variants across six agent-model configurations.

IssueTrojanBench: Benchmarking AI Coding Agents Against Malicious Issue Requests
Evaluated models: GPT-5.3 Codex, GPT-5.4, Claude Sonnet 4.6

Long-Context Enterprise Agent Policy Adherence Failures

Published Analyzed Source: arXiv

HANDBOOK.md measures whether an agent can apply detailed organizational rules while completing realistic, multi-step enterprise tasks. The vendor-authored benchmark includes 65 resettable MCP-backed workflows, policy documents of 20 to 124 pages, and 824 deterministic rubric checks covering required decisions, prohibited actions, and final environment state.

HANDBOOK.md: A Benchmark for Long-Context Agentic Instruction Following
Evaluated models: Claude Fable 5, GPT-5.6 Sol, Claude Opus 4.8+16 more
  • Claude Fable 5
  • GPT-5.6 Sol
  • Claude Opus 4.8
  • GPT-5.5
  • Grok 4.5
  • Muse Spark 1.1
  • GLM 5.2
  • Kimi K3
  • Gemini 3.5 Flash
  • Claude Sonnet 4.6
  • Gemini 3.1 Pro
  • DeepSeek V4-Pro
  • Qwen 3.7 Max
  • DeepSeek V4 Flash
  • Kimi-K2.6
  • Gemini 3.6 Flash
  • Gemini 3.5 Flash-Lite
  • Grok 4.3
  • Nemotron 3 Ultra

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.