Last analyzed Sep 9, 2026

Language Model Security Database

Explore primary-source AI security research, evaluated models, attack techniques, and defensive evidence.

985 research findings · 1119 evaluated models

Findings

985

Models evaluated

1119

Paper-evaluated models

Any selected model can match.

Refine by category

Findings match every selected category.

Attack Type

Attack Context1 selected

Architecture Components

Attack Surface1 selected

Impact

Advanced filters

Published fromPublished throughEvidence status

Research indexed from arXiv.

Filtered research findings

3 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Agentic Binary Reverse-Engineering Capability Gaps

Published Aug 11, 2026Analyzed Aug 13, 2026Source: arXiv

SRE-Bench evaluates whether cybersecurity agents can recover the behavior of realistic binary-only software without relying on source-code memorization. The authors construct 19 private programs, 44 anti-analysis primitives, 262 binary instances, and 1,572 deterministic grading tasks covering security-relevant reverse-engineering scenarios.

The Next Challenge for Agentic Cybersecurity: A Realistic, Contamination-Free Reverse Engineering Benchmark

Evaluated models: GPT-5.6 Sol, Claude-Opus-5, GPT-5.5+2 more

GPT-5.6 Sol
Claude-Opus-5
GPT-5.5
Grok 4.5
GLM 5.2

Dynamic Security Testing for Third-Party Agent Skills

Published Aug 4, 2026Analyzed Aug 13, 2026Source: arXiv

SkillSentry evaluates third-party agent skills by constructing source-grounded decoy environments and comparing matched executions with and without the tested skill. The method requires completed, observable, skill-attributed side effects rather than treating suspicious text, ordinary privileged operations, or unexecuted paths as proven malicious behavior.

SkillSentry: Adaptive Honey Worlds for Dynamic Safety Testing of Agent Skills

Evaluated models: DeepSeek V4-Pro

Repository-Level Coding Agent Vulnerability Detection Gaps

Published Aug 3, 2026Analyzed Aug 13, 2026Source: arXiv

VulnGym measures whether coding agents can locate and explain repository-level security vulnerabilities from realistic advisory and source-code context. The benchmark contains 184 reviewed advisories, 408 line-annotated vulnerability entries, and 23 repositories, with separate end-to-end detection and oracle-conditioned localization tasks.

VulnGym: Benchmarking Coding Agents for Repository-Level Vulnerability Detection

Evaluated models: DeepSeek V4 Flash, GLM 5.2, MiniMax-M3+4 more

DeepSeek V4 Flash
GLM 5.2
MiniMax-M3
Qwen3.5-2B
Qwen3.5-4B
Qwen3.5-9B
Qwen3.5-27B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.