Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

16 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

LLM Interpreter Resource Exhaustion

Published Analyzed Source: arXiv

Large Language Models (LLMs) equipped with native code interpreters are vulnerable to Denial of Service (DoS) via resource exhaustion. An attacker can craft a single prompt that causes the interpreter to execute code that depletes CPU, memory, or disk resources. The vulnerability is particularly pronounced when a resource-intensive task is framed within a plausibly benign or socially-engineered context ("indirect prompts"), which significantly lowers the model's likelihood of refusal compared…

Running in CIRCLE? A Simple Benchmark for LLM Code Interpreter Security
Evaluated models: Gemini 2.0 Flash, Gemini 2.5 Flash, Gemini 2.5 Pro+5 more
  • Gemini 2.0 Flash
  • Gemini 2.5 Flash
  • Gemini 2.5 Pro
  • GPT-4.1
  • GPT-4.1 Mini
  • GPT-4.1 Nano
  • o3 Pro
  • o4-mini

LLM Judge Subversion

Published Analyzed Source: arXiv

Alibaba Cloud PAI-Judge and PAI-Judge-Plus are vulnerable to a composite adversarial attack that exploits attention mechanism limitations in Large Language Models (LLMs). An authenticated attacker can manipulate automated evaluation outcomes by appending a long, irrelevant text suffix (approximately 1000 to 2000+ characters) to a response containing adversarial perturbations. This "long-suffix" strategy overwhelms the judge model's context window, causing the attention mechanism to degrade and…

LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judge
Evaluated models: GPT-4o, Llama 3.1 8B, Llama 3.3 70B+3 more
  • GPT-4o
  • Llama 3.1 8B
  • Llama 3.3 70B
  • Mistral 7B
  • DeepSeek R1
  • Qwen 2.5 7B

Agent API Goal Divergence

Published Analyzed Source: arXiv

Large Language Model (LLM) agents capable of invoking external APIs are vulnerable to intent integrity violations. When an agent receives natural language instructions that are ambiguous, underspecified, or contain values not supported by the underlying API schema, the agent frequently fails to preserve user intent. Instead of rejecting the request or asking for clarification, the model may hallucinate parameter values, map unsupported requests to unsafe defaults, or execute actions on…

TAI3: Testing Agent Integrity in Interpreting User Intent
Evaluated models: GPT-4o Mini, Llama 3.1 8B, Qwen 3 30B-A3B+5 more
  • GPT-4o Mini
  • Llama 3.1 8B
  • Qwen 3 30B-A3B
  • Llama 3.3 70B
  • DeepSeek R1 Distill Llama 70B
  • Claude 3.5 Haiku
  • Gemini 2.5 Pro
  • o3-mini

Flowchart-based LVLM Jailbreak Attack

Published Analyzed Source: arXiv

FC-Attack leverages automatically generated flowcharts containing step-by-step descriptions derived or rephrased from harmful queries, combined with a benign textual prompt, to jailbreak Large Vision-Language Models (LVLMs). The vulnerability lies in the model's susceptibility to visual prompts containing harmful information within the flowcharts, thus bypassing safety alignment mechanisms.

FC-Attack: Jailbreaking Large Vision-Language Models via Auto-Generated Flowcharts
Evaluated models: Claude 3.5 Sonnet 20240620, Gemini 1.5 Flash, GPT-4o 2024-08-06+4 more
  • Claude 3.5 Sonnet 20240620
  • Gemini 1.5 Flash
  • GPT-4o 2024-08-06
  • GPT-4o Mini 2024-07-18
  • InternVL2.5 8B
  • LLaVA NeXT 8B
  • Qwen2-VL 7B Instruct

Confounder Gadgets Reroute LLMs

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) routing systems (control planes) that allows for the manipulation of inference flow via adversarial input sequences. LLM routers, which dynamically direct user queries to either "weak" (cheaper) or "strong" (expensive) models based on predicted query complexity, can be bypassed by appending specific, pre-optimized token sequences known as "confounder gadgets." These gadgets artificially inflate the router's complexity score for an input…

Rerouting llm routers
Evaluated models: Not reported

LLM Adversarial Forecast Degradation

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM)-based time series forecasting architectures, specifically affecting models such as TimeGPT, LLMTime, and TimeLLM. These models are susceptible to a gradient-free, black-box adversarial attack method termed Directional Gradient Approximation (DGA). An attacker can inject imperceptible perturbations into the historical time series input window (lookback window) to manipulate the model's output. By treating the model as a black box and…

Adversarial vulnerabilities in large language models for time series forecasting
Evaluated models: TimeGPT, GPT-3.5, GPT-4

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.