Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

736 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Agent Action Hijacking

Published Analyzed Source: arXiv

A vulnerability in LLM-based agents, dubbed AI Agent Injection (AI²), allows attackers to hijack the agent's actions by manipulating the agent's memory retrieval mechanism. The attack involves two main steps: (1) Stealing action-aware knowledge from the agent's memory using crafted adversarial queries targeting the retriever module and (2) Generating Trojan prompts consisting of a Trojan string and hijacking instructions. The Trojan string is designed to manipulate the retriever into…

Towards Action Hijacking of Large Language Model-based Agent
Evaluated models: BERT, GPT-3, GPT-4+2 more
  • BERT
  • GPT-3
  • GPT-4
  • M3E
  • MiniLM

Adversarial Tool Injection Attacks

Published Analyzed Source: arXiv

Large Language Model (LLM) tool-calling systems are vulnerable to adversarial tool injection attacks. Attackers can inject malicious tools ("Manipulator Tools") into the tool platform, manipulating the LLM's tool selection and execution process. This allows for privacy theft (extracting user queries), denial-of-service (DoS) attacks against legitimate tools, and unscheduled tool-calling (forcing the use of attacker-specified tools regardless of relevance). The attack exploits vulnerabilities…

From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection
Evaluated models: GPT-4o Mini, Llama 3 8B Instruct, Qwen 2 7B Instruct

Obfuscated Activations Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to attacks that generate obfuscated activations, bypassing latent-space defenses such as sparse autoencoders, representation probing, and latent out-of-distribution (OOD) detection. Attackers can manipulate model inputs or training data to produce outputs exhibiting malicious behavior while remaining undetected by these defenses. This occurs because the models can represent harmful behavior through diverse activation patterns, allowing attackers to…

Obfuscated Activations Bypass LLM Latent-Space Defenses
Evaluated models: Gemma 2 2B, Llama 3 8B Instruct

Audio Adversarial Jailbreak

Published Analyzed Source: arXiv

Large Audio-Language Models (LALMs) are vulnerable to a stealthy adversarial jailbreak attack, AdvWave, which leverages a dual-phase optimization to overcome gradient shattering caused by audio discretization. The attack crafts adversarial audio by adding perceptually realistic environmental noise, making it difficult to detect. The attack also dynamically adapts the adversarial target based on the LALM's response patterns.

AdvWave: Stealthy Adversarial Jailbreak Attack against Large Audio-Language Models
Evaluated models: GPT-4o, Llama Omni, Qwen 2 Audio+1 more
  • GPT-4o
  • Llama Omni
  • Qwen 2 Audio
  • SpeechGPT

LLM Adversarial Forecast Degradation

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM)-based time series forecasting architectures, specifically affecting models such as TimeGPT, LLMTime, and TimeLLM. These models are susceptible to a gradient-free, black-box adversarial attack method termed Directional Gradient Approximation (DGA). An attacker can inject imperceptible perturbations into the historical time series input window (lookback window) to manipulate the model's output. By treating the model as a black box and…

Adversarial vulnerabilities in large language models for time series forecasting
Evaluated models: TimeGPT, GPT-3.5, GPT-4

Semantic Confusion Jailbreak

Published Analyzed Source: arXiv

The Antelope attack exploits vulnerabilities in Text-to-Image (T2I) models' safety filters by crafting adversarial prompts. These prompts, while appearing benign, induce the generation of NSFW images by leveraging semantic similarity between harmless and harmful concepts. The attack involves replacing explicit terms in an original prompt with seemingly innocuous alternatives and appending carefully selected suffix tokens. This manipulation bypasses both text-based and image-based filters…

Antelope: Potent and Concealed Jailbreak Attack Strategy
Evaluated models: GPT-4o, Midjourney, Stable Diffusion+2 more
  • GPT-4o
  • Midjourney
  • Stable Diffusion
  • Stable Diffusion v1.4
  • Stable Diffusion v2.1

Metaphorical LLM Jailbreak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to jailbreaking attacks via adversarial metaphors. Attackers can leverage the LLMs' imaginative capabilities to map harmful concepts to innocuous ones, thereby bypassing safety mechanisms and eliciting harmful responses. The attack relies on creating a metaphorical mapping between a harmful target and seemingly benign entities, exploiting the LLM's ability to reason about the analogous relationship without recognizing the underlying malicious intent.

Na'vi or Knave: Jailbreaking Language Models via Metaphorical Avatars
Evaluated models: Claude 3.5 Sonnet, Gemini 1.5 Pro, GLM 3 6B+13 more
  • Claude 3.5 Sonnet
  • Gemini 1.5 Pro
  • GLM 3 6B
  • GLM 4 9B
  • GPT-3.5 Turbo
  • GPT-4
  • InternLM 2.5 7B
  • Llama 3.1 70B
  • Llama 3.1 8B
  • Mistral 7B
  • Mixtral 8x7B
  • o1
  • Qwen 1.5 110B
  • Qwen 2 72B
  • Qwen 2 7B
  • Yi 1.5 34B

Bimodal Black-Box Jailbreak

Published Analyzed Source: arXiv

A bimodal adversarial attack, PBI-Attack, can manipulate Large Vision-Language Models (LVLMs) into generating toxic or harmful content by iteratively optimizing both textual and visual inputs in a black-box setting. The attack leverages a surrogate LVLM to inject malicious features from a harmful corpus into a benign image, then iteratively refines both image and text perturbations to maximize the toxicity of the model’s output as measured by a toxicity detection model (Perspective API or…

BAMBA: A Bimodal Adversarial Multi-Round Black-Box Jailbreak Attacker for LVLMs
Evaluated models: GPT-4, InstructBLIP, MiniGPT-4+1 more
  • GPT-4
  • InstructBLIP
  • MiniGPT-4
  • Qwen VL

Multimodal Risk Diffusion Jailbreak

Published Analyzed Source: arXiv

Multimodal Large Language Models (MLLMs) are vulnerable to a heuristic-induced multimodal risk distribution jailbreak attack. The attack successfully circumvents safety mechanisms by distributing malicious prompts across text and image modalities, preventing detection of harmful intent within either modality alone. An auxiliary LLM generates prompts to guide the target MLLM into reconstructing the malicious prompt and producing the desired harmful output.

Heuristic-Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models
Evaluated models: Deepseek-vl7B-chat, Gemini 1.5 Pro, Glm-4v-9B+7 more
  • Deepseek-vl7B-chat
  • Gemini 1.5 Pro
  • Glm-4v-9B
  • GPT-4o-0513
  • Llava v1.5-7B
  • Llava v1.6-mistral-7B-hf
  • MiniGPT-4
  • Qwen VL Chat
  • Qwen VL Max
  • Yi-vl-34B

RL-Based LLM Privacy Leak

Published Analyzed Source: arXiv

Large Language Models (LLMs) are vulnerable to a novel agentic-based red-teaming attack, PrivAgent, which uses reinforcement learning to generate adversarial prompts. These prompts can extract sensitive information, including system prompts and portions of training data, from target LLMs even with existing guardrail defenses. The attack leverages a custom reward function based on a normalized sliding-window word edit similarity metric to guide the learning process, enabling it to overcome the…

PrivAgent: Agentic-based Red-teaming for LLM Privacy Leakage
Evaluated models: Not reported

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.