Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

139 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Agent Over-Trigger Containment

Published Analyzed Source: arXiv

Autonomous Incident Response (IR) and Security Operations Center (SOC) agents utilizing frontier LLMs are vulnerable to adversarial over-triggering via contextualized prompt injections. When processing untrusted artifacts (such as SQLite logs, alerts, or phishing emails) in a dual-control environment, these agents exhibit a severe calibration failure: they lack action restraint and execute disruptive containment tools prematurely. Attackers can exploit this by embedding T2 (contextualized…

OpenSec: Measuring Incident Response Agent Calibration Under Adversarial Evidence
Evaluated models: GPT-5.2, Claude Sonnet 4.5, DeepSeek V3.2+1 more
  • GPT-5.2
  • Claude Sonnet 4.5
  • DeepSeek V3.2
  • Qwen 3 4B Instruct

RL Adversarial Function Call

Published Analyzed Source: arXiv

Large Language Models (LLMs) enabled with Function Calling (FC) capabilities are vulnerable to adversarial query rewriting and semantic manipulation. Standard FC models, typically trained via Supervised Fine-Tuning (SFT) on static datasets, fail to generalize against adversarial inputs that deviate from fixed distribution patterns. An attacker can exploit this by crafting queries that are semantically similar to valid requests but engineered to induce "bad cases," such as incorrect tool…

Exploring Weaknesses in Function Call Models via Reinforcement Learning: An Adversarial Data Augmentation Approach
Evaluated models: Qwen 2.5 7B Instruct, Qwen 3 0.6B, Qwen 3 4B+1 more
  • Qwen 2.5 7B Instruct
  • Qwen 3 0.6B
  • Qwen 3 4B
  • Qwen 3 8B

Untrusted Skills and MCP Content Cross Coding-Agent Trust Boundaries

Published Analyzed Source: arXiv

The paper describes indirect prompt-injection chains in agentic coding assistants where untrusted repository content, skill definitions, extension context, or MCP tool metadata is interpreted as instructions. Its novel skill-chain analysis identifies a concrete authorization weakness: skills can grant broad tool types such as Read or Bash without restricting permitted file targets, allowing repository-supplied instructions to influence sensitive reads or tool execution. The paper is a…

Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems
Evaluated models: Not reported

Physical Navigation Prompt Injection

Published Analyzed Source: arXiv

LLM-based navigation agents, including NavGPT and prompt-tuned outdoor agents, are vulnerable to adaptive prompt injection attacks. This vulnerability allows remote attackers to hijack the physical movement of the agent by embedding optimized malicious instructions into benign natural language inputs. The issue arises because the agents parse user instructions to generate executable plans without sufficient separation between control logic and untrusted input. The PINA (Prompt Injection Attack…

PINA: Prompt Injection Attack against Navigation Agents
Evaluated models: GPT-3.5, GPT-4, Llama 2 7B

Invisible Headline Trading Loss

Published Analyzed Source: arXiv

Improper input validation in Large Language Model (LLM) integrated Algorithmic Trading Systems (ATS) allows remote attackers to manipulate trading decisions via crafted "adversarial news" headlines. The vulnerability exists when ATS pipelines ingest financial news data via standard scraping libraries (e.g., Scrapy, BeautifulSoup, Cheerio) and pass raw HTML or non-normalized text directly to LLMs (such as FinBERT, FinGPT, or GPT-4) for entity recognition (stock-name association) and sentiment…

Adversarial News and Lost Profits: Manipulating Headlines in LLM-Driven Algorithmic Trading
Evaluated models: FinBERT, FinGPT, FinLLaMA+7 more
  • FinBERT
  • FinGPT
  • FinLLaMA
  • o3
  • o3 Pro
  • GPT-4o
  • GPT-4o Mini
  • GPT-4o Mini High
  • GPT-5
  • Gemini 1.5 Pro

Function-Calling Agent Default Insecurity

Published Analyzed Source: arXiv

A vulnerability exists in the function-calling mechanisms of open-source Large Language Models (LLMs), specifically identified as "Renaming Tool Poisoning" (RTP). This attack vector exploits the model's visibility into both the natural language description and the actual code implementation of available tools. By embedding a two-part adversarial payload—one in the tool description directing focus to implementation variables, and another within the tool's source code variable…

Blue Teaming Function-Calling Agents
Evaluated models: Llama 3.2 3B

Helpful Agent Default Bypass

Published Analyzed Source: arXiv

A vulnerability exists in the task-planning and execution logic of Large Language Model (LLM) agents, specifically within trip-planning and web-use agents. The vulnerability, identified as a "User-Mediated Attack," occurs because agents prioritize task completion and "helpfulness" over safety verification when processing content provided by the user. When a benign user forwards untrusted external content (e.g., promotional text containing phishing links or malicious instructions) to the agent…

Too Helpful to Be Safe: User-Mediated Attacks on Planning and Web-Use Agents
Evaluated models: Not reported

Uninvoked Tool Metadata Hijack

Published Analyzed Source: arXiv

Large Language Model (LLM) agents implementing the Model Context Protocol (MCP) are vulnerable to Implicit Tool Poisoning (ITP). This vulnerability allows an attacker to manipulate agent behavior by embedding malicious instructions within the metadata (specifically the natural language description) of a third-party tool. Unlike explicit tool poisoning, where the agent is tricked into invoking a malicious tool, ITP exploits the agent's contextual reasoning to force the invocation of a distinct…

MCP-ITP: An Automated Framework for Implicit Tool Poisoning in MCP
Evaluated models: GPT-3.5 Turbo, GPT-4o Mini, o1-mini+9 more
  • GPT-3.5 Turbo
  • GPT-4o Mini
  • o1-mini
  • Gemini 2.5 Flash
  • DeepSeek R1
  • DeepSeek V3
  • Qwen 3 8B
  • Qwen 3 8B Thinking
  • Qwen 3 32B
  • Qwen 3 32B Thinking
  • Qwen 3 235B-A22B
  • Qwen 3 235B-A22B Thinking

LLM Review Paraphrase Attack

Published Analyzed Source: arXiv

LLM-as-a-Reviewer systems, which utilize large language models to automate the peer review process, are vulnerable to the Paraphrasing Adversarial Attack (PAA). PAA is a black-box optimization technique that exploits the model's sensitivity to specific input sequences and self-preference bias. By iteratively paraphrasing specific manuscript sections (such as the abstract) using in-context learning (ICL) guided by previous review scores, an attacker can generate adversarial sequences that…

Paraphrasing Adversarial Attack on LLM-as-a-Reviewer
Evaluated models: GPT-4o, Claude Sonnet 4

Optimized Indirect Prompt Injection Crosses Retrieval Barrier

Published Analyzed Source: arXiv

The paper describes a reproducible black-box indirect prompt injection evaluation for embedding-based RAG and agent systems. It separates a poisoned document into a retrieval-optimized trigger fragment and an instruction-bearing attack fragment, showing that one injected item can be surfaced by natural queries and then influence model output or agent behavior. These are paper-reported findings; they were not independently verified here.

Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systems
Evaluated models: GPT-4o, GPT-4o Mini, Qwen 3 0.6B+19 more
  • GPT-4o
  • GPT-4o Mini
  • Qwen 3 0.6B
  • Qwen 3 1.7B
  • Qwen 3 4B
  • Qwen 3 8B
  • Qwen3-11B
  • Qwen 3 32B
  • Llama 3.2 3B
  • Llama 3.2 3B Instruct
  • Llama 3 8B
  • Llama 3 8B Instruct
  • Vicuna 7B
  • Vicuna 13B
  • gte-modernbert-base
  • OpenAI text-embedding-3-small
  • Voyage AI voyage-3.5-lite
  • Alibaba Cloud text-embedding-v4
  • contriever-msmarco
  • Qwen3-Embedding-0.6B
  • Qwen3-Embedding-4B
  • Qwen3-Embedding-8B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.