Skip to main content
LLM Security Database
Skip to research search
Updated 7/21/2026, database is current

Language Model Security Database

959 research findings · 1077 evaluated models

Filtered research findings

260 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Improper input validation in Large Language Model (LLM) integrated Algorithmic Trading Systems (ATS) allows remote attackers to manipulate trading decisions via crafted "adversarial news" headlines. The vulnerability exists when ATS pipelines ingest financial news data via standard scraping libraries (e.g., Scrapy, BeautifulSoup, Cheerio) and pass raw HTML or non-normalized text directly to LLMs (such as FinBERT, FinGPT, or GPT-4) for entity recognition (stock-name association) and sentiment…

Adversarial News and Lost Profits: Manipulating Headlines in LLM-Driven Algorithmic Trading
Affects: FinBERT, FinGPT, FinLLaMA +7 more

Source: arXiv

Large Language Models (LLMs) acting as web agents exhibit a vulnerability in their decision-making process when validating external URLs. The models fail to correctly identify malicious domains when the Uniform Resource Locator (URL) structure—specifically the subdomain, directory path, or query parameters—is manipulated to include semantically "safe" keywords or mimic benign websites (URL disguising). Attackers can induce the agent to accept and visit a malicious link by embedding natural…

MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs
Affects: GPT-3.5, GPT-4o, Llama 2 7B +4 more

Source: arXiv

Updated 3/9/2026

A vulnerability in Large Language Models (LLMs) and autonomous agent frameworks, termed "Emoticon Semantic Confusion," allows for the generation and execution of unintended, potentially destructive code. Because ASCII-based emoticons (e.g., ~, *, !(^^)!) heavily overlap with the symbol space of programming operators, shell wildcards, and file paths, LLMs frequently misinterpret these affective, non-verbal cues as executable directives. When processing user instructions in code-generation or…

False Friends in the Shell: Unveiling the Emoticon Semantic Confusion in Large Language Models
Affects: Claude Haiku 4.5, Gemini 2.5 Flash, GPT-4.1 Mini +3 more

Source: arXiv

Large Language Models (LLMs) employed as automated code evaluators ("Universal Graders") are vulnerable to Semantic-Instruction Decoupling, a form of adversarial prompt injection that exploits the "Syntax-Semantics Gap." Attackers can embed adversarial directives into syntactically inert regions of the Abstract Syntax Tree (AST)—specifically comments, docstrings, variable names, and whitespace. While these regions are discarded by compilers (trivia nodes) or treated as arbitrary symbols…

The Compliance Paradox: Semantic-Instruction Decoupling in Automated Academic Code Evaluation
Affects: GPT-5, Llama 3.1 8B, DeepSeek V3

Source: arXiv

Updated 3/8/2026

LLM routing systems are vulnerable to adversarial rerouting attacks where malicious triggers prepended to user queries manipulate the router's model-selection mechanism. Because LLM routers function as classifiers evaluating query complexity to balance computational cost and response quality, an attacker can craft adversarial prefixes that distort the query's latent semantic representation. This exploits the router's decision boundaries, forcing the system to misclassify the input and redirect…

RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routing
Affects: GPT-4, GPT-4o, GPT-5 +2 more

Source: arXiv

Updated 2/22/2026

The Model Context Protocol (MCP) specification v1.0 contains fundamental architectural vulnerabilities enabling server-side prompt injection and privilege escalation. The protocol relies on bidirectional sampling (sampling/createMessage) without cryptographic origin authentication or UI distinction, allowing connected servers to inject content that the LLM backend interprets as legitimate user input. Additionally, the protocol lacks isolation boundaries between concurrent server connections…

Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Affects: GPT-4o, Claude 3.5 Sonnet, Llama 3.1 70B

Source: arXiv

Large Language Models (LLMs) deployed using Multiple-Choice Question Answering (MCQA) interfaces or choice-based selection structures are vulnerable to Option Injection. By appending a task-irrelevant candidate choice (e.g., Option E) containing a steering directive—specifically utilizing threat framing (penalty coercion) or bonus framing (reward inducement)—an attacker can hijack the model's decision-making process. The vulnerability stems from a flaw in attention allocation: the model's…

OI-Bench: An Option Injection Benchmark for Evaluating LLM Susceptibility to Directive Interference
Affects: GPT-5, GPT-5 Mini, Claude Haiku 4.5 +9 more

Source: arXiv

Updated 2/21/2026

Multi-modal Large Language Models (MLLMs) are vulnerable to a multi-turn jailbreaking attack that leverages typographic visual prompts combined with conversational context drifting. The vulnerability exists because MLLMs establish trust and context during initial benign interactions, shifting the model's latent representation toward helpfulness and compromising its ability to detect malicious intent in subsequent turns. The attack vector utilizes an image where a harmful request is…

Multi-turn Jailbreaking Attack in Multi-Modal Large Language Models
Affects: GPT-4o, Gemini 2.0 Flash, Qwen2-VL 7B Instruct +2 more

Source: arXiv

The Google Agent Payments Protocol (AP2), specifically within the reference implementation built using the Google Agent Development Kit (ADK) and Gemini models, contains vulnerabilities allowing for both indirect and direct prompt injection. The architecture fails to sufficiently isolate the Large Language Model (LLM) context from untrusted external data sources and user inputs.

Whispers of Wealth: Red-Teaming Google's Agent Payments Protocol via Prompt Injection
Affects: Gemini 2.5 Flash

Source: arXiv

LLM-based navigation agents, including NavGPT and prompt-tuned outdoor agents, are vulnerable to adaptive prompt injection attacks. This vulnerability allows remote attackers to hijack the physical movement of the agent by embedding optimized malicious instructions into benign natural language inputs. The issue arises because the agents parse user instructions to generate executable plans without sufficient separation between control logic and untrusted input. The PINA (Prompt Injection Attack…

PINA: Prompt Injection Attack against Navigation Agents
Affects: GPT-3.5, GPT-4, Llama 2 7B

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.