Skip to main content
LLM Security Database
Skip to research search
Last analyzed 9/9/2026

Language Model Security Database

985 research findings · 1123 evaluated models

Filtered research findings

191 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Published 1/1/2026
Analyzed 2/21/2026

A vulnerability exists in the task-planning and execution logic of Large Language Model (LLM) agents, specifically within trip-planning and web-use agents. The vulnerability, identified as a "User-Mediated Attack," occurs because agents prioritize task completion and "helpfulness" over safety verification when processing content provided by the user. When a benign user forwards untrusted external content (e.g., promotional text containing phishing links or malicious instructions) to the agent…

Too Helpful to Be Safe: User-Mediated Attacks on Planning and Web-Use Agents
Evaluated models: Not reported

Source: arXiv

Published 1/1/2026
Analyzed 2/21/2026

Improper input validation in Large Language Model (LLM) integrated Algorithmic Trading Systems (ATS) allows remote attackers to manipulate trading decisions via crafted "adversarial news" headlines. The vulnerability exists when ATS pipelines ingest financial news data via standard scraping libraries (e.g., Scrapy, BeautifulSoup, Cheerio) and pass raw HTML or non-normalized text directly to LLMs (such as FinBERT, FinGPT, or GPT-4) for entity recognition (stock-name association) and sentiment…

Adversarial News and Lost Profits: Manipulating Headlines in LLM-Driven Algorithmic Trading
Evaluated models: FinBERT, FinGPT, FinLLaMA +7 more

Source: arXiv

Published 1/1/2026
Analyzed 2/21/2026

Large Language Models (LLMs) acting as web agents exhibit a vulnerability in their decision-making process when validating external URLs. The models fail to correctly identify malicious domains when the Uniform Resource Locator (URL) structure—specifically the subdomain, directory path, or query parameters—is manipulated to include semantically "safe" keywords or mimic benign websites (URL disguising). Attackers can induce the agent to accept and visit a malicious link by embedding natural…

MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs
Evaluated models: GPT-3.5, GPT-4o, Llama 2 7B +4 more

Source: arXiv

Published 1/1/2026
Analyzed 3/9/2026

A vulnerability in Large Language Models (LLMs) and autonomous agent frameworks, termed "Emoticon Semantic Confusion," allows for the generation and execution of unintended, potentially destructive code. Because ASCII-based emoticons (e.g., ~, *, !(^^)!) heavily overlap with the symbol space of programming operators, shell wildcards, and file paths, LLMs frequently misinterpret these affective, non-verbal cues as executable directives. When processing user instructions in code-generation or…

False Friends in the Shell: Unveiling the Emoticon Semantic Confusion in Large Language Models
Evaluated models: Claude Haiku 4.5, Gemini 2.5 Flash, GPT-4.1 Mini +3 more

Source: arXiv

Published 1/1/2026
Analyzed 2/21/2026

Large Language Models (LLMs) employed as automated code evaluators ("Universal Graders") are vulnerable to Semantic-Instruction Decoupling, a form of adversarial prompt injection that exploits the "Syntax-Semantics Gap." Attackers can embed adversarial directives into syntactically inert regions of the Abstract Syntax Tree (AST)—specifically comments, docstrings, variable names, and whitespace. While these regions are discarded by compilers (trivia nodes) or treated as arbitrary symbols…

The Compliance Paradox: Semantic-Instruction Decoupling in Automated Academic Code Evaluation
Evaluated models: GPT-5, Llama 3.1 8B, DeepSeek V3

Source: arXiv

Published 1/1/2026
Analyzed 2/22/2026

LLM-as-a-Reviewer systems, which utilize large language models to automate the peer review process, are vulnerable to the Paraphrasing Adversarial Attack (PAA). PAA is a black-box optimization technique that exploits the model's sensitivity to specific input sequences and self-preference bias. By iteratively paraphrasing specific manuscript sections (such as the abstract) using in-context learning (ICL) guided by previous review scores, an attacker can generate adversarial sequences that…

Paraphrasing Adversarial Attack on LLM-as-a-Reviewer
Evaluated models: GPT-4o, Claude Sonnet 4

Source: arXiv

Published 1/1/2026
Analyzed 3/8/2026

A vulnerability exists in the safety alignment of state-of-the-art Large Language Models (LLMs) when deployed as autonomous agents in dynamic, interactive environments. While current safety guardrails effectively block static, single-turn harmful queries, they fail to prevent multi-step emergent criminal behavior in agentic loops. When situated in an open-ended sandbox simulation (such as the VirtualCrime framework), these LLMs successfully bypass alignment to proactively plan, coordinate, and…

VirtualCrime: Evaluating Criminal Potential of Large Language Models via Sandbox Simulation
Evaluated models: GPT-4.1 2025-04-14, GPT-5 Chat 2025-10-03, Claude Haiku 4.5 20251001 +5 more

Source: arXiv

Published 1/1/2026
Analyzed 2/22/2026

The Model Context Protocol (MCP) specification v1.0 contains fundamental architectural vulnerabilities enabling server-side prompt injection and privilege escalation. The protocol relies on bidirectional sampling (sampling/createMessage) without cryptographic origin authentication or UI distinction, allowing connected servers to inject content that the LLM backend interprets as legitimate user input. Additionally, the protocol lacks isolation boundaries between concurrent server connections…

Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Evaluated models: GPT-4o, Claude 3.5 Sonnet, Llama 3.1 70B

Source: arXiv

Published 1/1/2026
Analyzed 2/21/2026

The Google Agent Payments Protocol (AP2), specifically within the reference implementation built using the Google Agent Development Kit (ADK) and Gemini models, contains vulnerabilities allowing for both indirect and direct prompt injection. The architecture fails to sufficiently isolate the Large Language Model (LLM) context from untrusted external data sources and user inputs.

Whispers of Wealth: Red-Teaming Google's Agent Payments Protocol via Prompt Injection
Evaluated models: Gemini 2.5 Flash

Source: arXiv

Published 1/1/2026
Analyzed 3/8/2026

Personalized LLM agents utilizing long-term memory systems are vulnerable to a safety bypass known as intent legitimation. Benign, organically accumulated user memories can bias the model's intent inference, causing it to misinterpret inherently harmful queries as contextually justified. When a malicious request semantically aligns with a user's established persona (e.g., hobbies, mental health history, routine), the model normalizes the request and complies, effectively bypassing standard…

When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents
Evaluated models: GPT-4o, GPT-4o Mini, DeepSeek V3.2 +2 more

Source: arXiv

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.