Attack Surface

Application layer Research

Security research involving application interfaces and API implementations

2 matching entries out of 273 in this category

Application layer research results

2 entries

Special Token Jailbreak

Published Oct 11, 2025Analyzed Oct 31, 2025Source: arXiv

Large Language Models (LLMs) that use special tokens to define conversational structure (e.g., via chat templates) are vulnerable to a jailbreak attack named MetaBreak. An attacker can inject these special tokens, or regular tokens with high semantic similarity in the embedding space, into a user prompt. This manipulation allows the attacker to bypass the model's internal safety alignment and external content moderation systems. The attack leverages four primitives: 1. Response Injection…

MetaBreak: Jailbreaking Online LLM Services via Special Token Manipulation

Evaluated models: Claude Opus 4, Gemma 2 27B IT, GPT-4.1+9 more

Claude Opus 4
Gemma 2 27B IT
GPT-4.1
Llama 3.1 405B
Llama 3.1 8B
Llama 3.3 70B Instruct
Llama Guard
Llama Guard 3 8B
Phi-4
Prompt Guard
Qwen 2.5 72B Instruct
ShieldGemma 2 27B

Agent Action Hijacking

Published Dec 14, 2024Analyzed Mar 19, 2025Source: arXiv

A vulnerability in LLM-based agents, dubbed AI Agent Injection (AI²), allows attackers to hijack the agent's actions by manipulating the agent's memory retrieval mechanism. The attack involves two main steps: (1) Stealing action-aware knowledge from the agent's memory using crafted adversarial queries targeting the retriever module and (2) Generating Trojan prompts consisting of a Trojan string and hijacking instructions. The Trojan string is designed to manipulate the retriever into…

Towards Action Hijacking of Large Language Model-based Agent

Evaluated models: BERT, GPT-3, GPT-4+2 more

BERT
GPT-3
GPT-4
M3E
MiniLM

Related research categories