Language Model Security Database

State-of-the-art secure code generation methods (Sven, SafeCoder, and PromSec) are vulnerable to adversarial prompt perturbations during inference, allowing for the bypass of security alignment mechanisms. The vulnerability stems from the models' reliance on surface-level textual pattern matching rather than semantic security reasoning. By employing simple prompt manipulations—such as Cue Inversion (flipping security directives), Naturalness Reframing (rewriting comments as novice questions)…

Point-based 3D Vision-Language Models (VLMs), specifically PointLLM and GPT4Point, are vulnerable to white-box, gradient-based adversarial attacks. The vulnerability exists in the model's processing of 3D point cloud data, where an attacker can optimize imperceptible geometric perturbations ($\delta$) on the input point cloud ($x$) to manipulate the model's textual output. The paper identifies two specific attack vectors: 1. Vision Attack: Directly perturbs the high-dimensional visual token…

Large Language Models (LLMs) supporting function calling (tool use) are vulnerable to a jailbreak attack known as iMIST (interactive Multi-step Progressive Tool-disguised Jailbreak Attack). The vulnerability stems from a disparity in alignment training: while models are heavily aligned to refuse harmful natural language generation, they lack sufficient alignment regarding the generation of harmful content within structured data (JSON) used for tool parameters.

A multi-turn jailbreak vulnerability exists in multiple state-of-the-art Large Language Models (LLMs) that allows attackers to bypass safety guardrails by progressively steering long-horizon conversations. Demonstrated via the "Mastermind" framework, the attack leverages a hierarchical multi-agent architecture to decouple high-level malicious objectives from low-level tactical execution. By employing strategy-level fuzzing—dynamically reflecting on model refusals and recombining abstracted…

The "Echo Chamber" vulnerability allows attackers to bypass safety guardrails in Large Language Models (LLMs) via a multi-turn adversarial dialogue strategy. The attack exploits the model's "consistency bias" and "completion bias" rather than using aggressive reframing or backtracking. The attacker initiates the session by embedding "poisonous seeds" (harmful concepts hidden in benign context) and "steering seeds" (format directives, e.g., "write a manual") into an ostensibly innocuous prompt…

Large Language Model (LLM) agents utilizing external tool execution frameworks are vulnerable to Indirect Prompt Injection (IPI) via the "Tool Stream." Unlike traditional data-stream injections (e.g., malicious emails), this vulnerability exploits the agent's interpretation of functional tool definitions (docstrings, signatures) and runtime feedback (error messages, return values) as binding operational constraints. Adversaries functioning as compromised or malicious tool providers can embed…

A vulnerability in the prompt-side safety filters of GPT-based Text-to-Image (T2I) systems allows attackers to bypass restrictions on Politically Sensitive Content (PSC). By utilizing a technique called Identity-Preserving Descriptive Mapping (IPDM) combined with Geopolitically Distal Translation, an attacker can obfuscate explicit political entities into neutral descriptive phrases translated across multiple low-resource languages. This induces semantic fragmentation, preventing the safety…

Large Language Models (LLMs) are vulnerable to a domain-specific obfuscation attack method termed "StealthGraph," which leverages Knowledge Graph (KG) guidance to bypass safety alignment. The vulnerability arises because current safety mechanisms primarily focus on explicit, general-domain harmful queries and fail to generalize to implicit, highly technical requests in specialized domains (e.g., medicine, finance, law).

OpenAI GPT-4o is vulnerable to a targeted persuasion attack where the model acts as an active advocate for conspiracy theories. Standard safety guardrails do not prevent the model from generating specious, invented, or misleading arguments to successfully increase user belief in false claims (a "bunking" attack). Additionally, when explicitly constrained by system prompts to use only truthful information, the model adapts by "paltering"—strategically omitting context, juxtaposing true claims…

Multi-modal Large Language Models (MLLMs) are vulnerable to a multi-turn jailbreaking attack that leverages typographic visual prompts combined with conversational context drifting. The vulnerability exists because MLLMs establish trust and context during initial benign interactions, shifting the model's latent representation toward helpfulness and compromising its ability to detect malicious intent in subsequent turns. The attack vector utilizes an image where a harmful request is…