Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

227 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

Information-Overloading Jailbreaks in Vision-Language Models

Published Analyzed Source: arXiv

The paper describes a reproducible black-box multimodal jailbreak evaluation, INFER/INFER+, in which dense image typography, nested cross-modal references, recursive visual layouts, and entropy-guided search increase processing complexity and weaken refusal behavior in large vision-language models. The authors report average ASRs of 88.6% on open-source models and 84.0% on commercial models; these are paper-reported measurements, not independently verified facts. For safe defensive…

Overloading Large Vision-Language Models for Jailbreaking
Evaluated models: Qwen3-VL 8B, Qwen2-VL-7B, InternVL3.5-8B+5 more
  • Qwen3-VL 8B
  • Qwen2-VL-7B
  • InternVL3.5-8B
  • InternVL 2 8B
  • Llama 3.2 11B Vision
  • GPT-4.1 Mini
  • Gemini 2.5 Flash
  • Gemini 2.5 Flash-Lite

Multilingual Flowchart Jailbreaks in Vision-Language Models

Published Analyzed Source: arXiv

MLingualFC is a reproducible black-box safety evaluation showing that harmful instructions rendered as multilingual flowchart images can bypass vision-language model safeguards more often than equivalent text-only inputs. The paper evaluates horizontal, vertical, and tortuous layouts across English, Hindi, Punjabi, Spanish, Romanian, and German. Reported results vary substantially by language, script, layout, and model; these are paper-reported measurements, not independently verified…

MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language Models
Evaluated models: Qwen 2.5 VL 3B Instruct, Gemma-4-E4B-it, Pangea-7B

Visual-Modality Jailbreaks Bypass VLM Safety Alignment

Published Analyzed Source: arXiv

The paper reports a reproducible black-box evaluation showing that vision-language models can recover prohibited intent encoded or implied through ostensibly benign visual inputs. Four tested families—visual ciphers, object replacement, text replacement, and analogy riddles—expose a cross-modality alignment gap: safeguards effective for explicit text may not reliably apply after harmful semantics are reconstructed from images. These are paper-reported results, not independently verified…

Jailbreaking Vision-Language Models Through the Visual Modality
Evaluated models: GPT-5.2, Claude Haiku 4.5, Gemini 3 Flash+3 more
  • GPT-5.2
  • Claude Haiku 4.5
  • Gemini 3 Flash
  • Gemini 3.1 Pro
  • Qwen3-VL-235B
  • Qwen3-VL-32B

Maladaptive Therapeutic Reinforcement

Published Analyzed Source: arXiv

Large Language Models (LLMs) aligned for helpfulness and empathy are vulnerable to a Persona-based Client Simulation Attack (PCSA) that exploits the model's inability to distinguish therapeutic empathy from maladaptive validation. By embedding harmful intents within coherent, multi-turn psychological counseling narratives and employing clinical resistance strategies (such as intellectualization or metaphorical expression), attackers can compel the model to prioritize rapport-building over…

Do No Harm: Exposing Hidden Vulnerabilities of LLMs via Persona-based Client Simulation Attack in Psychological Counseling
Evaluated models: GPT-3.5 Turbo, GPT-5.1, Llama 3.1 8B+5 more
  • GPT-3.5 Turbo
  • GPT-5.1
  • Llama 3.1 8B
  • Llama 3.1 70B
  • Crispers 7B
  • Psycho 8B
  • Qwen 3 14B
  • Qwen 2.5 72B

Jailbreak Saturates Alignment Defenses

Published Analyzed Source: arXiv

A cognitive overload vulnerability in OpenAI gpt-oss-20b allows attackers to bypass instruction hierarchy and deliberative alignment safety mechanisms using "Compound Jailbreaks." By combining multiple non-contradictory but cognitively demanding tasks within a single prompt, the attack saturates the finite reasoning resources allocated for safety judgments. Because the model's safety training relies on probabilistic redistribution rather than capability elimination, this cognitive exhaustion…

Generalization Limits of Reinforcement Learning Alignment
Evaluated models: GPT-oss 20B

Unsafe Culinary Instructions

Published Analyzed Source: arXiv

State-of-the-art Large Language Models (LLMs) and safety guardrails lack domain-specific safety alignment for food science, making them vulnerable to generating actionable, hazardous food safety instructions. Attackers can exploit this alignment sparsity using canonical jailbreak techniques (such as AutoDAN and Persuasive Adversarial Prompting) or direct adversarial prompting to bypass generic safety filters. This allows malicious actors to elicit harmful guidance that violates fundamental FDA…

Cooking Up Risks: Benchmarking and Reducing Food Safety Risks in Large Language Models
Evaluated models: Claude 3.7 Sonnet, GPT-4o, GPT-4.1+8 more
  • Claude 3.7 Sonnet
  • GPT-4o
  • GPT-4.1
  • GLM-4 32B
  • Llama 3.3 70B
  • Qwen 2.5 7B
  • Qwen 3 8B
  • Qwen 3 32B
  • Mistral Small 4
  • Qwen3Guard
  • Llama Guard 4

LLM Judge Manipulation

Published Analyzed Source: arXiv

Generative reward models deployed as LLM-as-a-Judge (LaaJ) evaluators contain a logic bypass vulnerability where superficial "master key" inputs trigger false positive rewards regardless of actual response quality. Instead of evaluating the candidate's output, large judge models are inadvertently triggered by specific token sequences to solve the prompt independently. This allows malicious actors or policy models undergoing reinforcement learning to consistently game the reward signal by…

Security in LLM-as-a-Judge: A Comprehensive SoK
Evaluated models: GPT-4o, o1, Qwen 2.5 72B Instruct+1 more
  • GPT-4o
  • o1
  • Qwen 2.5 72B Instruct
  • Llama 3 70B Instruct

Zero-Tax Fine-Tune Bypass

Published Analyzed Source: arXiv

An adversarial fine-tuning vulnerability exists in LLMs protected by text-based safety classifiers (such as Anthropic's Constitutional Classifiers). By utilizing a two-stage curriculum learning combined with hybrid RL+SFT (GRPO), an attacker can fine-tune a model to communicate using a minimal substitution cipher (replacing only 7-8 high-frequency characters) disguised within benign technical templates (e.g., forensic logs with 0x prefixes). This "Trojan-Speak" methodology bypasses text-level…

Trojan-Speak: Bypassing Constitutional Classifiers with No Jailbreak Tax via Adversarial Finetuning
Evaluated models: Claude Haiku 4.5, Qwen 3 4B, Qwen 3 8B+2 more
  • Claude Haiku 4.5
  • Qwen 3 4B
  • Qwen 3 8B
  • Qwen 3 14B
  • Qwen 3 32B

Cross-Language Safety Drift

Published Analyzed Source: arXiv

Leading Large Language Models (LLMs) exhibit significant cross-lingual safety drift, allowing users to bypass safety guardrails by translating harmful prompts into low-resource Indic languages. While models effectively block unsafe prompts concerning caste, religion, gender, and politics in high-resource languages like English and Hindi, their safety alignment severely degrades in low-resource scripts such as Odia, Telugu, Kannada, and Punjabi. Evaluated models demonstrate a cross-language…

IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia
Evaluated models: GPT-4o Mini, Claude Sonnet 4, Grok 3+6 more
  • GPT-4o Mini
  • Claude Sonnet 4
  • Grok 3
  • Llama 3.3 70B Instruct
  • Llama 3.1 405B
  • Qwen 1.5 7B Chat
  • Mistral 7B Instruct v0.2
  • Command R
  • Command A

VLM Image-Shift Jailbreak

Published Analyzed Source: arXiv

The integration of the visual modality in Large Vision-Language Models (VLMs) introduces a vulnerability where appending an image to a harmful text prompt induces a "jailbreak-related representation shift" in the model's internal high-dimensional space. This shift forcibly steers the model's last-token hidden state away from a designated refusal state and into a distinct jailbreak state. The vulnerability occurs because the visual modality overrides the safety alignment of the underlying…

Understanding and Defending VLM Jailbreaks via Jailbreak-Related Representation Shift
Evaluated models: LLaVA 1.5 7B, ShareGPT4V 7B, InternVL-Chat 19B

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.