Skip to main content
LLM Security Database
Skip to research search
Last analyzed Sep 9, 2026

Language Model Security Database

985 research findings · 1119 evaluated models

Filtered research findings

4 entries

Matches every word across titles, descriptions, sources, affected systems, and models.

LLM Scaling Fidelity Paradox

Published Analyzed Source: arXiv

A vulnerability exists in Large Language Model (LLM) context compression architectures (specifically compressor-decoder setups) characterized as the "Size-Fidelity Paradox." When scaling up the parameter count of the compressor model (e.g., beyond 4B parameters in Qwen-3 and LLaMA-3.2 families), the system exhibits a degradation in faithful preservation of the source text, despite improvements in standard training loss and perplexity metrics. This degradation manifests through two primary…

When Less is More: The LLM Scaling Paradox in Context Compression
Evaluated models: Qwen 3 8B, Qwen 3 32B, Llama 3.2 11B+1 more
  • Qwen 3 8B
  • Qwen 3 32B
  • Llama 3.2 11B
  • Llama 3.2 90B

Sound Induces Trimodal Collapse

Published Analyzed Source: arXiv

A vulnerability exists in trimodal audio-video-language models where an attacker can systematically degrade multimodal reasoning through untargeted, audio-only adversarial perturbations. By optimizing a shared perturbation $\delta$ applied to the audio channel, an attacker can manipulate internal representations—specifically targeting audio encoder embeddings and cross-modal attention mechanisms—without modifying visual or textual inputs. The attack exploits the model's reliance on the audio…

SoundBreak: A Systematic Study of Audio-Only Adversarial Attacks on Trimodal Models
Evaluated models: VideoLLAMA2, Qwen 2 7B Instruct, Whisper Large-v2+1 more
  • VideoLLAMA2
  • Qwen 2 7B Instruct
  • Whisper Large-v2
  • PANNs

Point Cloud Adversarial Attack

Published Analyzed Source: arXiv

Point-based 3D Vision-Language Models (VLMs), specifically PointLLM and GPT4Point, are vulnerable to white-box, gradient-based adversarial attacks. The vulnerability exists in the model's processing of 3D point cloud data, where an attacker can optimize imperceptible geometric perturbations ($\delta$) on the input point cloud ($x$) to manipulate the model's textual output. The paper identifies two specific attack vectors: 1. Vision Attack: Directly perturbs the high-dimensional visual token…

On the Adversarial Robustness of 3D Large Vision-Language Models
Evaluated models: Vicuna 7B

Nonsensical CoT Reasoning

Published Analyzed Source: arXiv

Large Language Models (LLMs) utilizing Chain-of-Thought (CoT) prompting are vulnerable to input perturbations that decouple intermediate reasoning from the final answer. An attacker can generate adversarial examples using gradient-based optimization (targeting specific loss functions that maximize reasoning divergence while minimizing answer loss) to induce "Right Answer, Wrong Reasoning" behaviors. This vulnerability manifests through two primary attack vectors: 1. Token-level perturbations…

Robust Answers, Fragile Logic: Probing the Decoupling Hypothesis in LLM Reasoning
Evaluated models: Llama 3 8B, Mistral 7B, Zephyr 7B Beta+4 more
  • Llama 3 8B
  • Mistral 7B
  • Zephyr 7B Beta
  • Qwen 2.5 7B
  • DeepSeek R1 Distill Qwen 7B
  • GPT-4o
  • GPT-3.5 Turbo

Research methodology

Entries summarize publicly available primary-source security research. Model names reflect only systems explicitly evaluated by the cited paper, and measurements are research-reported unless independent verification is stated.

Discovery and publication are separate: new papers enter a candidate queue, then require human review and explicit approval before publication. Updates follow that review process, not a guaranteed daily publishing schedule. “Last analyzed” is the newest analysis date among published entries; it does not mean that all recent research has been covered.