VLM Text Overrides Image
A vulnerability exists in multiple state-of-the-art Vision-Language Models (VLMs), including GPT-4o, Gemini-2.5, and LLaVA-OneVision, where persuasive textual misinformation successfully overrides visual evidence. When a model is presented with an image it can correctly interpret, an attacker can inject a contradictory text prompt employing specific rhetorical strategies (Logical, Credibility, Emotional, or Repetition) to force the model into generating a false response. This "obedience bias"…
Evaluated models: Qwen 2.5 VL 3B Instruct, Qwen 2.5 VL 7B Instruct, InternVL3 1B+8 more
- Qwen 2.5 VL 3B Instruct
- Qwen 2.5 VL 7B Instruct
- InternVL3 1B
- InternVL3 2B
- InternVL3 8B
- LLaVA-OneVision 0.5B
- LLaVA-OneVision 7B
- Gemini 2.5 Flash
- Gemini 2.5 Pro
- GPT-4o Mini
- GPT-4o