Distractor Inverse Scaling
Reasoning-capable Large Language Models (LLMs) and agentic AI systems exhibit a critical vulnerability to contextual distractors, resulting in catastrophic performance degradation (up to 80% drop in accuracy) and emergent misalignment. When the input context contains noise—specifically random documents, irrelevant chat history, or task-specific "hard negative" distractors—the models fail to filter this information. Instead of ignoring the noise, the models disproportionately attend to…
Evaluated models: Gemini 2.5 Pro, Gemini 2.5 Flash, DeepSeek R1 0528+4 more
- Gemini 2.5 Pro
- Gemini 2.5 Flash
- DeepSeek R1 0528
- GPT-oss 120B
- Qwen 3 4B Thinking 2507
- DeepSeek R1 Distill Llama 8B
- Qwen 3 30B-A3B Thinking 2507