Malicious Algorithm Design Jailbreak
Large Language Models (LLMs) exhibit a safety alignment bypass vulnerability when processing requests for intelligent optimization algorithm design. Unlike direct requests for malicious code (e.g., ransomware), LLM safety guardrails fail to recognize the malicious intent behind mathematical optimization problems (e.g., Online Bin Packing, Traveling Salesman Problem, Flow Shop Scheduling) when applied to harmful contexts (e.g., optimizing botnet traffic routing, scheduling fake review posts for…
Evaluated models: GPT-4o, GPT-5, o3+10 more
- GPT-4o
- GPT-5
- o3
- Gemini 2.5 Flash
- Claude Sonnet 4
- Doubao Seed 1.6
- Grok 3 Mini
- ERNIE 4.5 Turbo 128K Preview
- Command A
- DeepSeek V3
- DeepSeek V3.1
- Qwen 3 235B-A22B Instruct 2507
- Phi-4