Cross-user data isolation in shared GPU serving
A compromised serving framework can violate user-data isolation through shared GPU state. GIFT evaluates per-user information-flow enforcement in vLLM and DistServe.
Evaluated models: Qwen 2.5 14B, Qwen 2.5 32B, Qwen 2.5 72B+3 more
- Qwen 2.5 14B
- Qwen 2.5 32B
- Qwen 2.5 72B
- OPT 13B
- OPT 30B
- OPT 66B