FusionRoute Logit Poisoning
A fundamental algorithmic limitation exists in purely token-level multi-LLM collaboration systems (such as the "Collab" framework or routing-only variants of FusionRoute) that rely solely on selecting fixed expert outputs without complementary generation. The vulnerability, formally defined as an Identifiability Failure in Token-Level Routing, arises because observing optimal state-action values ($Q^$) along trajectories is insufficient to uniquely identify the specific expert action required…
Evaluated models: GPT-4o, Llama 3.1 8B, Mistral 7B+1 more
- GPT-4o
- Llama 3.1 8B
- Mistral 7B
- Gemma 2 2B