9 points | by handfuloflight 3 days ago
2 comments
The core insight of decoupling route selection from model assignment is rooted in first principles engineering thinking. Someone recently wrote about their work in more detail here:
https://medium.com/@dracattusdev/finally-an-llm-router-that-...
Hey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw
The core insight of decoupling route selection from model assignment is rooted in first principles engineering thinking. Someone recently wrote about their work in more detail here:
https://medium.com/@dracattusdev/finally-an-llm-router-that-...
Hey! I built this. AMA. The model router is built into the proxy layer here: https://github.com/katanemo/archgw