ShadowPrefill: Keeping Your Next Model Warm for Model Routing in Agentic Serving

2 points | by matt_d 7 hours ago