Nitsum: Serving Tiered LLM Requests with Adaptive Tensor Parallelism

2 points | by matt_d 9 hours ago