>1B tokens/minute/GPU by combining query planner and inference engine

1 points | by birdculture 7 hours ago