Accelerating Block Low-Rank Foundation Model Inference on MemoryConstrained GPUs

9 points | by matt_d 10 hours ago