Exploiting Sparsity for Long Context Inference: Million Token on Commodity GPUs

1 points | by teleforce 6 hours ago