SSD-Llama: SSD-Native Inference for Trillion-Parameter Moe on a Consumer PC

2 points | by AlmostCosmo79 8 hours ago