Running 800B-parameter LLMs on consumer hardware with InferSSD

4 points | by andyxukq 6 hours ago