Cold starting a 32B model in 1.1s with GPU checkpoint/restore

4 points | by agcatalan 7 hours ago