Llama.cpp v1.0 on an RTX 3090: up to 55% faster with speculative decoding

2 points | by aidotguru 8 hours ago

1 comments