Dense vs. Moe Models: Active Parameters, Throughput, and When to Choose Each

1 points | by pretext 7 hours ago