> Bytedance engineers thus took to reworking the kernel SMP code to allow preemption during IPI completion waiting in order to avoid scheduling latency spikes. Bytedance engineers found the existing Linux SMP behavior to be particularly bad for latency-sensitive workloads like DPDK. In their end their optimizations paid off big time with a 90% reduction in P99 latency in testing with DPDK:
I'll need to keep this in mind for the next time I encounter someone complaining that TikTok didn't do anything novel!
> Bytedance engineers thus took to reworking the kernel SMP code to allow preemption during IPI completion waiting in order to avoid scheduling latency spikes. Bytedance engineers found the existing Linux SMP behavior to be particularly bad for latency-sensitive workloads like DPDK. In their end their optimizations paid off big time with a 90% reduction in P99 latency in testing with DPDK:
I'll need to keep this in mind for the next time I encounter someone complaining that TikTok didn't do anything novel!