Low Latency System

A collection of everything about low latency systems.

The goal of this project is to collect resources that help people to get better performance in their system.

Leave a message

If you have anything about this project, please submit a GitHub issue here.

Linux OS tuning

System tuning guides from server vendors

Server vendors have their tuning guides. Generally, a tuning guide from a server vendor contains similar sections which are hardware tuning, OS tuning, network tuning, benchmark test, etc. In a hardware tuning section, there would be some options about turning on high performance mode on a server. Some subtle differences would be in OS tuning section.

HP

Supermicro

Dell

lenovo

Tuning Guides from Intel and AMD

Few years ago, Intel Xeon CPU was the only choice for a low latency system. It provides enough cores, CPU frequency, cache capacity, etc. Overclocked dual 2600 series CPU was the mainstream solution. Some scenarios would choose a single 1600 series CPU for higher frequency. Xeon CPU has a problem. They only could be overclocked via the base clock. That means only 1 digit percentage of frequency increment. Core i5/i7 series CPU could provide a high overclocked ratio. But the core number was a problem until core i9 released. A top core i9 CPU like i9-7980XE has 18 cores with 4.2 GHz turbo frequency. Some vendors can make all cores running at 4.6+ GHz. A single socket solution removes the latency between CPUs. Servers based on i9 is a mainstream solution now. The same thing happened with AMD. AMD’s EPYC CPU is another choice now.

Intel

AMD

Network Tuning Guides

Solarflare

Mellanox

Other

Benchmarks and tools

Tools

Faster than 10G network

Low Level API

Kernel bypass

Solarflare

Infiniband, RMDA

Other

Zero Copy

Time tech

Jitter detection

Unsort

These resources will be moved to right topics later.

Other

Report, Whitepaper

FPGA

Programming languages

The choices are not so many for low latency system.

Java

C++

About me