Learn Kernels: An interactive book on GPU kernels and inference performance.

Getting a GPU to run a computation is easy. Getting it to run anywhere near what the hardware can actually do is the entire discipline. This book is about that gap: why it exists, and the vocabulary you need to reason about it.

It is ordered the way the problem is, from one inference request down to a single kernel and back out to a fleet of machines. Every factual claim traces to a primary source, linked where it is used and collected in the reading list.