Chapter 3
Programming models and profiling
Blocked programs, tile layouts, and how to verify both
Chapter 1 built a kernel out of threads, blocks, and warps: the programmer decides what each thread does. Triton and CUTLASS both reject that unit of work and ask the programmer to describe tiles instead, leaving the mapping onto threads to a compiler. Once the compiler is making those decisions, profiling and correctness checking stop being optional reading of the source and become separate tools in their own right.