Chapter 6
Current hardware
What the chips being deployed now provide
Every kernel in this book eventually runs on real silicon, and what that silicon can actually do sets the ceiling the earlier chapters’ roofline math was assuming all along. This chapter reads the numbers straight from each vendor’s own architecture and tuning documentation: NVIDIA’s Blackwell generation, AMD’s CDNA 4 Instinct MI350 series, Google’s TPU7x, and AWS’s Trainium3.