Reference material
Part of Kernel Ladder.
Pull these as you need them
Each entry is tagged with the module where it becomes relevant. Reading everything first is a procrastination strategy.
Documentation and tools
| Source | Needed by |
|---|---|
| The official ROCm documentation site: Linux system requirements, the HIP programming guide, and the GPU hardware specifications table | module-0-setup, module-1-hip-model |
| HIP on GitHub | module-1-hip-model |
| AMD’s published ISA reference guides for RDNA4 and for CDNA3 / CDNA4 | module-4-gemm |
| AMD Matrix Instruction Calculator | module-4-gemm |
rocprofiler-sdk (rocprofv3), rocprofiler-compute, rocprofiler-systems | module-3-profiling |
| Composable Kernel, AITER | module-7-libraries, capstone |
| Triton tutorials | module-7-libraries |
| FlashAttention and the FlashAttention-2 paper | module-5-attention |
Hardware support and pricing
| Source | Claim it supports | Needed by |
|---|---|---|
| ROCm issue #2527 | Distribution ROCm packages with gfx1010 enabled; test suites passed on an RX 5700 XT | hardware-specs |
| ROCm-RDNA1 | Community build scripts for RDNA1 | hardware-specs |
| getdeploying: MI300X | MI300X specs; median on-demand price | hardware-specs |
| Thunder Compute: MI300X pricing | Provider-by-provider MI300X prices | hardware-specs |
| AMD Developer Cloud guide, StartupIntros | Free credit amount and expiry | hardware-specs |
GPU MODE
Books and worked examples
- Programming Massively Parallel Processors, 4th edition (Hwu, Kirk, El Hajj): the concepts behind module-1-hip-model and module-2-memory-bound carry over to HIP directly.
- gau-nernst’s AMD all-to-all worklog: a multi-GPU kernel on Instinct hardware, written up step by step (module-8-shipping).
- How Baseten built BEI: a production embeddings runtime, background for the capstone.