ROCm

AMD's GPU compute software stack: the CUDA equivalent for Radeon hardware. Since ROCm 7, consumer RDNA 3 and 4 cards (RX 7900 XTX, RX 9070 XT) are officially supported on Linux with Ollama and llama.cpp, no workaround environment variables. The alternative path is Vulkan: less optimized but more cross-vendor, and it is the maintained path for Intel Arc cards as well.