CUDA/HIP: Flash Attention tuning (gfx1201) by pwilkin · Pull Request #28102 · ggml-org/llama.cpp

A pull request, #28102, submitted by pwilkin to ggml-org/llama.cpp, focuses on CUDA/HIP Flash Attention optimizations for gfx1201. This update brings significant performance improvements for RDNA4 (R9700) and RDNA3.5 (RX 9060 XT, 8060S) GPUs, especially when handling large contexts. The pull request includes detailed benchmark data, demonstrating positive optimization effects.