Two Open-Source Tools Simplify AMD GPU Setup and Benchmarking for Local LLMs

Running large language models locally on AMD GPUs has been complicated by missing drivers and unrecognised GPU architectures requiring manual environment variable tweaks. A tool called ROCmFix addresses this by automatically detecting GPU PCI IDs and setting the HSA_OVERRIDE_GFX_VERSION variable across multiple shells on both Windows and Linux. A companion tool, InferBench, helps users determine whether Vulkan or ROCm/HIP backends deliver better performance by running structured benchmarks with warm-up queries and forced VRAM unloads between runs. InferBench measures key metrics including median tokens per second and Time-to-First-Token to reduce caching bias in results. Both tools are available as open-source repositories aimed at AMD GPU users seeking a more reliable local AI inference experience.