AMD R9700 AI PRO vLLM Benchmarks

Performance comparison on vLLM

View on GitHub → | Compare vs NVIDIA & Tuned Results

GPUs: TP1 TP2

Attention: Triton ROCm

Loading benchmark results...

System Configuration

GPUs 2x AMD Radeon AI PRO R9700 (64GB Total VRAM)

CPU AMD Ryzen 9 9900X3D

Motherboard ASRock X870E Taichi

RAM 64GB Crucial Pro DDR5

OS Fedora 43 (6.17.8-300.fc43.x86_64)

ROCm 7.2.53150 (Nightly Build)

Benchmark Info