AMD Strix Halo (gfx1151) vLLM Benchmarks

View on GitHub →

TP1 TP2 TP2 (Eth) TP2 (Thunderbolt)

Attention

Triton ROCm

Loading benchmark results...

System Configuration

Node 1 & 2 Framework Desktop Mainboard · AMD Ryzen AI MAX 395+ (Strix Halo) · 128GB Unified RAM

OS/Kernel Fedora 43 · Linux 6.18.5-200.fc43.x86_64

Interconnect RDMA (RoCE v2) via Intel E810 (Direct Attach) · ~5µs Latency

Benchmark Info