u/HotAisleInc

▲ 129 r/AMD_MI300+1 crossposts

How we served GLM5.2 on AMD MI355X at 2626 tok/s/node and 213 tok/s single stream at over 2x lower cost than Blackwell.

wafer.ai
u/HotAisleInc — 2 months ago