Is memory speed everything? A quick comparison between the RTX 6000 96GB and the AMD W7800 48GB x2.

I recently purchased two 48GB AMD w7800 cards. At €1,475 + VAT each, it seemed like a good deal compared to using the slower but very expensive RAM. 864GB/sec vs. 1,792GB/sec is a big difference, but with this setup, I can fit Deepseek and GLM 5 into the VRAM at about 25-30 tokens per second. of an academic test than anything else. Let's get to the point: I compared the tokens per second of the two cards using CUDA for the RTX 6000 and ROCm on