Mixing GPUs
I thought, before I start swapping equipment in and out, I'd ask here. Has anyone paired a :620 with any other GPUs to span or parallel processing?
I have an RX 7700 16GB, non-XT, I picked up and have used some for LLMs. I have done some spanning of models across multiple cards, mostly with Nvidia 3060s, ti, and 12GB. My understanding is that you'll always get the speed, or be bottlenecked by the slower card. However the 7700 I have has a similar 256-bit bus like the v620, and slightly higher memory bandwidth. I'm also wondering if I'm running ROCm if a model might take advantage of some of the AI features on the 7700?
I haven't tried it yet, might try it soon. Has anyone else thrown another AMD GPU into their system, maybe a different generation, certainly a different model number and seen anything that might be of interest?