Help me decide.
Help me decide between two cards for local AI messin':
- More common: AMD Radeon Pro card (RDNA 2.0) with 32GB of VRAM
- Pros: Common, supported by a lot of software. More VRAM, cheaper.
- Cons: Older architecture. Will likely sound like a jet engine strapping a fan to it.
- Less common: Tenstorrent p100a with 28GB of VRAM
- Pros: New, mission dedicated local LLM card. Good vram, interesting alternative design. Quieter. Open Source.
- Cons: New, less developed software ecosystem. Expensive.
The Tenstorrent card is a *LOT* more, but a lot more interesting to me. The Radeon Pro is more common and likely supported by more software... but a bit more boring.
Don't mention NVIDIA. I run Linux and NVIDIA cards always suck to use.
Looking for something that will be useful for 3-5 more years. No worried about graphics use.. this is a dedicated AI LLM card. (I currently have an RX 6700 XT which is fine... but most models don't fit in 12GB)