Should I buy Titan RTX gpu
Hey everyone,
I'm completely new to local LLMs. I'm a software developer and recently decided to start experimenting with local models and agents to help me build things more efficiently. I haven't really studied the field yet, so my understanding is pretty basic.
From what I've gathered, the general advice seems to be "the more RAM/VRAM you have, the better the models you can run." Right now I have an RX 5700 8GB, and I have an opportunity to buy a Titan RTX 24GB locally for $280. Is that a worthwhile upgrade specifically for running local LLMs and will this 2018 card be able to keep up with newer hardware? I don't think there could any better deal at this price point, no?