u/ReipuSarada

Does anybody have this agent set up locally on a 128gb unified strix halo 395+ AI max pc?

What models are best to give hermes for this kind of local setup with 96gb vram? I got my pc coming Monday and need some community tips. Ive been considering hermes 4.3 36b and qwen 3.6 27b. I am looking for all-around best model to serve as the daily driver for hermes.

I am also going to connect a 4090 via usb4 to run smaller models totally offloaded (or stable diffusion models completely offloaded). Not sure if this will be tricky with an AMD setup. Any tips are welcome. Thanks in advance.

Does anybody have this agent set up locally on a 128gb unified strix halo 395+ AI max pc?

What models are best to give hermes for this kind of local setup with 96gb vram? I got my pc coming Monday and need some community tips. Ive been considering hermes 4.3 36b and qwen 3.6 27b. I am looking for all-around best model to serve as the daily driver for hermes.

I am also going to connect a 4090 via usb4 to run smaller models totally offloaded (or stable diffusion models completely offloaded). Not sure if this will be tricky with an AMD setup. Any tips are welcome. Thanks in advance.

Ive got a used 7900xtx taichi (black), kingsbank 2x16gb ddr5 6000mhz CL36 ram sticks, or Alternatively some t-force 2x16gb ddr5 6400mhz cl32 ram sticks. Id prefer to do the card + 1 pair of ram sticks for the 3090, but can do the card + cash on my end.

Looking to get into stable diffusion and the 7900xtx is not it. 3090 seems like the entry point. Thanks for reading.