u/fridder

I have a m1max with 64GB of RAM. I'm not sure how to tune it effectively and when the auto tuner runs it errors out with

Prefill would require ~61.47 GB peak (current 45.55 GB + KV+SDPA 15.91 GB) but metal_cap ceiling is 54.62 GB. Raise kernel iogpu.wired_limit_mb in Terminal (currently caps Metal at 58.00 GB), or reduce context length.

Just an appreciation post and heads up. I had gotten some use out of this model before but the prompt prefill performance was terrible. It still isn't blistering but on my m1max 64GB I am finally seeing triple digit prompt prefill stats!

Very late 80's and early 90's but I really liked BBD, Boys II Men, Soul For Real , Heavy D and the Boyz. Is it just me or is it one of the genres that haven't really come back up again?