u/CatchInternational43

Bear with me on this one. I currently own (personally) a 16" M5 Max 128gb/4tb machine. It's my daily driver. I run local models on this fairly regularly, and it works great -- but does get very warm when doing long duration inference.

I recently started a new job as an AI Architect and I've convinced my VP that I should have a company owned machine with enough power to do R&D using local LLMs. I can pick either another 16" M5 Max 128gb/2Tb machine, or I can instead go with an M3 Ultra Studio 32/80 96gb/2Tb for the same price.

I know the cooling of the Studio is going to be hugely beneficial, and memory bandwidth is slightly better (as is the GPU count).. and I can continue using my *personal* Macbook to ssh/screen share into the Studio, making it seem, on paper at least, that the Studio is a no-brainer.

My concern is memory. 96gb is likely fine for most of the upcoming LLM models. It seems either a model requires a 512gb machine, or it can run on something more pedestrian (ie 32/64gb) with little overlap.

I need to act while I have this opportunity -- I don't know if the budget will exist for an M5 Ultra if/when one is released. Even IF an M5 Ultra is released with capacity for 128gb/256gb, it'll likely be too expensive for my department budget anyway.

Thoughts?

Update - decided to request the 96gb M3U 80 core Studio. Thanks everyone for your input!

Genuinely curious. I’ve worked for companies that have no problem with RDP sessions into laptops or desktop machines, as long as you’re using AD credentials for the login. I’ve also worked for companies that provisioned VDIs for contractors and developers to give access to the network from unmanaged devices.

And then there are enterprises that refuse to give access to anyone for any reason.

Is this stance warranted, honestly? Especially for remote workers trying to RDP from the same network. Or external users using AD with push TOTP MFA?

I have a 16" M4 Max 32gb/1Tb that I got in February. I've struggled here and there with memory pressure and on some occasions even got memory popups when using a lot of apps/tabs when doing software development.

So, literally the day before RAMageddon, I placed an order for a 16" M5 Max 128Gb/4Tb with Edu discount. It's a shit ton of money, but *now* it's a downright bargain.

Today I received a shipping notification, I'm starting to wonder if I've lost my damned mind paying $5500 for a new laptop, when my existing machine -- while not ideal -- is sufficient. I probably would have cancelled the order last month if it weren't for the realization that this is likely the last time I'll have the opportunity to buy a machine of this caliber/horsepower for a relative bargain anytime in the next decade.

I do software development. I'll have Parallels running a Windows 11 VM. I'll have Docker containers running. Frequently running dozens of tabs across 3-4 different browsers. I would like to experiment with local LLM, but I'm realistic in that this machine won't replace a frontier model subscription (or 2). My current role is "AI Architect" at my job, so having a machine appropriate for local LLM might be a smart hedge anyway. Dunno.

4Tb also lets me keep my entire photo catalog local, rather than relying on a NAS. 128gb allows me to run multiple VMs, tons of Docker containers, etc.

I can sell the new machine for healthy profit, or I can sell the old machine for almost what I paid for it and apply that to the balance. Suddenly recent MacBooks are an appreciating asset! Ha!

We adopted a 5mo old Border Aussie who is generally sweet as can be - until we take her into social situations. She’ll growl and bark at anyone, especially women, that approach us.

I’ll reach down, comfort her, and tell her everything is ok. While also gently telling her no - not punishing her, just telling her that reaction is incorrect and then praise her when she stops. She’ll simmer down somewhat and eventually let people pet her, but that initial guarded reaction is concerning.

For example, tonight we took her with for dinner and sat on the patio. The pretty young server came out, looked at our dog and smiled, and the dog started growling and barking at her. The server couldn’t have been less threatening if she tried - she even brought us a water bowl and dog treat - resulting in more growls and barks.

I’m hoping that continued exposure to strangers will eventually de-sensitize her, but looking for some tips on how to better train her that friendly people aren’t a threat .

Dogs have always loved me. Not sure why, but nearly every dog I’ve been around for any significant period of time decides that I’m their person.

This weekend we adopted a 5mo puppy for our 10yo daughter. The dog *immediately* bonded to me. She hasn’t left my side since we got home.

The kid and I are doing recall training, where my daughter has treats when she calls her and I simply give her a dismissive pat when she comes to me.

Daughter is taking her for walks, alone.

Daughter is responsible for feeding and watering her.

Kennel is in my daughter’s room, and lets her out first thing in the morning.

Daughter is playing ball/fetch/tug-of-war

Even after all of this the dog still gravitates to me. She sits in my lap. Sleeps pressed against my leg. She acknowledges my daughter, gives her kisses, and is generally very gentle towards her - she just prefers me.

Any suggestions on what I can do to help foster a relationship between the puppy and my daughter? The kid is despondent that her puppy isn’t crazy about *her* and I need to do everything in my power to fix this.

Any suggestions appreciated!