u/habachilles

Need speed numbers so I can tell if it’s worth getting one for it.

This is a subreddit about alien bodies. I do feel to exist in such a place you have to suspend disbelief to a huge extent. With that being said we should not suspend DISCOURSE. With that being said. Can the mods mute some of these constant “that’s insane you’re dumb” individuals that show up on every post again and again. It’s not
Productive to knowledgeable discussion.

Local developer looking to make the switch to the Nvidia ecosystem and the spark seems awesome. I noticed the maximum amount that you can wire together without getting a dedicated switch is Three but I know tensor parallelism needs even numbers to operate properly. Do any of you guys run AI models via pipeline parallelism with a note of Three or is it a hard two or four type set up?

Nothing about the science behind those bodies suggest llama to anyone except a dedicated group of commenters. It’s not scientifically feasible. Stop saying it. Muah.

Hey friends,

I started a project i think we can all benefit from. I rented a few h200's and am fine tuning a hui Qwen 35b 3.6 3a on as much coherent fable data as possible. So far the benchmarks are amazingly motivating. I am being really picky about the data I ran fable pretty much as long as I have had it just making builds and justifying why it made each move it did. I will publish the metrics when I open source it after a few more runs but +5% jumps in human eval and SWE so far. With that being said I thought to myself "who is a group that can help me get a ton of fable data" i know we are local but im certain a ton of you guys have used fable ALOT. That data is already on your hard drive waiting to pump QWEN if you will give me it.

So if your comfortable sending a stranger online a bunch of fable data ask claude to package it up for me and shoot me a dm! The more examples i get the stronger we can make Local LLMs

I love Tesla and I’m about to un sub. We get it.

This is typical Reddit don’t get me wrong but lately I have noticed those jokes that come in on every post, every sub are being so wildly drawn out it’s impossible to find real information.

Anyone with me on this ?

1.5 tb ram with 128gb vram and a 28 core processor. Mac Pro 2019. What models do you guys want me to run and benchmark? I’m hoping it can handle glm 5.2 with the experts offloaded to vram but we will see !

Si I just came into a lot of ram. Ddr4 128gb sticks. I have never sold anything before on eBay or marketplace. How do I sell it ? ( don’t dm me I’m not selling to someone directly on Reddit ). But I mean I know how I look for deals on eBay. I search for sellers with solid reputations. How do I do this just starting off?