Let’s talk quants of Gemma and Qwen - 16 vs Q8 vs Q4 - any experiences?
Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?
Some people say they’d never go under Q8, and others say they find Q3 acceptable! What’s your take?
I’m upgrading from 32 to 48 soon and am excited but I’m curious what y’all run!
I thought it had horrible performance and was a nothingburger and had spent like an hour benchmarking it. Updated it yesterday and received a like 1.5-1.8x token boost. They even mostly fixed the pp issue. Now my pp is really big ;)
So fucking stupid
Self-explanatory I hope.
Like I know they’re just joking but they know I’m vegan. I ask them if they’d eat the acts and dogs too and they say yeah if it came down to it. I asked them if we did get a pig would they stop eating bacon and they said no.
Like wow.
This phrase pisses me off because it’s basically used by A any time B talks about something more than A thinks it should be talked about. Then you have people in the comments saying “oh well, to be fair there ARE people who…” shut the fuck up
Like no. I’m allowed to not like food. It’s not like I tried it once from a single place and declared I hate it. Come on.
So as you probably know, there's a ongoing scientific debate about crustacean sentience and consensus right now is that they likely capable of feeling pain and distress when they are being prepared. And so far, some countries have banned the practice of boiling lobsters alive and recognized decapod crustaceans for welfare considerations.
Despite this, there are still too many irresponsible purchases and horrible handling of crustaceans. Like there are videos of people (assuming restaurant workers) full on ripping them apart.
E.g I saw this relatively young looking woman on TikTok who purchased these Dungeness crabs who clearly had no idea what she was doing and was unintentionally torturing a crustacean in the worst way possible. She was told that the most "humanly" (yes the word "humanly" was used not "humanely") was to rip off the apron to kill it when she must have been confused with spiking which involves using a knife or a screw driver to pierce the somewhat condensed ganglion nerve clusters in the body. She proceeds to rip the crabs limbs off while its clearly moving desperately not "residual movements after death" like her and a bunch of clueless people in the comments were saying.
Reminder this is only one of the few irresponsible acts I've seen online. There are still a lot more similar videos.
So in the end I think only people working in restaurants who understand humane dispatch methods should be sold crustaceans live.,
“Well actually…”
“Just to play devil’s advocate…”
“To be fair…”
“Maybe they just…”
“That’s not…”
Shut the FUCK UP
Literally one shot voice cloning and it’s literally so easy. What the FUCK. It’s everything I’ve ever dreamed of.
But I ever mention veganism I get “that’s different” and “this is why people hate vegans” and “you should be grateful people even care about this dog” and “so you think we should just let it stay on the side of the road then???”
They’re so close and yet so far.
“This might be difficult but try. Do a completely normal bedroom, and in the corner have just a TINY bit of a face with an extremely wide pitch black smile sticking out of the corner. Make it EXTREMELY scary. I love it lol”
I wanna see what kind of creepy stuff yall can come up with lol
I can’t really run 70B models on my current setup, but I’m curious haha
This one is hard to explain but an example is “why are mods so awful?” “Because they never have power in their life so they just have to take it out on someone to feel the tiniest bit vindicated” like no? They just happen to be a rude person?? It’s not that deep!
Or like “why do women/men/whatever do X”, “they feel unloved and are willing to do anything for attention” like no???
Why do people say and believe this? They even make jokes about it. How can we get them to understand?
It’s like they’re trying to sanitize it by saying what they get out of it instead of what it costs so they don’t have to feel bad about it. I know most non-vegans don’t feel bad at all, but I more mean it’s a way to make sure they stay distanced from it. They don’t actually engage with the thought of “this came from a being that suffered”, it’s just “oh that’s kinda sad, anyways…”