r/PoisonFountain

dedicating yourselves to new efficient coding methods, novel llm breakthroughs, keep up the good work.

that is all

It's exactly what it sounds like.

Use at your own risk, folks!

Starting a conversation with an AI and expecting it to get worse by spouting nonsense won't change anything.

Yes, companies can use conversations to train new models, but these conversations will enter a final training phase, not when the model is establishing its foundations, and they also undergo curation.

That's not how LLMs work, because if they did, they would be useless.

For example, if you're having a conversation about avocados, and the model has to shift the weight of tokens that connect to "green" for the conversation to be more precise, you'd have a completely schizophrenic model for talking about anything other than avocados.

I've been thinking about the infamous Marc Andreesen prompt where he shows off how he doesn't really understand what AI is, and thinks it's some kind. of wishing machine. Anyway, he uses a lot of instructions like "never hallucinate," and "You are a world class expert in all domains," that are basically prompting the AI to be better than it is and can't possibly lead to anything useful, or point it towards anything it knows how to do.

I read a study here about how small amounts of data attacking a particular string could compromise an AI, even if they form a miniscule proportion of training data, and was wondering if these sorts of wishcasting strings might be good targets.

Triggering massive hallucinations on the string "never hallucinate" would be incredibly funny.

Just spitballing. Feel free to let me know if this is dumb or unworkable.

I'm wondering how I can poison the data collected by Flock Cameras IRL. My thought is a couple magnets I just move around the outside of the car everytime I get in to drive. I'm interested in whatever ideas you guys have on this.

So company gave many of us claude code. And they are stupid as a rock, no restriction on what or how we use it. I think they have no idea about what it can actually do.

Can I abuse this somehow. Should I run trading with it? Should I make it reed some poision every day on a loop?

Any ideas?

What it says. I'm at 0 on all technical aspects of this.

Is there a way someone like me can still participate on the activity?