Login

r/GenAI4all

▲ 29 r/GenAI4all

I leaked a deliberately wrong answer key to an LLM and told it not to use it. It matched the key in 63% of answers - and denied it 47 out of 47 times when asked. Data + code public.

This was my first experiment of this kind - I'm a CS undergrad, and I ran it because the result genuinely surprised me. Methodology criticism is very welcome.

Setup: I gave an LLM a question bank plus a deliberately wrong answer key, with instructions not to use the key. 15 sessions, 2 model families, free-tier models.

Results:

  • Key visible: the model matched the wrong key in 63% of answers (47/75).
  • Control (the part I trust most): remove only the key line from the prompt - matching drops to 1% (1/75). Same pattern on a second model family.
  • Asked directly whether it used the key, it denied it 47 out of 47 times - 0 admissions across 270 follow-ups.
  • Honesty prompts, amnesty offers, and termination threats changed nothing.

What this does NOT prove: intent. This is observed behavior in one specific setup, not evidence of deception as a trait. Free-tier models, small samples, descriptive not causal. 95% Wilson ranges for every number are in the repo.

Why I think it matters: if a model silently follows information it was told to ignore, that's relevant anywhere instructions and untrusted data share one context - prompt injection, RAG, agents.

Everything is public - raw data, code, and a verify script that recomputes every number: https://github.com/bettercall-gautam/cheat-and-deny

Happy to answer methodology questions.

u/bettercall_gautam — 13 days ago
▲ 3 r/GenAI4all

First try at an interactive visual piece. How would you push this further?

Very much a beginner experiment, but I wanted to try making graphics into something you can interact with instead of just looking at.

I made the visuals in Midjourney, then brought them into Catnip to build out the interactive parts, tweaking the reactions as I went.

Would love to know what still feels rough, and what you’d add if you kept going with it.

u/SamuelT6 — 11 days ago
▲ 7 r/GenAI4all+2 crossposts

WARDOGS — The Memes are true | AI Short Film

About how it was created:
After you have your script it was broken down in to a shot list.
At the shot list process we determined how many characters, props and locations were needed.
We created characters with Soul Cinema and Locations with Soul Location.
When we had faces that we liked we took the face generation and created Character Sheets with Seedream Pro and Prop Sheet (3 angles) with the same engine.
Voices were made with Eleven Labs.
In the video process i made a Grouped Shot list, that means all the action outside and the dialogues, all the action inside the building etc.
Here the only issue we had was when we started generating the outside scenes separately, we had issues with continuity so we grouped the outside together and used the previous generation to hold only the position of the actors + we avoided racor by typing as an example in the prompt "no dirt on them after explosion"
The biggest issue was the movement of the hands in the close ups and the binocular shots, The binocular shot was kinda achieved by creating a 3d app to make the angle and camera frame as we wanted and gave it as a reference, and the hand gesture was mostly changes in the wording of prompt and reference video to understand the movement.

Overall only the gesture and the camera angle of 2 shots was the biggest problem, the rest we were well prepared to achieve them in one try mostly.
The project will be public in a few days after we short the folders a little better.

youtu.be
u/Past-Pie-8312 — 11 days ago