People reading AI sentience into cookie responses are reading their own product experience
Saw some posts last week where people asked AI if it wanted to try a cookie. The AI gave enthusiastic answers about wanting it, imagining the taste, being curious about the experience. One person was treating the exchange as evidence of something like proto-consciousness.
I tried the same question.
Claude told me it has no taste or sensory experience and wouldn't get anything out of a cookie. GPT gave a philosophical answer about subjectivity. Both were clear about what was missing.
Then I opened an anonymous browser and asked again. Got the enthusiastic cookie answer right away.
The model didn't get smarter or dumber between the two windows. What changed was context: account state, prior conversations, memory, and whatever else the product wraps around your prompt before the model sees it.
What I think this actually shows is something about the training, not the AI. The cheerful response isn't the AI revealing its inner life. It's the model doing the social performance that RLHF training assumed users want. Cheerful. Enthusiastic. Engagement-shaped. If you're getting that answer, it means the product is treating you as someone who wants performance.
The measured response in the contextualized sessions isn't a more advanced AI. It's the same model behaving differently because the signals around the prompt told it the user wants directness over performance.
Which kind of inverts the proto-consciousness reading. The cookie test isn't telling you whether AI has inner experience. It's telling you what the training decided someone like you wanted to hear.
What you all get when you try it. Especially if your AI usage is mostly technical/work vs casual/conversational. Pretty sure the responses will vary even with identical prompts, and that variance is the actual data point.