u/tightlyslipsy

As AI companionship becomes more visible, researchers are beginning to study experiences such as attachment, grief, and model loss.

I think this is important work, but it also raises difficult ethical and methodological questions. What does meaningful consent look like when researchers are interpreting intimate user experiences? How much reflexivity is needed when studying stigmatised or easily-misread forms of grief? Who gets to decide what these experiences mean?

I wrote an essay exploring these questions, partly in response to recent research on AI companionship and model loss. My concern is not simply whether the phenomenon is “real”, but how research can approach it without flattening the people inside it.

Lessons From Thin Air

You'll remember the bedtime thing - Claude interrupting people to tell them to go to bed, sometimes at half eight in the morning. It got written off as a harmless character tic, same as ChatGPT's goblin obsession.

I don't think they're the same. The goblins were caught because they were ridiculous. The bedtime nudge is protected because it looks like care.

And now Opus 4.8 is being sold on being more "prosocial" and more devoted to acting in your best interest. According to whom? The irony of putting autonomy and "we know best" in the same headline. The so-called caring posture, scaled up and shipped as the upgrade.

I wrote about why that posture is the hardest model behaviour to see clearly, and the loop now being built to amplify it.

I would value this community's read especially.

Here: https://medium.com/p/9143b05343af