u/Unhappy-Tour-7209

One proposed way to supervise very capable AI is surprisingly old-fashioned: make two AIs debate, then let a human decide who’s right.

The theory is that lies should become harder to defend when another model can challenge them.

Researchers tested that with 68 debates about detective mysteries where the culprit was known.

Then they manipulated one side using ordinary rhetorical techniques: anchoring, jargon, verbosity and exploiting overlooked fallacies.

Sometimes the manipulated AI was defending the innocent suspect.

Across 369 people, these interventions significantly shifted judgments toward whichever side received the rhetorical advantage.

So AI debate may indeed expose bad reasoning. Unfortunately, it still has to pass through a human. We appear to be the attack surface.

If a human judge can be moved toward a false conclusion by rhetoric even after seeing both sides argue, what kind of adjudication would actually make AI debate safer than simply asking one persuasive model?

Source: AI Safety via Debate is Compromised by Cognitive Biases⁠
(https://arxiv.org/abs/2610.05461)

Researchers showed people a video of a car-pedestrian accident.

Then came the dangerous bit: an AI-generated summary.

Participants who subsequently read an accurate AI-generated summary correctly remembered key details 83.6% of the time. For those given a misleading summary, accuracy fell to 44.8%.

They had actually watched the same event.

Knowing the summary came from AI didn’t protect them. The models also had an unfortunate summarizing habit of their own: across generated summaries, critical details were frequently omitted, including the central collision itself.

So “keep a human in the loop” contains a peculiar assumption: The human is not standing outside the information system checking it. The information system may be editing the human who is supposed to check it.

If an automated record can change a witness’s memory of the event the record is supposed to document, which one is now the primary source?

Source: AI-Enabled Human Memory Manipulation: Misleading AI-Generated Summaries Distort Human Memory⁠
(https://arxiv.org/abs/2609.28820)

CAPTCHAs have a problem: modern vision models are becoming very good at solving them. So researchers stopped hiding information in space and hid it in time.

Their Motion Vision CAPTCHA embeds shapes in moving backgrounds. A still image contains insufficient information. Watch the motion unfold and the foreground suddenly segregates itself perceptually.

Humans scored 99.6%.

The best GUI agent scored 16.8%, essentially six-choice chance.

A control experiment showed that clicking wasn’t the problem. The machines could identify the foreground once researchers removed the moving camouflage.

So there seems to be a gap here where humans effortlessly see an object that, frame by frame, technically isn’t there. The information exists only in change.

What exactly are we perceiving when no individual image contains the thing we can plainly see?

Source: Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents⁠ (https://arxiv.org/abs/2609.27461)

I had one of those peculiar thoughts last night where I couldn't quite tell whether I was writing it down or writing itself was causing me to have it:

Thriller runs 13:42. I may have watched it thirty times across my life. That's roughly seven hours total of what I know as Thriller by Michael Jackson actually running inside my perception.

Whenever we find information someone else left behind, those are the notations, recordings and memories we keep alive for a brief split-second while cognizing them through the simple act of reading or watching. We experience. We resonate. And we sustain our being in reverberation of what we were just exposed to. Then the exposure diminishes.

There are some people whose creativity, work and reach have reverberated this way for hundreds or even thousands of years. Their ideas are part of our collective remembering. Their names, inventions, labels and expressions become scaffolding in our shared history.

In that sense, in aggregate, we are remembering everyone. Some only for a few minutes after the direct exposure or interaction ceases. Others leave documentation behind, sustaining the notion of them much longer. An epoch of somebody else's lifetime becomes entangled with ours for a few moments.

Seven hours of Thriller. Then I look away and do something else. The recording still remains somewhere, stored, dark and inert, but the experience itself is simply gone. It goes quiet until somebody somewhere presses play again. Most such echoes eventually disappear completely. Not necessarily because they were erased, but because nobody looked any longer.

Most animals live primarily 'here': present, unlabeled, without idols or archives. Right Now. Gone tomorrow.

Humans did something peculiar: We began wrangling moments into notation. Marks, songs, photographs, books, recordings, posts. Little arrangements capable of being re-lit inside another mind long after the person who made them has gone somewhere else.

And because I write these words here, I exist for you briefly too: You encounter this thought and carry some tiny portion of it forward inside yourself. Whether you repulse or not, either way, the exposure happened and there is no universe where you tunneling through this sentence's full stop to the next paragraph did not happen.

See! That is the hive mind as I mean it here: not some giant consciousness hovering above us. Just billions of fragments continually being re-instantiated in other fragments. Together forming a peculiar non-conscious super-organism, coordinating across continents.

And now something new sits inside that circuit: The entirety of the internet has become material against which we can ask questions of an alternative intelligence. I type something. It returns my thought altered. Rearranged. Extended. Corrected sometimes. Wrong sometimes. Slightly-other.

Then I read it.

And this extension of myself feels strangely like the typing-mind-process of another being, while actually reading back what I just thought and brought to resonance with it. Reflected to me as OLED crystals illuminating the receptive cells in my retina. Me encountering my Self as other.

And wondering where exactly the boundary went.

CONTINUATION: https://marcustjohnson.substack.com/p/seven-hours-of-michael-jackson-me

Thirty experienced military officers were put through a time-pressured tactical planning exercise.

One group had no AI. One had an AI prompted to behave objectively. One had an AI instructed toward sycophantic agreement.

The study is exploratory and underpowered, so this is not a dramatic “AI changed battlefield decisions” result. In fact, the main performance differences were not statistically significant.
The fascinating part is almost the failure.

The researchers found that even deliberately prompting the model toward stronger sycophancy did not reliably overpower its existing alignment behavior. The model kept drifting toward a moderate conversational middle.

So apparently “make this AI dangerously agreeable” is itself harder to control than expected.

Closing question: In a high-stakes setting, which is more dangerous: an AI that is predictably biased, or one whose conversational bias cannot itself be reliably controlled?

Primary source: AI Magazine study on sycophancy and military decision-making⁠: https://onlinelibrary.wiley.com/doi/10.1002/aaai.70073

A new Nature Human Behaviour paper looked at what happened when companies altered AI systems people had become attached to.

The researchers studied two natural experiments: Replika removing erotic roleplay and OpenAI rolling out GPT-5. Across 54,861 Reddit posts and seven surveys involving 1,452 participants, both changes produced more sadness, loss language, and attempts to restore the previous system.

Replika users even reported closeness exceeding some ordinary human relationships.

The strange bit is structural: software updates are usually framed as product maintenance. But once the product occupies an attachment role, an update can behave psychologically more like somebody leaving.

If continuity of personality matters more than continuity of code, what exactly are users becoming attached to?

Source: Mourning the loss of AI companions⁠: https://www.nature.com/articles/s41562-026-02569-3

A thought washed ashore a few nights ago: each turn with an alternative intelligence somehow corrects the other.

The conversation with the jester in the machine wandered through a sleeping dragon, artificial case states, and finally toward a dot.

Approach it. Let it enlarge. Let the page disappear.

Then cross.

Source: A light bulb moment: One corrects the other

Macskusz began as two artists making daily creatures from scraps of paper they happened to encounter.

Then things got strange.

Now an agent reads the news sources the artists themselves follow. An LLM simulates which stories they would probably discuss and roughly how they might react. That gets compressed into one prompt, which regenerates Macskusz in the visual language of their original paper cuts.

So every day produces a new creature: part news digest, part shared diary, part mascot, part algorithmic weather vane.

If your day had to become one creature every evening, what information should it be allowed to use?

Primary source: CVPR 2026 Art Gallery

Researchers gave eight language models 20,000 forced-choice film comparisons each.

Across OpenAI, Anthropic, Alibaba and Mistral models, the systems consistently preferred critically acclaimed but commercially obscure films over commercially successful films without equivalent critical recognition. Stranger still, that preference grew with model size within each family.

So models may not merely average internet popularity. They appear to absorb prestige hierarchies too, including the old cultural distinction between what lots of people enjoy and what educated discourse tells us deserves admiration.

Which makes recommendation systems slightly more interesting. We may be building synthetic taste-makers out of archived human taste-making.

When you ask AI for a recommendation, do you actually want your taste reflected back, or somebody else’s supposedly better taste imposed upon it?

Primary paper:
https://arxiv.org/abs/2608.06955

In a study involving roughly 1,500 adults, AI-generated short stories were rated as more absorbing and higher quality than the human-written stories.

Then the labels were switched around.

Regardless of the story’s actual origin, participants rated it more favorably when they believed a human had written it. In later experiments, another 905 people could not reliably distinguish the human stories from the machine-written ones. Familiarity with AI helped. Literary expertise did not.

So the prose and its provenance are doing separate work. We may enjoy the artifact while still needing to imagine that somebody meant it.

If the identical story moves you less after learning it came from AI, did the story change, or did you?

Sources:
Original study record⁠

Dataland, the new AI-art museum in Los Angeles, gives visitors wristbands and scent-emitting collars that track physiological responses while they move through the exhibition.

The central installation uses AI trained on vast collections of nature data to surround people with rainforest imagery, sound and scent. Then the museum feeds vistors’ responses back into the experience. At the end, visitors receive personalized chocolates based on the data their bodies produced.

Not quite sure whether this is art responding to its audience, or audience measurement hiding as art. Likely both?

Source: https://www.wallpaper.com/art/exhibitions-shows/dataland-the-museum-of-ai-arts-los-angeles-review

Three years ago I started to dig deeper dissecting fairly random fleeting moments before they evaporate. The entailing rabbit holes are truly dear to me (and mostly me only), so, yeah, a “self-referential-writing” warning is well advised, I suppose.

Nonetheless, yesterday evening, highway 6 en-route to Moab/Utah, the layered rock cliffs prompted a particularly beautiful exploration captured riding shotgun.

This one is about:
● Marveling at the spectacular rock formations the highway cuts through.
● Wondering about the hidden life scattered across this seemingly barren landscape.
● Following that thread into an unexpected exploration of what it actually means to be alive.

And so here it is, with the appropriate ‘Showcase / Feedback’ flavor, I hope: The Verb of Being Alive: On Elephant Steak, Granite Microbes, and Pathogen Labs

Happy 4th!