Claude Fable solved open physics problems about related to Schrödinger–Newton equations. Is it hallucinated or legit?

I saw some criticism in a Wikipedia article on the Schrödinger-Newton Equation, specifically about Penrose's ideas about quantum gravity, and it seemed pretty easy to solve (the article hinted at possible solutions, etc) which made me think that it could be interesting to let Claude try to solve it. It now claims to have solved all the 3 problems outlined in the article.

The issue is that I have no way of validating if the result claude gave me are hallucinated or legit. If the solutions are correct, then maybe it's useful to someone, and if not then I/we might learn something from that explanation.

Artifact (look here first): https://claude.ai/code/artifact/e871ae13-54d1-437c-a489-cad81617c06d

GitHub repo, including all the raw transcript etc: https://github.com/henke443/penrose-1

Latex paper: https://www.overleaf.com/read/hgmnyqgqtwqz#80a24a

reddit.com
u/henke443 — 1 day ago
▲ 1 r/AINewsAndTrends+1 crossposts

Claude Fable is amazing, but still fundamentally flawed.

The top rated post on this subreddit currently is Fable one-shotting a horror game and I've seen lots of other posts praising it's ability to "count the number of Rs in strawberry" and correctly deducing that it's better to drive 50m to the carwash than to walk there. I agree it's really impressive, and AI has already changed the world, both for good and for bad (and I hope that in the future it will be more for good).

But, I still hold firm to my belief that current LLM technologies using transformers is fundamentally flawed in a way that I think might prevent it from ever becoming super-intelligent or even useful without having to "babysit" it, at least when it comes things like having actual financial utility.

I can't come up with a good explanation or a way to describe the issue without me sounding super arrogant and/or stupid, so the best I can come up with is an example.

Here's a screenshot from my second ever question to Fable, on the Max effort setting:

https://preview.redd.it/vk58ecn5me6h1.png?width=2050&format=png&auto=webp&s=891a44d7194a2894abd39b1eed728fb746f94053

The first question was: "Based on what you know about me and what you can find out about me, what would be the best way for me to make money in the next 5 years?"

It's a very hard question obviously, but the way it chose to answer it was just to rely on "What you know about me" instead of asking me questions like a human would have done. Not only did it only rely on it's extremely limited dataset on me and my professional skills and projects, which a somewhat intelligent human would never do, it also choose to appease my ego and hype up my shitty projects. When I challenged it even mildly then it immediately backpedalled on everything as you can see in the screenshot.

reddit.com
u/henke443 — 2 months ago

The way the Asian shop packed my package

The candy pieces were disturbed by me. The piece of cardboard was the only thing they needed to make it fit completely perfect.

u/henke443 — 3 months ago