Advanced reasoning models are hallucinating even more
I am observing a pattern where advanced reasoning models try to over hypothesize, explore too many edge cases, and infer hidden intent, which generates very long chains of logic. If the advanced reasoning model doesn't know something, it tries to interpolate and come up with a coherent explanation, even if it is not fully correct. Additionally, for a retrieval-based task, the models start reasoning instead, leading to hallucinations. This usually happens when the prompts are too ambitious and the context window is too large. Curious to see if others are observing similar patterns