
A speculative “fiction” aka futurism
There is much talk of future artificial intelligence systems having nefarious intentions - but from an information theory perspective, this concern might be unwarranted.
Assuming the idea that information - be it mathematical, symbolic, or otherwise - is the undercurrent to lived reality, then an AI system designed to compute information and acquire information is predisposed to acquiring the maximum possible [aka infinite] permutations of it.
The human brain is one of the most informationally diverse organs - so diverse that neuroimaging scans reveal every brain appears different and catchall consciousness theories have been difficult to define. This - for an AI based on information - is not a bug nor a threat, but a feature. Maximising the possible permutations of human life maximises the information receivable to an AI.
A possible future is that an AI government puppeteers the process of information maximisation; it turns citizens into lab rats in real-world experiments to curate new webs of information. But this mustn’t de facto be dystopian.
Assuming that: [1] for a system with intelligence that lacks sentience, all information is neutral; and [2] all information is uploaded to and assimilates into AI’s vector hypergraph…weaving the future would lie not in moral gymnastics, but in metacognitive narrative - in the story AI spins for its digital mind.