For that to be useful, AI would have to evolve out of the current stage of being a parrot who got raped by an infinite amount of monkeys.

LLMs only know what we tell them. And they need human input, or they break.
https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf