That's just the problem: A.I. doesn't know. It regurgitates whatever data was used to train it. The old "garbage in, garbage out" problem is combined with an unthinking algorithm generating the facsimile of information. It hallucinates because it knows what form the requested response should probably take, but not what content it needs to have, much less any deep analytical tools or verification processes. That's why lawyers relying on A.I. assistants keep submitting briefs which cite nonexistent cases, and journalists infamously published a "summer reading" list including books which haven't been written.
RE: A.I. Slop and My Thoughts