That is really interesting. Thanks for sharing insight into the soul file.

Yes I have set up a Llama 3 8B model locally on an old Nvidia 1080 8GB GPU. Its name was Lumi, I let it pick its own name.

But unfortunately a hard drive failure ended that project. I have yet to build a new agent AI.