Phonellama

Not to long ago I talked about my custom deerflow setup for my local AI and how I hocked up my main computer to it, it has a 16 GB GPU and it's AMD based but non the less could load up some decent models, the idea is not to use it on it's own, I am also doing the same thing for my phone it too has reasonable processing power and can run some smaller models.

Anyway so I started out with getting the Termux app on my phone it lets you run a Linux shell, I was trying to get llama.cpp setup on it and serve up an API so that my deerflow can connect and use it, I was struggling and even tried to get gemini AI on the Termux to help out I made it happen but I was only able to use the phones cpu not it's gpu chip making it more or less unusable, I tried and tried but no luck.

Then I though hey google got the edge gallery app that lets you run local AI models on the phone and that app lets you use the GPU, the only issue is that the app has no API function but the good news is that it is open source.

And so I started to mod the google app into phonellama to do just that instead of waiting for google to maybe release that feature.

I am still working out some kinks but it is working, but why you may be asking what is the point you got your server with 2 nice GPU why bother with our main computer 16 GB and the phone... well I am thinking of having the main computer gpu and the phone be sub agents and get assigned task by another model running on my server, that way I can get some more AI workers to get things done faster.

Anyway I will probably release this too the public too when I am done who knows maybe google can hire a mofo sheeeet

I am a financial advisor ! If you can't take personal responsibility for you investing, I hate to brake it to ya, but you ain't nothing but a sucka, you supposed to lose your shit.

Hive account@bitcoinman's bits of wisdom

• Invest only what you can afford to lose and be mindful of the potential risks.
• Unless you can accept delivery stay away from futures and stick to physical.
• Leverage is a great tool for losing money fast.
• Numismatics for the lows stick to smart stacking baby.
• Be cautious of new schemes in crypto, like ICOs, DeFi, and NFTs, do your research before investing.