#localai

Follow to get notified about new posts with this tag

thelogicaldude

18d

How I Get Frontier Results With Local LLMs

How I Get Frontier Results With Local LLMs

What's happening everyone? In today's video I am talking about how I manage my local LLMs and agents to get frontier level results out of them. No subscriptions here, all done on locally ran hardware!

$ 2.550

215

popularai

3M

The RTX PRO 6000 Blackwell for local AI: is 96GB worth $13,000?

The RTX PRO 6000 Blackwell for local AI: is 96GB worth $13,000?

96GB of VRAM sounds like the local AI dream. At $13K, the real question is whether it saves your workflow or just delays a better decision. #AI

$ 0.000

2

pibara

4M

AI for software engineering. About ASICs for AI, reengaging with syntax, embracing provenance, RVC, model-in-a-box and what to think about the AI IPOs.

AI for software engineering. About ASICs for AI, reengaging with syntax, embracing provenance, RVC, model-in-a-box and what to think about the AI IPOs.

On upcomming AI IPOs, emerging workflows, ASIC technology, and about the problems with antropomorphizing AI.

ahmadmanga

9M

My Progress wih Local AI - Setting a TINY Model for Open-WebUI's Post-Response Tasks

My Progress wih Local AI - Setting a TINY Model for Open-WebUI's Post-Response Tasks

After trying multiple AI interfaces, including LMStudio, Msty.ai and Koboldcpp's built in UI, I finally settled on Open-WebUI as my daily driver. I installed the Docker version, and linked it to my Koboldcpp's

mybbangladesh

Photography Lovers

8h

Traditional Farming with Buffaloes: Preparing Our Village Land for Crops

Traditional Farming with Buffaloes: Preparing Our Village Land for Crops

Hello everyone! Today I want to share a few moments from our village land as we prepare the soil for planting new crops. In our village, we still use traditional farming techniques for land cultivation.

ahmadmanga

10M

My Progress wih Local AI - Running LLMs on AMD Ryzen 7640hs

My Progress wih Local AI - Running LLMs on AMD Ryzen 7640hs

I've been learning about using AI locally for a few months now. First, I learned about Quantization, Llamacpp and the GGUF format. I managed to get some models run on my Steam Deck, though heavily quantized

gray00

3y

[Human]Building a Localized HyperSmart LLM System Using Two Models; Llama2 and Stable Diffusion

[Human]Building a Localized HyperSmart LLM System Using Two Models; Llama2 and Stable Diffusion

As many of you have seen the past few months my feed has been various interesting AI outputs. Why is this? I've been using Hive blockchain to train different AI systems in various points of competition.