RE: RE: How I Get Frontier Results With Local LLMs
You are viewing a single comment's thread from:

RE: How I Get Frontier Results With Local LLMs

ahmadmanga(75)
Published in
Threespeak
Words
38
Reading
1 min
19d

I haven't tested it enough yet, but Ling3.0-tiny seems like a great fit for 8B VRAM... There's also Gemma4-12B that could fit in there without offloading, but from my testing, it's not as good as the MoE models.

via 3speak
This post was published via 3speak. Ecency is not the originator or editor of this content and displays it for discovery purposes only.
1