Small LLMs Running on CPU 🤖 Tested `Fijik1.5 2.6B A380M` and `SmallThinker 4B ...
Words
28
Reading
1 min
Listen
Play
7M
... A600B` recently. For now SmallThinker gives way better results and is mostly coherent for its size, even at Q4 compression. #technology #stemgeeks #stem #lolz