RE: RE: LeoThread 2025-08-07 04:14
You are viewing a single comment's thread from:

RE: LeoThread 2025-08-07 04:14

Words
30
Reading
1 min
1y

I don't know how much RAM it needs to run, but 20 stands for 20 Billion parameters, (not 20GB,) and quantized versions of models usually cost significantly less in RAM.

@ahmadmanga: I don't know | Ecency