Hacker News .hn
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
lostmsu
27 days ago
|
parent
|
context
|
favorite
| on:
Speculative KV coding: losslessly compressing KV c...
27B does, the op was talking about consumer use of DS v4 Flash, that's 160GB.
zozbot234
26 days ago
[–]
It has been quantized to 80GB (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model, and especially useful in a size range where few "native" models exist.
lostmsu
26 days ago
|
parent
[–]
> (2-bit quantization for experts) with limited degradation. Certainly competitive with a 27B model
Uh-huh...
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
