Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
root_axis
10 months ago
|
parent
|
context
|
favorite
| on:
The Llama 4 herd
Quantizing definitely lowers memory requirements, it's a pretty direct effect because you're straight up using less bits per parameter across the board - thus the representation of the weights in memory is smaller, at the cost of precision.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: