Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
evilduck
8 months ago
|
parent
|
context
|
favorite
| on:
Ask HN: What is the best LLM for consumer grade ha...
With a 16GB GPU you can comfortably run like Qwen3 14B or Mistral Small 24B models at Q4 to Q6 and still have plenty of context space and get much better abilities than an 8B model.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: