Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Tried it within LMStudio on my m4 macbook pro – it feels dramatically worse than gpt-oss-20b. Of the two (code) prompts I've tried so far, it started spitting out invalid code and got stuck in a repeating loop for both. It's possible that LMStudio quantizes the model in such a manner that it explodes, but so far not a great first impression.


Are you using the full BF16 model or a quantized mlx4?


Not sure what the default is – whatever that was. It's probably the quantized mlx4 if I had to guess.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: