Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Are you using the full BF16 model or a quantized mlx4?


Not sure what the default is – whatever that was. It's probably the quantized mlx4 if I had to guess.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: