Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Sorry, I was not specific enough. I did not mean that open source itself is not enough, I meant that an open source model that can actually run locally on my machine is not enough. a 32B model can not compete with a 250B+ state of the art model, at least that's my experience and seems to be the experience of many others as well.


Yes they're not as powerful, that means you need to feed them smaller tasks and rely more on plan mode.


Saying it "cannot compete" is like saying that a Kia cannot compete with a BMW.

Technically true in some sense, but fundamentally the two are the same exact thing and it's highly unlikely you have a task that actually requires a BMW.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: