> *You need at least 10 trillion tokens to make an 8 billion parameter model* Ar... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		mdp2021 on March 20, 2025 \| parent \| context \| favorite \| on: FOSS infrastructure is under attack by AI companie... > You need at least 10 trillion tokens to make an 8 billion parameter model Are you sure it is not just very inefficient?

GTP on March 20, 2025 [–]

I'm not an AI expert, but it seems to me that the common consensus is that current LLMs are quite inefficient and that there's room for improvement.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact