From my estimation each second of gpt eats about 0.5-1.5 watthours | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		KaiserPro 24 days ago \| parent \| context \| favorite \| on: Rob Pike goes nuclear over GenAI From my estimation each second of gpt eats about 0.5-1.5 watthours

YetAnotherNick 24 days ago [–]

You can say it takes 1800-5400 W. Not sure where you are estimating it from.

KaiserPro 24 days ago | [–]

Depending on what you're doing its taking up to 8GPUs working in parallel to serve those queries.

YetAnotherNick 24 days ago | | [–]

Yes but then the batch size is in 100s or even 1000s. These GPU doesn't serve just 1 user at a time.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact