Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yeah for some reason AI energy use is so overreported. Using chatgpt for query does not even use two order of magnitude less energy compared to toasting a bread. And you can eat bread untoasted too if you care about energy use.

[1]: https://epoch.ai/gradient-updates/how-much-energy-does-chatg...



How many slices of toast are you making a day?

If you fly a plane a millimeter, you're using less energy than making a slice of toast; would you also say that it's accurate that all global plane travel is more efficient than making toast?


1-2 slice a day and 1-50 chatgpt query per day. For me it would be within same order of magnitude, and I don't really care about both as both of them are dwarfed by my heater or aircon usage.


From my estimation each second of gpt eats about 0.5-1.5 watthours


You can say it takes 1800-5400 W. Not sure where you are estimating it from.


Depending on what you're doing its taking up to 8GPUs working in parallel to serve those queries.


Yes but then the batch size is in 100s or even 1000s. These GPU doesn't serve just 1 user at a time.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: