Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Their data is freely available to download. There are weekly dumps of the entire planet and several sources for partial data. There's no need for most legitimate use cases to scrape their API.


So problem is someone is stupid enough scraping without realizing they can just download 100gb at once?

And there are so many of such idiots that it's overwhelming their servers?

Something doesn't math here.


That's exactly the case. It's been an issue for a while.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: