Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

While you might not want to do this with actual Twitter, any sort of high-performance computing workload can run substantially faster on a single optimized machine than on a distributed computing environment.

I learned this the hard way when I was running a medium-sized MapReduce job in grad school that was over 100x faster when run as a local direct computation with some numerical optimizations.



Obligatory "you don't need Hadoop": https://news.ycombinator.com/item?id=14401399




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: