PeteSearch: MapReduce for Idiotsurl Sunday, January 9, 2011
PeteSearch: MapReduce for Idiots
Photo by Stuart Pilbrow
I'll admit it, I was intimidated by MapReduce. I'd tried to read explanations of it, but even the wonderful Joel Spolsky left me scratching my head. So I plowed ahead trying to build decent pipelines to process massive amounts of data without it. Finally my friend Andraz staged an intervention after I proudly described my latest setup: "Pete, that's Map Reduce".
Sure enough, when I looked at MR again, it was almost exactly the same as the process I'd ended up with. Using Amazon's Elastic Map Reduce implementation of Hadoop, I was literally ab
Additional text has been truncated due to copyright reasons. Things without URLs and private things don't get truncated.