Hadoop helps Yahoo! Mail reduce spam for over 300 million people. In the second part of their talk, Mark Risher and Jay Pujara, Yahoo! Mail technologists and spam cops, describe how they are using Hadoop to fight botnets.
Mark and Jay explain how Hadoop makes it possible for Yahoo! Mail to quickly analyze huge sets of data to identify where spam comes from. They describe how team members can quickly come up to speed and submit queries on the data using Pig, and how they see this effort evolving. Listen in as they describe their experiences: