Hadoop Bay Area User Group – April 21st at Yahoo!

Hi Hadoopers,

I'm excited to invite you to the next Hadoop Bay Area User Group, April 21st, 6PM at the Yahoo! Sunnyvale Campus.

The Hadoop community is growing at a considerable rate. We had more than 200 attendees at the last meetup.
It was our largest turnout ever and people stuck around until 9 pm.

We invite you to attend whether you are an active submitter, developing Hadoop-based applications or completely new to the Apache Hadoop world. In addition to interesting presentations you will enjoy food, beer and great networking.

We have a diverse plan for this event, comprised of three sessions:

  • Vishwanath Ramarao, Director of Engineering for Yahoo! Mail, will discuss the extensive use of Hadoop to detect and mitigate spam attacks. In this exciting session titled "Yokai and the Elephant", Vishwanath will describe the cat-and-mouse fight against insidious spammers and the considerable impact of Hadoop in areas of abuse and security.


  • John Sichi will discuss Facebook's recent integration of two related projects in the Hadoop ecosystem: HBase and Hive. This integration gives powerful SQL query capabilities to HBase, and brings the potential for low-latency incremental data refresh to Hive. John will go over use cases, the current state of the integration, and ongoing improvements planned.


  • Ken Krugler from Bixo Labs will discuss the Public Terabyte Dataset project - a large-scale web crawl that uses SimpleDB, Hadoop, Cascading and Bixo on Amazon's EMR cloud. Ken will cover the architecture, problems encountered and solutions developed for running this type of Hadoop data collection & processing workflow


For those of you who are not able to attend in person the session's slides and video recording will be posted on this blog after the event. Stay tuned!


Please RSVP at the Hadoop Bay Area Meetup page

Don't forget to register early and submit session proposals to Hadoop Summit 2010 on June 29th at Santa Clara. Space is limited!

Looking forward to see you all soon.

Dekel Tankel
Director, Product Management
Cloud Computing at Yahoo!