Thanks to the 125 or so developers who came to Yahoo! recently for our monthly Hadoop User Group meeting, in spite of the Giants' World Series baseball game. The conversations continued before and long after the formal sessions.
The event started with a presentation on state-of-the-art productivity tools for developers and analysts by Ben “Shevek” Mankin, from Karmasphere. Shevek talked about the challenges developers face when interacting with Hadoop programs — MapReduce, Hive, and so on. He demonstrated how to debug big data jobs on Hadoop from your desktop using familiar graphical interfaces. The graphical IDE certainly improves engineering productivity and accelerates the Hadoop job development process.
Next we had Marc Limotte talk about how Cascalog fills a need as an internal domain-specific language for map/reduce jobs. Marc talked about about how Cascalog differs from other options for creating map/reduce programs and the advantages of this option.
Finally, we are always looking for Hadoopers who will want to talk about how they are leveraging the power of Hadoop to solve their business needs. If you have any experiences you would like to share, please contact me via the Hadoop Bay Area User Group Meetup page.
See you at the next HUG, November 17, Wednesday, at Yahoo! headquarters.