Hadoop2010: Honu at Netflix

allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21080464&autoPlay=0'>

iPod: Download high-resolution version

Netflix moved a large portion of their infrastructure to the cloud to meet reliability, scalability, and availability requirements. As the number of instances running in the cloud increase, the standard way of moving log files or loading log events to a database starts saturating the system. Latency/thruput becomes unusable for its operational needs. Honu is the new streaming log collection and processing pipeline in the cloud for Netflix, and it leverages the computational power of Hadoop/Hive to solve its log analytics requirements.

Baycat logo Media Production by BAYCAT, a non-profit community media producer that educates and employs underserved youth and adults in the digital media arts.