Hack India: Hyderabad — It’s a Wrap!

Hack India: Hyderabad — It’s a Wrap!

The energy at the 6th edition of Yahoo! Hack in India was electrifying as we counted down to the close of hacking at Yahoo! Hack Hyderabad, 2013. Over…

Internal Hackday Produces Record-Breaking 300 Hacks

Internal Hackday Produces Record-Breaking 300 Hacks

Yahoo! has been hosting internal Hackdays since 2005, and the traditio…

Demand is High for Yahoo! Hack India: Hyderabad

Demand is High for Yahoo! Hack India: Hyderabad

Photo credit to Reid Burke Since 2007, YDN has been hosting amazing Ha…

  • allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21232308&autoPlay=0'>

    iPod: Download high-resolution version

    The MapReduce framework is now a de facto standard for massive dataset computations. However, many of the elementary graph algorithms are inherently sequential and appear to be hard to parallelize (often requiring number of rounds proportional to the diameter of the graph). In this talk, Sergei Vassilvitskii, Yahoo! Labs, describes a different approach, called filtering, to implementing fundamental graph algorithms, like computing connected components and minimum spanning trees. He notes that filtering can also be applied to speed up general clustering algorithms like k-means. Finally, he describes how to apply the technique to find tight-knit friend groups in a social network.

    Media Production by BAYCAT, a non-profit community media producer that educates and employs underserved youth and adults in the digital media arts.

    Read More »from Hadoop2010: XXL Graph Algorithms
  • Yahoo! India Research & Development has been making great progress in the field of accessibility. In one of my earlier blog posts, I mentioned some of the initiatives that were undertaken by the Yahoo! Bangalore office. The successful collaboration between product, engineering, and quality teams to make the Yahoo! properties more usable to the widest audience possible is seeing signs of success over the past year.

    In recognition of these efforts, the National Center for Promotion of Employment for Disabled People (NCPEDP), in association with AccessAbility and BarrierBreak Technologies, has awarded the NCPEDP - Mphasis Universal Design Company Award to Yahoo! India R&D! for the year 2010. This award was given to Yahoo! India in the category of companies or organizations who have taken up the cause of accessibility and universal design.

    As mentioned on their website, Universal Design benefits every human being to some degree at some point of time. Universal Design has attained major

    Read More »from Yahoo! India wins 2010 Universal Design Awards
  • allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21120816&autoPlay=0'>

    iPod: Download high-resolution version

    The field of genomics is of increasing importance to research and medicine. As the physical cost of DNA sequencing continues to drop, biologists are collecting ever larger data sets, requiring more sophisticated data processing. Hadoop is an excellent platform on which to build a consistent set of tools for genomics research. In this talk, Jeremy presents a general framework for working with genomic data in Hadoop, and provide details on implementations for many common operations, including a novel mechanism for de novo DNA sequence assembly. Hhe discusses how this open source genomics platform can be leveraged by researchers to reduce repeated effort and increase collaboration

    Media Production by BAYCAT, a non-profit community media producer that educates and employs underserved youth and adults in the digital media arts.

    Read More »from Hadoop2010: Hadoop for Genomics
  • allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21120805&autoPlay=0'>

    iPod: Download high-resolution version

    Over the next few years Biometric databases for the Federal Bureau of Investigations (FBI), Department of State (DoS), Department of Defense (DoD) and the Department of Homeland Security (DHS) are expected to grow to accommodate hundreds of millions, if not billions, of identities. As these biometric systems grow, distributed computing platforms such as Hadoop/MapReduce may be a feasible solution to this potential problem. This presentation outlines the magnitude of the problem, and evaluates algorithms and solutions using Hadoop and MapReduce. Open source biometric algorithms include BOZORTH3 (fingerprint matching) and IrisCode (Iris Scan matching), and how they can be optimized for deployment over Hadoop/MapReduce are also discussed.

    Media Production by BAYCAT, a non-profit community media producer that educates and employs
    Read More »from Hadoop2010: Biometric Databases and Hadoop
  • On July 30th, we started hosting Coding Dojo São Paulo community meetings at Yahoo! Brazil's office.

    For those who are not familiar with it, a Coding Dojo is a meeting where a bunch of coders get together to work on a programming challenge. They are there to have fun and to engage in deliberate practice to improve their skills. This is an awesome event at which to learn new algorithms, programming languages, and tools, and to hang out with other programming geeks.

    Our first meeting had around 30 people (including an American who was visiting Brazil and wanted to participate in a Dojo). There were many proposals of problems to solve, but everybody ended up deciding to solve a simple problem (write numbers to words). This was so the many participants who didn't know the Python programming language beforehand could learn it, while also focusing on the solution. It's usually like that: you pick a more complex problem to solve in a language in which you are proficient, or you pick a

    Read More »from Coding Dojo São Paulo
  • Every Thursday is Tech Thursday and we bring you some cool links from the world of technology.

    Read More »from Tech Thursday – Another IE9 preview, Main frames and Rick
  • allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21120818&autoPlay=0'>

    iPod: Download high-resolution version

    In this session, Shevek discusses and presents solutions to the challenges most frequently encountered during development and deployment of MapReduce applications. The session content reflects the result of scouring customer mailing lists, forums, and user comments for the most common application development problems and questions. Be ready to walk away with practical answers to the most frequently encountered problems with developing MapReduce and Hadoop applications -- and some uncommon ones you may hit as well.

    Media Production by BAYCAT, a non-profit community media producer that educates and employs underserved youth and adults in the digital media arts.

    Read More »from Hadoop2010: Addressing Hadoop Headaches
  • Girl Geek logoTuesday, August 3: I attended the Bay Area Girl Geek Dinners event #7, this time hosted by Yahoo! at our Sunnyvale headquarters. The purple carpet was duly laid for the festive, sold-out event.

    After collecting my Code Like A Girl t-shirt and sticker, I scampered to the bar for my gin-and-tonic, then wandered into the crowd to meet and/or catch up with other women in high-tech. Attendees ran the gamut from the deeply technical engineers to the technical marketing crowd.

    Aurora Skarra-Gallagher and Brenda O'KaneYahoo! had posted several demo stations, interspersed with the food table and bar, featuring technology at play here. The picture at left shows girl geeks Aurora Skarra-Gallagher (a Senior Software Engineer in the Yahoo! Open Strategy Advanced Products team) and Brenda O'Kane (a Director of Technology in YOS) ready to explain Yahoo! Query Language (YQL) &mdash an expressive SQL-like language that lets you query, filter and join data across Web services. Other demo stations included YUI, web performance, innovation at

    Read More »from Bay Area Girl Geeks: The Seventh Wave
  • One of the reasons that I like working at Yahoo!, and the primary reason I've been here six years, is the scale at which we operate. It's not so much the number of users or pages, but the hamsters running behind the scenes to power those pages.

    It's also how we manage to always stay on even when something goes wrong. We've had several outages in the past. There was once a squirrel that took out an entire data center in a suicide mision, but we managed to keep the site up.

    For this we have to thank Service Engineering and some pretty smart Business Continuity Planning (BCP) policies.

    Last Thursday, Michael Christian, Chris Westin, and I spoke about high availability at Yahoo! — slides available here (infrastructure resiliency), here (MySQL business continuity planning), and here (application resiliency).

    Laptop problems notwithstanding, we had quite a bit of fun speaking and minglng with attendees afterwards. However, Yahoo!'s real MySQL High Availability guru, Jay Janssen, wasn't

    Read More »from MySQL High Availability at Yahoo!
  • allowFullScreen='true' src='https://s.yimg.com/m/up/ypp/default/player.swf' flashvars='vid=21120923&autoPlay=0'>

    iPod: Download high-resolution version

    ZettaVox is an enterprise content-mining application that combines crawling, extraction, monitoring, and analysis in a unified solution. In this talk, Kitenga CTO and ZettaVox designer Mark Davis will demonstrate ZettaVox's capabilities on clusters and using cloud-based data resources. He will further show how ZettaVox can extend the reach of cluster-based computing solutions built on Hadoop to include commodity supercomputers based on graphical processing units (GPUs) that implement MapReduce formalisms.

    Baycat logo Media Production by BAYCAT, a non-profit community media producer that educates and employs underserved youth and adults in the digital media arts.

    Read More »from Hadoop2010: ZettaVox Mining & Analysis

Pagination

(1,582 Stories)