The volume of data in the Yahoo! Cloud is growing and so is the Cloud Data Platform and Services team. Do you have a passion to tackle the challenges of a computing and storage system that handles petabytes of data every day? Do you have the skills to build software and systems for monitoring and managing distributed processes on hundreds of thousands of CPU cores?
The Yahoo! Cloud Data Platform and Services team is building platforms and services to enhance the Hadoop distributed computing and storage system. This includes metadata management for business data, monitoring and system management, and platforms for efficient development of massively parallel data processing programs on top of Hadoop.
Here are some of the leading positions we are looking for:
Principal Software Systems Engineer, Cloud Data Platform and Services Grid Monitoring and Management Software
Software development of system management components for the Grid. The system management components and applications include a framework and a tool set to operate, monitor and maintain the health of all Hadoop Grid-based services, spanning Hadoop core components, ancillary services, and Grid applications. Developing this system requires a good understanding of the management of highly distributed and complex data processing systems. Sample components of the system are a high bandwidth transport for system and application events, a storage repository, alerting, correlation algorithms, inference and reporting capabilities using Java and related technologies.
Location: Sunnyvale, CA, USA
See detailed job description here.
Principal Software Systems Engineer
Challenges include designing and building high-performance, distributed and fault-tolerant implementations of data stores that can scale to handle massive amounts of data with reduced operational cost, and meet the requirements of various Yahoo! businesses. You must be a quick learner, have good communication skills, and be able to maintain ownership of large engineering projects through their lifecycle: architecture/design, implementation, testing, post-release maintenance and support. This engineer should be able to write code in Perl, C++/Java and Map-Reduce constructs in addition to excellent communication skills, both written and presentation, to evolve the vision of massively scalable data stores in the Cloud.
Location: Santa Clara, CA, USA
See detailed job description here.
About Cloud Data Platform and Services
Yahoo!’s Cloud Data Platform and Services team builds data systems infrastructure, applications and services using Hadoop and related Cloud technology components. The Cloud Data team handles a majority of data needs at Yahoo! across advertising systems and online properties that serves upwards of 500 million customers. The system is built for scale and low latency. It handles a majority of revenue generated at Yahoo! and integrates with a multitude of systems inside and outside Yahoo! Data is very important to everything we do at Yahoo! We are looking for top technical talent to help build our next generation data system by leveraging, innovating and building Cloud based technology platforms and frameworks that can form the Grid based data backbone at Yahoo!
If you find the above description exciting and you have what it takes to build software, services and platforms for the Cloud, I would be happy to hear from you and explore the possibility of joining our growing team. Please send us details about yourself.
Engineering Manager, Cloud Computing and Data Infrastructure, Yahoo!