Job Description:

eBay is looking for talented Engineering Leaders who have a passion for building and shipping great software. You will be responsible for hiring and leading teams of ultra talented engineers and for driving innovation on Hadoop Product Development

eBay has one of the largest Hadoop Deployments in the world with over 8000 nodes and 200 Petabytes of configured storage. We are actively looking for people with expertise in Hadoop Storage and Compute. We partner with Hadoop Distribution Vendors including Cloudera and Hortonworks to build Enterprise ready features in Hadoop.

SQL-on-Hadoop: SQL Compliance for multiple SQL-on-Hadoop solutions such as Hive on Tez, Spark SQL and enable smooth transition of SQL workloads onto Hadoop.

Hadoop Storage Efficiency: Dynamic movement of data across different storage tiers within HDFS. True Multi-tenancy and partitioning of namespaces across different tenants in Shared Clusters.

Hadoop as a Service: Cloud provisioning of Hadoop with elastic capacity and bare metal Docker container based deployment.

If you are a ninja software engineer, have worked on large scale distributed systems and platforms, have built nothing but A+ teams, have an insatiable desire to create great products with a no-nonsense attitude, this is the perfect job for you.

Primary Job Responsibilities

The Cool Stuff:

Be part of the mission to enable the next generation of Hadoop platform at eBay.
Work in small groups of extremely talented and dedicated individuals in a fast-paced environment.
Design and implement differentiated production-grade features like security, high availability and multi-tenancy.
Build the next generation resource and workload management, scheduling and administration capabilities with YARN.
Improve performance of MR1, MR2 and YARN for real-time customer use-cases across 1000s of nodes and petabytes of data actively contribute to Apache opensource community and work towards becoming Apache committer.

Job Requirements

The stuff you'll need to succeed:

Passionate about learning new technology, take pride in code quality and a self-starter
Strong Java background building enterprise-grade systems software
Experience building and delivering multi-threaded scalable and distributed systems
Strong system-level troubleshooting skills and ability to identify and resolve performance and scalability bottlenecks.

Basic Qualifications

The stuff that would be nice to have:

Experience with scalable systems design and implementation
Familiarity with Apache Hadoop, HBase, Spark or other open source projects
BS/MS degree in Computer Science or equivalent experience

Passionate about learning new technology, take pride in code quality and a self-starter
Strong Java background building enterprise-grade systems software
Experience building and delivering multi-threaded scalable and distributed systems
Strong system-level troubleshooting skills and ability to identify and resolve performance and scalability bottlenecks.