Hot Jobs

Hadoop Engineer

Sunnyvale, CA 94085

Post Date: 02/01/2018 Job ID: 8238 Industry: IT Operations Pay Rate: Not Specified
We are seeking a solid Hadoop Operations Engineers focused on operations to administer / scale multi-petabyte Hadoop clusters and the related services that go with it. These roles focus primarily on provisioning, ongoing capacity planning, monitoring, management of Hadoop platform and application/middleware that run on Hadoop.

Key Qualifications:
*Responsible for maintaining and scaling production Hadoop, Kafka, and Spark clusters.
* Deep understanding of Hadoop/ Spark stack and hands on experience in resolving issues with Hadoop/Spark Jobs
* Responsible for the implementation and ongoing administration of Hadoop infrastructure including monitoring, tuning and troubleshooting.
* Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
* Able to support Shift plan with some odd hours coverage on a weekly basis
* Triage production issues when they occur with other operational teams.
* Conduct ongoing maintenance across our large-scale deployments across the world.
* Write automation code for managing large Big Data clusters
* Work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services
* Participate in the occasional on-call rotation supporting the infrastructure.
Hands on to troubleshoot incidents, formulate theories and test hypothesis, and narrow down possibilities to find the root cause.
* 4-8 years+ Operations Engineering * 2-5+ years with Hadoop/ Spark debugging experience in production, in medium to large clusters. * Hands on experience with managing production clusters (Hadoop, Kafka, Spark, more). * Strong development/automation skills. * Must be very comfortable with reading and writing Python or Java code; and Scala experience would be a huge plus * Tools-first mindset. You build tools for yourself and others to increase efficiency and to make hard or repetitive tasks easy and quick. * Experience with Configuration Management and automation. * Organized, focused on building, improving, resolving and delivering. * Good communicator in and across teams. * Familiarity with geo spatial data would be a huge plus

Not ready to apply?

Send an email reminder to:

Share This Job:

Related Jobs: