Hadoop/Data Platform DevOps Engineer - Site Reliability Engineering

Vancouver, British Columbia, Canada
Software and Services

Summary

Posted:
Role Number:200325602
The Apple Media Products Engineering team is one of the most exciting examples of Apple’s long-held passion for combining art and technology. These are the people who power the App Store, Apple TV, Apple Music, Apple Podcasts, and Apple Books. And they do it on a massive scale, meeting Apple’s high expectations with high performance to deliver a huge variety of entertainment in over 35 languages to more than 150 countries. These engineers build secure, end-to-end solutions. They develop the custom software used to process all the creative work, the tools that providers use to deliver that media, all the server-side systems, and the APIs for many Apple services. Thanks to Apple’s unique integration of hardware, software, and services, engineers here partner to get behind a single unified vision. That vision always includes a deep commitment to strengthening Apple’s privacy policy, one of Apple’s core values. Although services are a bigger part of Apple’s business than ever before, these teams remain small, forward-thinking, and cross-functional, offering greater exposure to the array of opportunities here.

Key Qualifications

  • 2-5+ years of managing services in a large scale Unix environment
  • Proficient in scripting languages like Python, Shell etc
  • Experience handling Big Data Environment like Spark, Hadoop, ELK, Kafka etc
  • Experience handling data pipelines running complex AI+ML models and aggregations
  • Deep understanding and experience in one or more of - Docker, Mesos, AWS, Ansible, Puppet, Chef
  • Deep understanding of Java applications
  • Experience and understanding on Scaling, Capacity Planning and Disaster Recovery is important
  • Familiarity using Splunk, other log aggregation tools.

Description

We are looking for a dedicated Hadoop/Data Platform DevOps Engineer to handle one of the largest Big data infrastructure. The successful candidate will enjoy handling the data among distributed database systems that serve Apple services around the globe! RESPONSIBILITIES: - Engage and improve life-cycle of service from inception and design to deployment, operation, migration and sunsets - Well organized and strict alignment to SLAs - Experience working with different teams to coordinate and execute critical projects - Write, review and develop code and documentation that solves the hardest problems on some of the largest and most complex systems - Real passion for quality and automation, ability to understand complex systems and a desire to constantly make things better - Prioritize and work efficiently in a fast-paced environment - Measure and optimize system performance - Strong interpersonal skills - Demonstrate ability to deliver results on time with high quality - Share on-call rotation with the existing team members to provide 24x7 support

Education & Experience

BS in engineering, computer science or other technical disciplines (or equivalent experience) plus 3+ years of related experience

Additional Requirements