Software Development Engineer - Data Platform
The Apple Services Engineering (ASE) team is one of the most exciting examples of Apple’s long-held passion for combining art and technology. We are the people who power the App Store, Apple TV and Sports, Apple Music, Podcasts, and Books along with Cloud and Infrastructure Services platforms.
As part of Apple Services Engineering (ASE), you will have a meaningful role in designing, developing, and deploying high-performance systems that handle millions of queries every single day. This enormous scale brings challenges that require extraordinarily creative problem-solving. By focusing on and respecting the customer's needs, you'll be responsible for helping us build the technology that works for so many customers around the world.
As a Senior Software Engineer on the Apple Data Platform Spark team, you’ll play a pivotal role in shaping the backbone of our data processing capabilities, directly impacting the experiences of our vast global customer base. You’ll work with innovative technologies to build and optimize scalable, high-performance systems that support a variety of critical services across Apple. This is a unique opportunity to influence the architecture and direction of our platform, collaborating with world-class engineers in an environment that values innovation and strives for continual excellence. Join us and help power the real-time analytics and insights that drive one of the world’s largest tech ecosystems.
What you can expect to do and contribute to:
• Develop and deploy new features of Apple’s internal data platform.
• Regularly contribute to open source.
• Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention.
• Optimize our cloud-based services to ensure they scale effectively, handling increasing loads while maintaining high performance.
• Innovate on API development and integration, enabling seamless communication between our applications and services.
This is an opportunity to join a dynamic and evolving team where your contributions will shape the future of our Apple’s technology landscape.
- A successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems.
- Experienced Poweruser of Apache Spark or Committer to Apache Spark.
- BS or MS degree in computer science or equivalent professional experience.
- Knowledge of Spark accelerators, e.g. Velox/Gluton or Datafusion/Comet.
- Experience working on or building connectors from Spark to any of the data sources.
- Knowledge of Yarn, Kubernetes or other compute substrate.