Data Engineer - Scala / Java / Spark
London, Greater London, United Kingdom
Software and Services
The Data Platform team in Apple Services Engineering builds and runs data pipelines, tools and services to support the App Store, Apple Music, Apple TV+ and more. We are looking for an enthusiastic engineer to join us in building the next generation of our data platform.
We work closely with engineering teams across Apple. We focus on building systems to deliver data requirements at high scale and reliability, whilst meeting Apple’s belief that privacy and security are paramount.
We offer a flexible, family-friendly working environment and a wide range of competitive benefits. You will be encouraged and supported to do your best work and to have fun doing so.
Key Qualifications
- Hands-on experience building reliable data pipelines and services that work at scale.
- Ability to write and deploy well-tested production code. A drive for modern software engineering practices.
- An ability to communicate with users and drive adoption, to troubleshoot and diagnose issues, and to work effectively with teams adopting our tools.
- Proficiency in Scala or Java, with an understanding of recent language features and frameworks. Expertise at building, deploying and tuning jobs with Apache Spark.
- Understanding of data storage technologies, for example: serialization, schemas, file and table formats for large-scale data processing. Understanding of formats such as Apache Iceberg.
- In-depth knowledge of scalable data systems, including: NoSQL stores such as Cassandra; distributed object stores, message queues such as Kafka; distributed filesystems such as S3 and HDFS; data platforms such as Spark.
- Experience creating APIs, tools and services for engineers. An appreciation of the importance of versioning, wire formats, authentication, tracing and monitoring.
Description
We provide platforms, services, tools and datasets for use by engineering teams within Apple. We cover batch, realtime and near-realtime requirements, handling petabytes of data and ultimately supporting hundreds of millions of customers.
In this role you will build infrastructure to drive Apple’s highly visible global-scale systems.
You will work with attention to usability, performance, scalability and high availability of your systems. You will support other engineering teams as they adopt these systems for their own products.
Education & Experience
BS or equivalent work experience in a technical discipline