AIML - Data Engineering Manager, AIML Integration & Delivery

Cupertino, California, United States
Software and Services

Summary

Posted:
Role Number:200540993
The AIML Integration and Delivery / Transparency Engineering team is looking for a Data Engineering manager. Our organization specializes in CI/CD and the delivery of AI models to servers and customer devices. Our team’s mission is to make the engineering workflow as transparent as possible for AIML engineers by providing data and engineering UIs. This requires us to produce and aggregate data from many sources, both emanating from our engineering systems and our customers' devices, process it, and guarantee its quality and reliability. We are looking for a strong data engineering manager to help us fulfill this mission by leading a global team of data engineers and software engineers.

Key Qualifications

  • 6+ years experience in architecting, designing, and developing large-scale data solutions.
  • 6+ years experience in building and maintaining large-scale ETL/ELT pipelines (batching and/or streaming) that are optimized for performance and can handle data from various sources, structured or unstructured.
  • 3+ years of experience leading data engineers and software engineers
  • Deep understanding of distributed data processing frameworks such as Hadoop, Spark, and Flink
  • Deep experience with both batch data and real-time data processing
  • Proficiency in various data modeling techniques, such as ER, Hierarchical, Relational, or NoSQL modeling.
  • Expertise in Java, Python, Unix Shell scripting, and Dependency driven job schedulers
  • Proven track record of mentoring and growing junior talent

Description

In this role, you will be leading our work building our data infrastructure as needed, leading data modeling and ETL effort, owning APIs that serve data to real-time and aggregated dashboards, growing and mentoring promising junior engineers, as well as setting a high bar for both engineering practices on the team and data quality. You will be expected to build a deep understanding of our overall engineering experience, CI/CD practices, and our data landscape and bring everything together. You will be the ultimate owner of all our data and guarantee its speed, availability, quality, and usability. You will collaborate closely with Data Scientists, UI Engineers, Backend Engineers, and Device Engineers, as well as with senior leadership. The ideal candidate is a highly motivated, collaborative, and proactive individual who can communicate effectively, adapt, and learn quickly.

Education & Experience

Bachelor's Degree or equivalent experience in computer science or a related field

Additional Requirements

  • - Outstanding ability to communicate, simplify problems, and drive towards a solution
  • - Ability to thrive in a complex and constantly changing environment.
  • - A strong sense of data ownership, being willing to guarantee data quality even if it originates from sources you don’t directly control
  • - Outstanding ability for cross-functional collaboration and driving large-scale projects
  • - Ability to work on both internal data emanating from engineering systems and very large-scale data emanating from devices
  • - Capacity to translate business requirements into technical solutions.
  • - Experienced in leading teams that write and maintain high-quality code using standard methodologies such as code reviews, unit testing, and continuous integration.
  • - Good time management skills and can incrementally deliver to tight schedules.
  • - (plus but not required) Deep Understanding of ML Processes, Operations, and Software CI/CD
  • - (plus but not required) Familiarity with Data Science

Pay & Benefits