ML Software Engineer
Our team builds ML-inference applications and services on Apple Silicon in the datacenter, specifically focusing in recent years on generative AI as part of the Private Cloud Compute component of Apple Intelligence.
As part of the team you will help engineer continuous improvements in stability and performance for private cloud compute, as well as help implement entirely new functionality as it emerges from the research community, in collaboration with product teams throughout Apple.
We write performant and scalable frameworks (in Swift and C++) to distribute and coordinate ML inference tasks to different hardware acceleration IP blocks on different SoCs.
We’re a collection of highly skilled and friendly engineers who value each other’s opinions and experience. We strive for excellence and believe strongly in the quality of our output. We have formed a team of domain experts who specializes in specific core subject areas, and also have broad experience of cloud software services and platforms.
You will integrate inference code into a full service stack to ensure that user traffic is served reliably and performantly, and will have a strong focus on developing code that is easy and safe to develop, update and monitor.
- Experience working as a software engineer on large production systems
- Experience programming in: Swift, C, C++, iOS/macOS or XCode
- Practical experience running machine learning models and evaluating them for quality and performance metrics
- Bonus qualification: familiar with Apple ML stack (ANE, CoreML, MPS/Metal), high-level general distributed ML stack (PyTorch-distributed, NCCL) and high throughput inter-chip communication systems.
- Bonus qualification: on-device iOS development
- EDUCATION & EXPERIENCE
- B.S. in Computer Science or other numerate subject, with 6+ years experience; or - M.S. in Computer Science or other numerate subject, with 4+ years experience
- ADDITIONAL REQUIREMENTS
- Quality focus - produce reliable, maintainable, deliverable software - Comfortable diving deep - working across multiple levels of abstraction - Good at handling relationships & communication - collaborate well with colleagues across a wide range of functions Advancement opportunities to all applicants, including minorities, women, protected veterans, and individuals with disabilities. Apple will not discriminate or retaliate against applicants who inquire about, disclose, or discuss their compensation or that of other applicants. Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you are applying for a position in San Francisco, please click here. Apple participates in the E-Verify program in certain locations as required by law. Learn more. Apple's committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Learn more. Apple is a drug-free workplace. Learn more.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.