AI/ML- ML Systems Evaluation Engineer, Siri and Language Technologies

Madrid, Madrid, Spain
Machine Learning and AI


Role Number:200421174
High-quality software and complex ML models require dynamic and sophisticated automation to evaluate and validate. The ML Systems Evaluation Engineering team within the AI/ML org at Apple is looking for an exceptional engineer to evaluate our Machine Learning systems and deliver the best customer experience. This exciting role will bring best practices, knowledge, and experience from traditional software engineering to the machine learning world, and combine the best of both to build robust, extensible and efficient systems and processes to evaluate ML at scale. In this role, you will have the opportunity to design, plan and implement the evaluation strategy of cutting-edge client based ML products. You will work closely with software engineers to enhance evaluation methodology to build fast and secure client based ML products. You will operate in a highly cross-functional environment to keep pushing the boundaries of existing automation and ML evaluation. If you are committed in delivering first class customer experience, and you have a background in both traditional software and machine learning, this role will give you an exciting opportunity to apply your skills to an entirely new problem space.

Key Qualifications

  • Proven ability to define/design/develop/maintain end-to-end advanced engineering systems to support automation using any combinations of Swift (XCTest), Objective-C, Python or Java
  • Hands-on experience in defining evaluation plans with clear understanding of quality gates and metrics
  • Solid experience with CI/CD automation tools such as TeamCity or Jenkins
  • Ability to think outside the box for solving complex problems and to explain proposals to stakeholders
  • Strong organizational skills and experience working on large multi-functional teams


We are looking for a motivated and results-oriented individual with positive attitude who has excellent communication and problem-solving skills. You must enjoy working on multiple concurrent projects in a fast-paced environment that nurtures growth, collaboration, and innovation. Some of your responsibilities will include: -Write reliable, efficient and reproducible tests using XCTest for Xcode projects to achieve optimal automation coverage -Define and implement an evaluation strategy, with a strong emphasis on automation, to achieve high efficiency, scalability and sustainability, for both existing and upcoming features -Create and maintain stable fully automated processes for regular product releases through our CI/CD platform -Participate in hands-on evaluation work throughout the entire development cycle -Proactively communicate with other engineering teams to promptly fix issues -Contribute to project requirements and define a plan to execute timely Apple's most important resource, our soul, is our people. Apple benefits help further the well-being of our employees and their families in meaningful ways. No matter where you work at Apple, you can take advantage of our health and wellness resources and time-away programs. We’re proud to provide stock grants to employees at all levels of the company, and we also give employees the option to buy Apple stock at a discount — both offer everyone at Apple the chance to share in the company’s success. You’ll discover many more benefits of working at Apple, such as programs that match your charitable contributions, reimburse you for continuing your education and give you special employee pricing on Apple products. Apple benefits programs vary by country and are subject to eligibility requirements. Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace.

Education & Experience

B.Sc. or M.Sc. in Computer Science, Computer Engineering or related field.

Additional Requirements

  • *Experience with Apple ecosystem
  • *Experience in end-to-end evaluation for machine learning models and products
  • *Experience with troubleshooting automation runs in 24/7 lab environment
  • *Experience with logging and debugging tools i.e., Grafana, Splunk, shell scripting
  • *Ability to debug issues specially in Unix base embedded software