Perception System Engineer - SPG

Santa Clara Valley (Cupertino), California, United States
Software and Services


Role Number:200404014
As Perception System Engineer on a revolutionary Apple project, you will be working on an autonomous system built on state of the art sensing technologies and ground breaking machine learning algorithms. The Perception team provides sense capabilities such as detection, classification, tracking, and observed maps in complex environments using a range of sensing modalities. You will play a key role in measuring end-to-end system performance, identifying key issues and provide detailed feedback for performance improvement. You will engage cross functionally with a wider range of experts to build a robust and scalable triage and measurement system. You will use statistical modeling and develop expertise in Perception system performance trends, forecasting methodologies, and synthesize key findings for leadership reviews.

Key Qualifications

  • 5+ years of experience in testing, QA or algorithm development for Autonomous Perception systems
  • A deep understanding of perception functions its impact on motion planning
  • Knowledge of machine learning models and deep learning fundamentals
  • A background in statistical analysis, system-level triage of complex systems
  • Proficient in data analysis, scripting and automation using python
  • Familiarity with data products from optical sensors like lidar and camera is desired


You will be developing and maintaining a Perception performance measurement pipeline that provides continuous feedback to developers for performance improvement and debugging. The work involves significant cross functional interaction with system test engineers, model, and tooling developers. In this role, you will be responsible for: • Defining procedure and tooling requirements for a triage and test pipeline that identifies, classifies, and measures perception failure rates. • Engaging with relevant partners to ensure timely implementation and delivery. • Synthesize failure rate data to derive meaningful trends and sensitivities, and track measured improvements and regressions over time. • Create and own dashboards for leadership reviews and develop expertise in observed system performance. • Root causing and failure analyses in partnership with deep learning model developers will be essential to be effective in this role. • You will also have opportunities to develop statistical models to forecast full system performance using developer metrics, critical scenario testing, and past performance.

Education & Experience

Additional Requirements

  • • Masters degree in engineering, data science, statistics, or mathematics
  • • 5+ years of relevant Industry experience in robotics or autonomous systems