Siri - Manager, QE Process & Analytics

Santa Clara Valley (Cupertino), California, United States
Software and Services


Posted: Nov 5, 2018
Weekly Hours: 40
Role Number: 200004241
This leadership position will define Quality Engineering process, establish key success metrics for quality of development process, and for quality of Siri product, and drive such process adoption and fulfillment. The key deliverable is a comprehensive embedded data-driven QE process which focuses on Siri experience as a whole. In this role, the manager will work closely with Siri Engineering leaders and with Siri Data & Analytics leaders, as well as with our partner teams at Apple. This role oversees and builds up two key areas of Siri QE: Process and Analytics.

Key Qualifications

  • 8+ years managing a BI / Metrics / Data Analytics organization
  • 5+ years as Individual Contributor Engineer - Hands on experience in CI, Tools, Automation
  • Provide examples of quality measurements with targeted definitions, goals and Metrics
  • Experience with driving operational and quality excellence in a large corporation via metrics and analytics
  • Strong knowledge of MS SQL, HiveSQL, Hadoop
  • Industry experience in similar roles at large scale companies
  • Excellent problem solving and communication skills
  • Able to give multiple examples of creativity and critical thinking on the job
  • Provide regular updates to organization groups as well as VP-level management
  • Ability to lead large teams, develop long term vision and execute strategies at scale


Key deliverables for QE Analytics: • Establish and define test health requirements: coverage, relevance and test count targets • Own and define test results scoring methodology • Develop and own QE process and QE metrics for logging validation • Define releases qualification, complete with reporting and trend analytics • Own consolidation and analysis of QE key metrics reporting of key trends • Bridge pre-release QE and Human Eval metrics in Production • Define, measure and drive QE operational metrics; identify and drive tool and automation initiatives to improve operational efficiency Key deliverables for QE Process: • Develop and drive QE process strategy, key success metrics and embedded quality workflow • Own definition and communication of quality processes to Siri teams • Define RCA process, establish lines of failure triage ownership between QE and Engineering • Work with Siri QE Org Partners to ensure QE processes align with Org level processes and future vision • Align QE Process with the test automation strategies and tools requirements for functional QE Teams

Education & Experience

MS/BS in Computer Science or equivalent work experience.

Additional Requirements