Search & Recommendations Quality Analyst Manager, Human Evaluation

Singapore, Singapore, Singapore
Software and Services


Weekly Hours: 40
Role Number:200203440
Are you passionate about analyzing data patterns for large scale search engines? As part of our Evaluation team, you will be a market expert and analyze of a diverse portfolio of Apple Media Product evaluations tasks. The team represents the user’s perspective as they vet new features being introduced to AMP. Your day-to-day responsibilities will include rating, analyzing, and creating innovative ideas to help improve our search features, and reporting systematic issues to statisticians and engineers.

Key Qualifications

  • A demonstrated passion for data analysis, data-informed product innovation, building and crafting data culture
  • 5+ years in a managerial role, recruiting top talent, growing, and scaling analytics organizations
  • Deep understanding of the software development for machine-learned products and services, and how analytics and human evaluation data can help improve those products
  • Ability to build relationships across multiple functions and establish strong partnerships. Outstanding communication and presentation skills, written and verbal, to all levels of an organization
  • Experience in executive reporting, and developing analytic recommendations to enable product strategy and growth
  • Strong technical approach - ability to work with engineering teams and develop sustainable solutions for meticulous analytics
  • Experience working with systems and products that are powered by machine-learned models and an understanding of natural language or speech-enabled products
  • Self-sufficient in analyzing and drawing conclusions about the quality and product opportunity from raw and refined product data
  • Self-motivated and proactive, with demonstrated creative and critical thinking capabilities
  • Strong analytical product intuition - able to use data impact-fully in guiding development of products and user experiences
  • Know how to weave definition of user experience instrumentation, the definition of success metrics, implementation and validation, into the process
  • Innate capability to, directly and indirectly, lead large teams for success


- Champion an industry-leading privacy-focused strategy for product measurement, human evaluation, and analytics - Evaluate and improve the quality of critical metrics for key products by analyzing customer problems. Empower others to understand and utilise data for decision making - Keep teams focused on the right priorities to meet tight deadlines; clearly, communicate project progress to leads and executive team - Direct supervision of staff: Performance management, career development, education, and training. Scale the team by recruiting top industry talent - Lead the development of a guideline driven human rating program that operates on a daily measurement cycle. Define what our evaluation tools should do and guide their development - Be involved in new evaluation creation with a view to crisply defining what the success criteria are - Drive high-impact exploratory analyses and investigations to enrich our understanding of how people interact with and use Apple Media Products around the world - Establish team capabilities (through hiring, training, tools, and process) that enable reproducible, transparent, and trusted work that influences decisions - Develop a strong consultancy approach that understands how to support and inform decisions over a large, complex feature development organization

Education & Experience

BS in Computer Science or equivalent industry experience.

Additional Requirements