ISE, SIML - Data Annotation Lead

Santa Clara Valley (Cupertino), California, United States
Machine Learning and AI

Summary

Posted:
Weekly Hours: 40
Role Number:200161572
Do you think Computer Vision and Machine Learning can change the world? Do you think it can transform the way millions of people capture, discover and share the most special moments of their lives? We truly believe it can! The System Intelligence and Machine Learning (SIML) group is responsible for crafting machine learning solutions to extract high level structure information from images, videos and text shipping on all Apple platforms (macOS, iOS, tvOS, watchOS). Examples include face recognition, scene classification, OCR, handwriting recognition as well as the support for internal tools. The group combines research and development in a dynamic and engaging environment. Our data team is responsible for designing and building high quality datasets at scale. At the heart of machine learning, data defines how Apple features and products operate and what is the final user experience that will impact millions of our customers. This is an exciting time to join us: grow fast, and have an impact on multiple key features on your first day at Apple!

Key Qualifications

  • At least one year experience in data annotation
  • Highly organized with strong attention to detail
  • Capacity to multitask and manage several projects in parallel, meet deadlines and provide visibility to client and partners
  • Ability to define/design/develop/optimize annotation workflows and QA workflows (anticipate potential failure modes and edge cases, detect anomalies, generalize, synthesize)
  • Problem solving & critical thinking capacities, with an eye for innovation and for continuous optimization (improve the diversity and quality of assets, reduce time to delivery and cost)
  • Understanding of the challenges associated to building datasets for machine learning R&D (eg coverage, bias)
  • Excellent communication and interpersonal skills

Description

Our team focuses on data collection/generation, smart filtering/selection, annotation, as well as failure analysis. Each year, we power dozens of features and work closely with ML teams across the entire company. Apple's commitment to deliver incredible experiences to a global and diverse set of users in full respect of their privacy leads our team to explore innovative data collection processes. This position focuses on setting up and managing annotation projects (in-house, outsourced) and on ensuring the quality of the data delivered to R&D. This includes: Communicate with R&D team to understand expectations and define specs of annotation tasks Participate in selection of assets to be included in the dataset Define annotation workflow (and re-assess it over time), establish guidelines and training material, establish range for time per task Calibrate task with vendor Define and continuously adjust QA methodology (eg types of errors, penalties, QA workflow) Lead QA effort Track quantities and quality delivered

Education & Experience

Bachelors degree in: Photography, Graphics Design, Computer Science, Mathematics, Physics, or equivalent experience

Additional Requirements