Research Engineer - Video Tone Mapping

Cupertino, California, United States
Machine Learning and AI

Summary

Posted:
Role Number:200562811
Apple's Camera Algorithm team is looking for extraordinary engineers and researchers interested in developing next generation of image capture, processing and rendering algorithms to be used across all Apple product cameras! As part of the team you will research and develop novel ways to improve the image and video quality of Apple’s camera systems. In order to reduce the computational complexity of your methods you are encouraged to take advantage of Apple silicon technologies such as the Image Signal Processor (ISP) or the Apple Neural Engine (ANE). The Camera Algorithm Tone Mapping team works at the intersection of software and hardware, developing real time algorithms required for camera operation and having major impact on the final image and video quality.! The team has a history of delivering solutions running on Apple products, for example Smart HDR, HDR video tone mapping or Apple Log encoding. This interdisciplinary team works closely with many other groups including silicon design, camera hardware and camera software teams to deliver industry leading consumer imaging devices. The work environment champions innovation, rapid iteration and awards independence and creativity in solving engineering problems.

Description

As an algorithm developer you will be responsible for crafting the creative look of videos captured with Apple cameras by developing capture side tone mapping algorithms. You will drive algorithm development across all stages of the cycle; from the initial idea and proof of concept work through on-device implementation all the way to field testing, validation and finally surprising and delighting our customers. - Prototype novel tone mapping algorithms in high level software languages such as Matlab or Python - Implement, test and refine developed approaches in Apple products to meet image quality expectations and satisfy code execution time criteria - Collaborate with hardware design teams on developing new image processing blocks improving image quality - Influence the artistic look of Apple cameras across different product categories (phones, portables, tablets), and modalities (video and still capture, playback) - Define and develop feature proposals for different use cases targeting consumer and professional markets

Minimum Qualifications

  • BS and a minimum of 3 years relevant industry experience
  • Track record of developing image processing algorithms for example: auto white balance, tone mapping, auto exposure and high dynamic range capture
  • Validated coding skills in Matlab or Python

Key Qualifications

Preferred Qualifications

  • Familiarity with a digital camera image processing pipeline and the Image Signal Processor (ISP)
  • Understanding of image quality metrics and subjective evaluations
  • Proven knowledge of HDR encoding standards
  • Prior experience with professional video content postproduction and color grading workflows
  • Curiosity about vision science and/or color science
  • Programming skills in C/C++
  • Exposure to machine learning algorithms
  • Passion for photography and videography

Education & Experience

Additional Requirements

Pay & Benefits

  • Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant.