AIML - Machine Learning Engineer, Core ML Model Conversion (ODML) Machine Learning Platform & Infrastructure

Seattle,Washington,United States

Machine Learning and AI

Are you passionate about revolutionizing on-device AI and shaping the future of ML deployment? Join the team behind Core ML, the technology that drives transformative ML features across Apple's ecosystem and beyond. Our cutting-edge technology leverages the full potential of Apple Silicon to execute neural networks with unprecedented speed and efficiency on Macs, iPhones, Apple Watch, and Vision Pro. Our team played a pivotal role in the groundbreaking Apple Intelligence features recently unveiled at WWDC, showcasing the cutting-edge capabilities of on-device AI. We were instrumental in getting the 3B on-device model running on device efficiently. We enable intelligent features in core Apple applications like Camera, Siri, Keyboard, FaceTime, Spatial Computing etc and empower professional-grade third-party applications like Adobe Photoshop, Pixelmator etc to leverage the power of on-device AI. By harnessing the full potential of Apple's custom-designed CPU, GPU, and Neural Engine, we make it possible for these applications to deliver exceptional AI-powered experiences with unparalleled performance and efficiency. As a key player in our team, you'll be at the forefront of bridging the gap between the training of state-of-the-art deep learning models and their efficient execution on Apple devices. Your expertise will be crucial in converting complex computational graphs from frameworks like PyTorch and JAX into optimized, Apple-friendly format that unleashes the full potential of our hardware. You will work on bringing state of the art models, of varying sizes to run on device with high performance (low latency, memory and power). We're seeking a highly motivated individual with a deep understanding of ML models and a passion for bringing cutting-edge models from ML research and different domains (vision, image/text generation, audio etc) into real-world applications on device. If you have a track record of optimizing and deploying models, writing high-quality code, and delivering impactful libraries to a broad user base, we want to hear from you. In this highly visible role, you'll collaborate with innovative teams across Apple and industry-leading external partners like Adobe, Hugging Face, and Meta. You will work with them to export and efficiently deploy deep learning models on Apple devices. Your contributions will be instrumental in shaping the future of on-device AI, and you'll play a key role in Apple's open-source initiatives, directly impacting the global AI developer community.

Description

We are the team that develops Core ML Tools, an open source python library for converting PyTorch and TensorFlow models to Core ML and optimizing models for performance. If you enjoy playing with the building blocks and architecture of machine learning models, and are strong at understanding the mathematical operations making these models and manipulating the computational graph to optimize for speed / execution, then you are going to have fun in this role! Responsibilities include: * Performing model conversion from PyTorch, among other libraries, to the Core ML model format * Running and benchmarking models. Understanding the effect of computational graph representation on the model execution performance on Neural Engine, GPU, CPU. * Proficient in setting up and running open source ML models (e.g. Hugging Face), understanding ML pipelines and reasoning on which parts should be part of the model, and which ones should be outside of the model as pre-processing and post processing steps * Adding graph passes for improving performance. Publishing examples of models that are converted in "performant" ways (example: the Apple Stable diffusion open source library) * Collaborate effectively with developers (internal and external). Be an active member of the open source CoreMLTools community on Github, interacting with developers, addressing GitHub issues etc * Implementing new operations / layers for neural networks * Improving model optimization documentation, writing examples, tutorials and guides Join us in shaping the future of on-device AI and be part of the team that's redefining what's possible with machine learning on Apple devices!

Minimum Qualifications

• BS/MS/PhD in Computer Science or Electrical Engineering

• 2+ years of industry experience

• Strong python programming skills (C++ a strong bonus)

Key Qualifications

Preferred Qualifications

• Strong ML fundamentals and understanding of the latest model architectures. Strong understanding of operations that constitute a model (e.g. gather, convolution, attention etc)

• Fluent in PyTorch, TF or JAX

• Ability to work comfortably with computational graphs and IRs (compiler background a strong bonus)

• Ability to profile models and reason through the effect of conversion / model representation on performance

• Experience with developing public facing APIs (in python or C/C++)

• Passionate about engaging and collaborating with ML community in the open source (track record in this area a strong bonus)

Education & Experience

Additional Requirements

Pay & Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $135,400 and $250,600, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.Learn more (https://www.apple.com/careers/us/benefits.html) about Apple Benefits.Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

• Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.Learn more about your EEO rights as an applicant. (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf)

Apple Footer

Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race,color,religion,sex,sexual orientation,gender identity,national origin,disability,Veteran status,or other legally protected characteristics. Learn more about your EEO rights as an applicant (Opens in a new window) .

Apple will not discriminate or retaliate against applicants who inquire about,disclose,or discuss their compensation or that of other applicants. United States Department of Labor. Learn more (Opens in a new window) .

Apple will consider for employment all qualified applicants with criminal histories in a manner consistent with applicable law. If you’re applying for a position in San Francisco,review the San Francisco Fair Chance Ordinance guidelines (opens in a new window) applicable in your area.

Apple participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program (Opens in a new window) .

Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace. Reasonable Accommodation and Drug Free Workplace policy Learn more (Opens in a new window) .