Senior Machine Learning Engineer, Evaluation, Agentic Search Capabilities - Jobs - Careers at Apple

The Agentic Search team is redefining how hundreds of millions of people access information across Apple devices, with privacy built in from the ground up. As part of the Agentic Search Evaluation team, you will help advance Apple Intelligence through personalized search that powers experiences across Siri, Spotlight, Mail, Messages, and more. Your team researches and builds deep search systems for Personal Question Answering, enabling Siri to answer questions about a user's emails, messages, events, files, and more, while keeping personal data private. We are looking for a senior Machine Learning Engineer with a passion for building scalable, high quality solutions to evaluate personalized agentic search applications. In this role, you will directly impact how we assess and improve the quality of novel agentic search applications by driving solutions for data generation, data quality assessment, offline and online metrics, and methods for statistical model and search quality assessment. Your work will impact the quality of innovative Personalized Agentic Search experiences across Siri and Apple products. In this role you will have the opportunity to build scalable systems for comprehensive evaluation of personalized model and search systems, develop data generation and curation methodologies to support evaluations, and design online and offline metrics for product quality assessment. Our team is responsible for models and evaluation of search experiences that answer user’s questions using their personal documents with privacy at the forefront.

• Build scalable, automated systems for large scale, end-to-end evaluation of models and search powered systems.
• Design and implement novel data generation and data quality assessment methods to support modeling and evaluation of personal agentic search.
• Design and implement offline and online metrics to assess product and component level quality for personal agentic search.
• Collaborate with partner teams to define data and evaluation requirements and priorities, and to explore opportunities for enhancements to the personal search stack.
• Develop long-term technical vision for personal search quality; identify problem areas and drive solutions as part of a larger roadmap.

• 6+ years industry experience in building Machine Learning or ML evaluation systems at scale.
• Strong software engineering skills in mainstream programming languages, such as: Python, C/C++.
• Ability to quickly prototype ideas and solutions, and perform critical analysis.
• Strong communication skills and ability to drive solutions in collaboration with partner teams.
• Bachelors in Computer Science, Engineering, Statistics or related field.

• Experience in design and building production ML systems and applications in search, NLP, recommendation systems, or information retrieval.
• Experience in data collection, data generation and/or data quality assessment of language, image or multi-modal data.
• Strong skills for quality metrics development; interpretation of evaluations; and presentation to executive audience.
• Advanced degree (Master’s or Ph.D.) in Computer Science, Engineering, Statistics, or related field, or equivalent industry work experience.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.