Machine Learning Engineer, AI/ML Model Quality - Jobs - Careers at Apple
- Curate, analyze, and maintain gold-standard ground-truth datasets for model evaluation and continuous validation across both ML and GenAI systems.
- Audit training data for systemic bias and fairness gaps prior to model deployment; establish ongoing analytical checks to catch bias introduced by data drift over time.
- Define and analyze telemetry across GenAI workflows, tracking quality signals such as output coherence, latency, task completion rates, and regression patterns.
- Design mechanisms to detect degradation of models in production in a privacy preserving manner.
- Define and own ML observability metrics — model performance, output distributions, training-serving skew, silent degradation and feature drift — translating raw production signals into actionable insights for engineering and product teams.
- Design and develop observability dashboards and reporting workflows that give stakeholders a consistent, real-time view of model health across both conventional ML and GenAI systems.
- Identify degradation patterns and domain-specific failure modes in GenAI systems through systematic telemetry analysis, translating findings into concrete recommendations for model and data teams.
- Define, track, and report key data quality metrics — completeness, accuracy, timeliness, validity for engineering and leadership audiences.
- A Bachelor's degree with exceptional hands-on experience in ML/AI model quality or applied research or a M.S or Ph.D in Machine Learning, Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related quantitative field is strongly preferred.
- 3+ years of experience in defining and tracking ML model health metrics in production — model performance monitoring, feature drift detection, and observability instrumentation.
- 3+ years of experience in Machine Learning, data science or a closely related analytical role, with a strong focus on data quality, model evaluation, or ML observability in production environments.
- Proficiency in Python (Pandas, NumPy, Scikit-learn), common ML frameworks like PyTorch and SQL for complex data analysis, metric creation, and validation.
- Experience querying and analyzing large-scale datasets using distributed computing frameworks (e.g., PySpark, Spark, or distributed SQL).
- Solid understanding of statistical methods — hypothesis testing, distribution analysis, data drift detection, and statistical process control.
- Experience with GenAI or LLM systems, including common quality failure modes, output evaluation approaches, and telemetry instrumentation.
- Strong communication skills — ability to translate complex data quality findings and model health risks into clear, actionable insights for both engineering and non-technical stakeholders.
- Experience with data visualization and dashboarding tools (e.g., Tableau, Apache Superset, Databricks) to present complex ML telemetry.
- Familiarity with LLM evaluation frameworks (e.g. LangSmith) or techniques like LLM-as-a-judge.
- Experience with Bayesian or causal graph-based approaches to synthetic data generation.
- Familiarity with confidence calibration techniques and uncertainty quantification.
- Experience with ML monitoring or observability platforms (e.g., MLflow, Weights & Biases, or equivalent).
- Experience working with privacy-constrained data or under regulatory compliance frameworks (GDPR, DMA).
- Background in financial services, fintech, or consumer payment products.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant
At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants
Apple accepts applications to this posting on an ongoing basis.
Required Skills
Required Languages
🇬🇧 English