Software Engineer, Data Quality Tools & Automation — AIML Data Operations - Jobs - Careers at Apple
- Build internal QA tools and automation for workflows such as audit sampling, gold dataset management, calibration, adjudication, and defect triage. Integrate these tools with existing annotation and review platforms.
- Design and operate reliable data pipelines that combine annotation, human review, and automated QA outputs. Build in validation, monitoring, and support for backfills so reported metrics remain traceable and reproducible.
- Develop dashboards and alerts that show quality, coverage, and emerging risks across projects and workflows. Enable users to trace an aggregate change to the relevant task types, error categories, and underlying examples.
- Implement scalable quality measurement for accuracy, inter-annotator agreement, error rates, and audit coverage. Work with QA and Data Science to define denominators, minimum sample sizes, and alert thresholds.
- Investigate quality regressions using SQL, Python, and statistical methods. Identify recurring failure modes, quantify their impact, and assess whether changes to guidelines, tooling, or workflows resolve them.
- Evaluate automated QA methods against human-reviewed examples. Measure false positives, missed defects, and review effort to determine where automation can reliably support human review.
- Own the systems you ship, including design, testing, deployment, documentation, monitoring, and support. Use feedback from QA and Operations teams to prioritize improvements.
- Bachelor's degree in Computer Science, Data Science, Engineering, or related field.
- Experience designing, building, and maintaining production software, internal tools, or data systems used by other teams.
- Strong programming skills in Python and strong SQL skills for data transformation, validation, and analysis.
- Experience building automated workflows or data pipelines that integrate multiple data sources or services.
- Experience presenting data through dashboards, analytical applications, or reporting interfaces that support operational decisions.
- Ability to investigate data discrepancies and translate ambiguous quality or operational questions into measurable outcomes.
- Ability to work across technical and operational teams and explain findings and tradeoffs clearly.
- Experience with data annotation, human evaluation, ML data pipelines, or quality engineering for data-intensive products.
- Familiarity with statistical sampling, confidence intervals, inter-annotator agreement, or measurement design for subjective tasks.
- Experience evaluating rule-based or model-assisted QA against human judgments, including precision, recall, and error analysis.
- Experience building systems for global operations or workflows with multiple sites and review teams.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant
At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants
Apple accepts applications to this posting on an ongoing basis.
Required Skills
Required Languages
🇬🇧 English