Software Engineering Manager, AIML — LLM Inference Quality - Jobs - Careers at Apple
- Build, mentor, and manage an inclusive team of high-performing engineers; drive hiring and onboarding, manage performance, and prioritize team health and growth paths.
- Define the strategic vision and technical roadmap for LLM inference qualification — output-correctness automation, regression and CI gating, agentic-behavior validation, and infrastructure-level inference validation.
- Drive execution of complex, multi-quarter projects end-to-end, balancing rapid iteration against long-term architectural stability and a high quality bar.
- Champion engineering excellence in evaluation methodology: test-and-qualification strategy across unit, integration, regression, and end-to-end layers for distributed ML serving systems.
- Partner cross-functionally with ML, performance, distributed systems, security, privacy, and platform teams to deliver secure, reliable AI experiences on tight timelines.
- Oversee AI-specific risk coverage — prompt injection, data leakage across users and permissions, hallucinated or ungrounded output, safety/refusal/policy compliance, and cost/latency regressions.
- Ensure infrastructure-level validation — output parity for quantization, KV-cache, speculative decoding, and batching; output equivalence across serving backends and accelerators.
- Invest in observability and AI-assisted tooling — metrics, logging pipelines, distributed tracing, drift monitoring, and agentic QA tooling that makes testing itself smarter and faster.
- Spot problems before they occur, resolve cross-functional bottlenecks, and present your team's work to executive leadership to advocate for resources and technical direction.
- 8+ years of experience in software and/or ML systems development, or equivalent experience.
- 3+ years of engineering management experience, with a proven track record of delivering complex, large-scale projects across multiple teams or organizations.
- Experience architecting test, qualification, or evaluation strategy for large-scale distributed systems — ideally ML serving or inference platforms.
- Hands-on background in one or more compiled languages (C, C++, Objective-C, or Swift) and proficiency in a scripting language (e.g., Python).
- Self-directed: the ability to drive a strategy or project from a simple idea to production, setting clear priorities and consistently delivering on schedule with measurable outcomes.
- B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
- Experience with machine learning and LLMs — common practical applications and frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks).
- Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software.
- Experience using AI/LLMs to improve testing itself — test-case generation, defect detection, or reducing manual QA effort.
- Experience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines.
- Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift.
- Experience validating agentic workflows — tool-use, function-calling, and multi-turn coherence.
- Track record of hiring, developing, and retaining strong engineers, and leading change across multiple sites.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant
At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants
Apple accepts applications to this posting on an ongoing basis.
Required Skills
Required Languages
🇬🇧 English