Position:
Senior Software Engineer - Model Evaluation & AI Systems
Company:
Deepgram
Compensation:
Estimated Base Salary $180K – $240K
• Offers Equity
• Offers Bonus
• 10% Annual Bonus
Location:
USA | Remote
Employment type:
Full time
Work Arrangement:
Remote
Short Summary:
Deepgram is looking for a Senior Software Engineer to join the team responsible for validating the quality of speech, audio, and multilingual models. This role involves defining evaluation methodology and building infrastructure to measure model quality at scale.
Responsibilities:
- Define and build evaluation methodologies for Deepgram's models.
- Design, build, and maintain automated evaluation pipelines across batch and streaming.
- Build scalable, reproducible evaluation infrastructure.
- Translate Research benchmarks into automated, enforceable pass/fail gates.
- Build and operate canaries and continuous-monitoring systems.
- Partner with DevOps/Infra to establish test environments.
- Work alongside Research and product teams to provide evaluation signals.
- Integrate evaluation and quality gates into CI/CD.
- Help raise the bar through code reviews and strong engineering practices.
Requirement:
- BS, MS, or PhD in Computer Science, AI, Applied Math, or related field, or equivalent experience.
- 5+ years of professional software or QA engineering experience.
- Solid backend/scripting experience in Python, Rust, Go, or similar.
- Experience designing and building automated test pipelines or evaluation frameworks.
- Strong analytical skills and comfort with metrics and statistical variation.
- Ability to communicate effectively across teams.
Benefits:
- Offers Equity
- Offers Bonus
- 10% Annual Bonus