Help us improve RVC
We use optional analytics cookies to understand how RVC is used. Allow analytics also enables a fully masked diagnostic recording on public vacancy pages. It stops before Apply and excludes page text, form fields, console, and network contents. We do not use advertising cookies. Cookie policy
RVC
JobsFor Employers
Use AILog in
  1. Jobs
  2. /
  3. Inference Engineer - Member of Technical Staff

Inference Engineer - Member of Technical Staff

Designworks Talent | AI Infrastructure
1h 49m ago
Hybrid
Full Time
IC
United States of America

Inference Engineer - Member of Technical Staff

Location: Hybrid | Bellevue, WA (downtown)
Multiple Levels and roles available

Build the Inference Platform Powering Next-Generation AI Applications

About the Opportunity

A well-funded, rapidly growing AI infrastructure company is building a next-generation cloud platform designed to power the full lifecycle of artificial intelligence. The organization is developing a comprehensive AI infrastructure, platform, and services portfolio that supports the full spectrum of AI workloads—including large-scale compute, model training, fine-tuning, inference, and emerging agentic AI applications.

Backed by significant long-term investment, the company combines the speed, ownership, and innovation of a startup with the stability and resources of an established parent organization. Engineering teams are intentionally lean, highly collaborative, and AI-native, leveraging modern tooling and automation to build infrastructure capable of supporting the industry's most demanding AI workloads.

We're seeking Inference Engineers to build and operate the model-serving systems behind a next-generation AI inference platform. This team focuses on delivering high-throughput, low-latency, reliable inference experiences that enable customers to consume advanced AI capabilities through production-scale APIs.

The Opportunity

This is a foundational engineering role focused on building the systems that bring AI models from research environments into reliable production services. You'll work on the infrastructure layer responsible for serving large models efficiently, optimizing performance, and ensuring reliability as usage scales.

You'll collaborate closely with GPU performance, AI training infrastructure, platform engineering, and operations teams to solve complex challenges around model serving, latency optimization, resource efficiency, and production reliability.

This opportunity is ideal for engineers who enjoy working at the intersection of distributed systems, machine learning infrastructure, GPU computing, and large-scale production systems.

What You'll Do

  • Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency AI workloads.

  • Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures and workloads.

  • Design systems that maximize GPU utilization while maintaining predictable performance and reliability.

  • Improve the scalability and operational maturity of inference platforms as customer demand grows.

  • Partner with AI training, GPU performance, orchestration, and infrastructure teams to ensure smooth transitions from model development to production serving.

  • Develop monitoring, alerting, and operational practices to maintain reliable inference services.

  • Investigate and resolve performance, reliability, and capacity challenges across inference workloads.

  • Contribute to architecture decisions and engineering standards as the platform evolves.

What We're Looking For

  • Experience building and operating production machine learning inference or model-serving systems at scale.

  • Strong understanding of the performance trade-offs involved in serving large AI models, including latency, throughput, memory utilization, and cost efficiency.

  • Experience designing reliable distributed systems or production infrastructure.

  • Understanding of GPU-backed AI workloads and the challenges of scaling inference systems.

  • Strong engineering fundamentals and the ability to independently own complex technical problems.

  • Comfortable working in a fast-moving environment where systems and processes are being built from the ground up.

Preferred Qualifications

  • Experience with modern inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies.

  • Experience optimizing LLM inference workloads or large-scale AI serving platforms.

  • Background operating API-based AI products or high-volume production services.

  • Experience with GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.

  • Familiarity with model optimization techniques such as quantization, batching, caching, or performance tuning.

  • Experience working at a hyperscaler, AI lab, GPU cloud provider, or large-scale ML infrastructure organization.

Compensation

  • Competitive base pay for Bellevue market

  • Certain roles are eligible for additional rewards, including merit increases, annual bonus, and long term incentives. These awards are allocated based on individual performance

  • U.S. based employees have access to medical, dental, and vision insurance, a 401(k) plan and company match, employees also receive per calendar year, paid holidays.

Location

  • Hybrid role based in the Bellevue, WA area.

  • Approximately three days per week in the office.

  • Candidates elsewhere in the U.S. who are open to relocation are encouraged to apply.

  • U.S. work authorization is required.

Why Join?

  • Build the inference platform powering the next generation of AI applications.

  • Work directly on large-scale model serving, GPU optimization, and production AI systems.

  • Solve complex challenges around latency, throughput, reliability, and cost efficiency.

  • Join early enough to influence architecture, tooling, and engineering practices.

  • Collaborate with a highly experienced team building critical AI infrastructure from the ground up.

  • Enjoy the ownership and technical impact of a startup environment backed by significant long-term investment.

Required Languages

🇬🇧 English

Related searches

  • Jobs in USA
  • Hybrid Jobs
  • Senior Jobs
1 jobs
Sort by
1h 49m ago

Inference Engineer - Member of Technical Staff

Designworks Talent·AI Infrastructure
Hybrid
|United States of America
ML Engineer
No similar jobs match these filters. Try changing or clearing a filter.
Popular job searches ▸
Roles
Python JobsJava JobsReact JobsTypeScript JobsGo JobsDevOps JobsNode.js JobsRemote C# and .NET JobsData Science JobsProduct Manager JobsDesign Jobs
Countries
United StatesUnited KingdomCanadaUS & EMEAGermanyPolandSpainNetherlandsPortugal
Experience
Senior JobsMid-Level JobsJunior Jobs
R© 2026 RVC Globalbuild b492d373
AboutJobs in Claude & ChatGPTPricingContactPrivacyCookiesRefundsTerms & ConditionsFor Employers