Help us improve RVC
We use optional analytics cookies to understand how RVC is used. Allow analytics also enables a fully masked diagnostic recording on public vacancy pages. It stops before Apply and excludes page text, form fields, console, and network contents. We do not use advertising cookies. Cookie policy
RVC
JobsFor Employers
Use AILog in
  1. Jobs
  2. /
  3. LLM Inference Engineer

LLM Inference Engineer

Near AI | Artificial Intelligence
13h 43m ago
Remote In-Country
Full Time
United States of America
Title: LLM Inference Engineer Location: San Francisco or Remote

Locations: San Francisco or Remote

About The Role

The NEAR AI team is building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our mission is to build highly scalable and efficient infrastructure for open-source AI at a global scale.

We are specifically seeking an expert in high-performance LLM serving systems and inference optimization. In this role, you will push the boundaries of how large language models are served.

What You'll Be Doing

  • Architect and maintain production high-traffic LLM serving systems.
  • Optimize throughput, latency, and cost for leading open-source LLMs.

What We're Looking For

  • Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT.
  • Deep knowledge of state-of-the-art GPU architectures, and effectively exploit them using PyTorch, Triton, CuTe, CUDA, etc.
  • Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems.
  • Strong problem-solving skills and ability to communicate technical ideas clearly.

We'd Love If You Have

  • Experience with Trusted Execution Environments (TEE).
  • Active contributor to open-source LLM inference engines.

Please let us know if you require any special requirements for your interview and we'll do our best to accommodate.

Required Skills

vllmtensorrtpytorchtritoncuda

Required Languages

🇬🇧 English

Related searches

  • Remote Jobs in USA
  • Jobs in USA
  • Remote In-Country Jobs
1 jobs
Sort by
13h 43m ago

LLM Inference Engineer

Near AI·Artificial Intelligence
vllmtensorrtpytorchtritoncuda
Remote In-Country
|United States of America
ML Engineer
No similar jobs match these filters. Try changing or clearing a filter.
Popular job searches ▸
Roles
Python JobsJava JobsReact JobsTypeScript JobsGo JobsDevOps JobsNode.js JobsRemote C# and .NET JobsData Science JobsProduct Manager JobsDesign Jobs
Countries
United StatesUnited KingdomCanadaUS & EMEAGermanyPolandSpainNetherlandsPortugal
Experience
Senior JobsMid-Level JobsJunior Jobs
R© 2026 RVC Globalbuild b492d373
AboutJobs in Claude & ChatGPTPricingContactPrivacyCookiesRefundsTerms & ConditionsFor Employers