AI Developer

Position:
AI Developer

Company:
Salvo Software

Location:
United States

Employment type:
Full time

Work Arrangement:
Remote

Short Summary:
Salvo Software is seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, involving collaboration with engineering and product teams to build end-to-end LLM pipelines.

Responsibilities:
- Train and fine-tune LLMs using supervised fine-tuning (SFT).
- Work with open-source models such as LLaMA, Mistral, Qwen, and similar architectures.
- Build LoRA / Q-LoRA pipelines for efficient fine-tuning.
- Implement and optimize data preprocessing workflows, including tokenization and long-context handling.
- Use and extend Hugging Face Transformers & Datasets for training and inference.
- Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines for document-grounded question answering and knowledge retrieval.
- Deploy, run, and maintain models fully offline and in air-gapped environments.
- Build backend services in Python for ML training and inference workflows.

Requirement:
- Strong experience in Python for backend and machine learning development.
- Expertise with ML frameworks such as PyTorch or TensorFlow, along with scikit-learn and pandas.
- Solid knowledge of Postgres or MySQL for data storage.
- Hands-on experience with LLM training, fine-tuning, and optimization.
- Familiarity with XML/XSD and Office document parsing tools.
- Experience deploying models with vLLM, TGI, or Ollama.
- Understanding of quantization techniques such as GGUF, GPTQ, or AWQ.
- Experience with GPU optimization and the CUDA stack.

Benefits:
- Opportunity to work with cutting-edge open-source LLMs.
- Engage in building context-aware AI systems and designing reliable backend pipelines.
- Work in a culture that values innovation, ownership, and engineering excellence.