AI Product Engineer (Backend/LLM)

Filevine | Legal technology

58 minutes ago

On-site

Contract

Czech Republic, Slovakia

Filevine is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, Filevine brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.

Powered by LOIS, the Legal Operating Intelligence System, Filevine connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, Filevine’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.

We're a team of driven, enthusiastic problem solvers with strong backgrounds in machine learning, engineering, product management, legal and operations, on a mission to help attorneys resolve cases faster, for better outcomes. We're combining cutting edge models, approaches, and technologies with precise human in loop and data annotation processes. After achieving state-of-the-art results in automatic transcription, we're now pushing the boundaries in advanced NLP problems such as summarization of medical records and legal depositions, or automations of other legal workflows. We have many challenges to solve, which is exactly where you'll start if you join us.

As an AI Product Engineer, you will work closely with Machine learning Engineers, turning AI capabilities into dependable product features. You will own the systems and workflows that make AI-powered customer experiences reliable, secure, measurable, and maintainable.

Key responsibilities

Own AI-powered features from technical design and implementation through rollout, monitoring, and maintenance
Design services, APIs, data pipelines, and workflows that integrate LLMs and other machine-learning capabilities into Filevine products
Turn prototypes into production systems weith appropriate reliability, scalability, security, latency, and cost
Implement patterns such as retrieval and grounding, structured generation, tool use, human review, and graceful fallbacks
Establish quality metrics, tracing, monitoring, and feedback loops for AI-powered features
Collaborate with ML Engineers, Software Engineers, Product, and domain experts to turn customer problems into practical solutions
Make pragmatic technical decisions and communicate their context and tradeoffs clearly

Who are we looking for

At least 5 years of professional software-engineering experience, including end-to-end ownership of production systems
Experience designing, delivering, and operating AI-powered product functionality in production
Strong software-engineering foundations, including API design, data modeling, distributed systems, testing, and failure handling
Strong experience with Python or a comparable language and the ability to work in a Python-first environment
Practical understanding of production LLM systems, including retrieval, context management, structured outputs, tool calling, evaluations, guardrails, and common failure modes
Experience with asynchronous workflows, data-processing pipelines, background jobs, or event-driven systems
Experience deploying and operating cloud services; our stack includes Python, TypeScript, Temporal, Kubernetes, and AWS
Ability to evaluate tradeoffs among quality, reliability, latency, user experience, complexity, and cost
Good communication and writing skills in English, team spirit, and an independent problem-solving mindset
Ability to meet periodically in our Prague or Bratislava office, as we value in-person collaboration

This opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.

This role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirements

Privacy Policy Notice

Filevine will handle your personal information according to what’s outlined in our Privacy Policy.

Required Skills

restapiawscloud_servicesdata_science/data_engineeringdistributed_systemskubernetesllmmlmonitoringpythonqatypescript

Required Languages

🇬🇧 English

Relocation support available