Principal, Data Engineer

Job Duties/Responsibilities 

Set Platform Engineering Standards: Define and maintain the data engineering patterns, pipeline standards, and architectural guardrails that govern how data systems are designed, built, and evolved across the organization's data platform. 

Design and Govern the Data Platform: Lead the design of scalable data processing frameworks and transformation models supporting claims, encounters, risk adjustment, and member data domains — with direct accountability for platform reliability and data quality outcomes. 

Integrate AI/ML into Production Engineering: Apply machine learning and automation techniques within production data engineering environments — including pipeline intelligence, data quality automation, and feature pipeline design — establishing patterns others can scale. 

Build and Optimize Data Pipelines: Implement and continuously improve high-performance cloud-based data pipelines using Apache Kafka, Databricks, Apache Spark, and cloud-native tools for real-time and batch workflows. 

Elevate Engineering Capability Across the Team: Serve as the technical subject matter expert for data engineering, mentoring engineers through architecture reviews, design sessions, and internal documentation — raising the overall capability and consistency of the team. 

Lead Technology Evaluation and Platform Roadmap Input: Evaluate emerging data technologies and translate findings into actionable build-versus-buy recommendations, contributing directly to the multi-year data platform engineering roadmap. 

Deliver Compliant Healthcare Data Solutions: Apply expertise in Medicare Advantage data constructs — including CMS requirements, HIPAA, HEDIS, and risk adjustment — to ensure all data solutions are audit-ready, regulatory-compliant, and aligned to health plan reporting standards. 

Supervisory Responsibilities 

This role carries no direct supervisory responsibility at this time. The Principal, Data Engineer is expected to provide informal technical leadership, mentorship, and subject matter guidance to Data Engineers and Senior Data Engineers as the function's highest-level individual contributor. 

Job Requirements 

Experience 

Required: 

• 10+ years of progressive data engineering experience, with demonstrated platform engineering at scale 

• 5+ years of experience in healthcare, health insurance, or a Medicare Advantage environment 

• Demonstrated experience building and governing enterprise data platforms using Apache Kafka, Databricks, and non-relational databases 

• Proven experience designing complex ETL/ELT pipelines in cloud environments (Azure, AWS, or GCP) 

• Experience working in HIPAA-compliant data environments with PHI/PII datasets 

• Demonstrated track record of setting engineering standards or architectural patterns adopted by others 

• Experience as a technical lead in a data platform modernization or cloud migration initiative 

• Working on AI tooling and usage in Data Platform space 

Preferred: 

• Hands-on experience with Medicare Advantage–specific data: encounter submissions, RADV, HEDIS, CMS reporting, or Star ratings analytics 

• Prior work in a high-growth or transformation environment where platform engineering was a strategic priority 

Education 

Required: 

• Bachelor's degree in Computer Science, Information Systems, Data Science, Engineering, or a related technical field; equivalent combination of education and experience considered 

Preferred: 

• Master's degree in a related technical discipline 

Training 

Required: 

• Demonstrated working proficiency with cloud data platform tools (Azure Databricks, Azure Data Factory, or equivalent); hands-on experience accepted in lieu of formal certification 

Preferred: 

• Cloud platform certification (Microsoft Azure Data Engineer Associate, AWS Certified Data Engineer, or Google Professional Data Engineer) 

• AI/ML engineering certification or relevant DataOps training 

Skills & Competencies 

Technical / Role-Specific Skills 

• Data Pipeline & Platform Engineering: Expert-level design, implementation, and optimization of complex data pipelines using Kafka, Databricks, Apache Spark, and cloud-native tooling across real-time and batch architectures. 

• Cloud Data Platforms: Deep experience with Azure (preferred), AWS, or GCP services including data lakes, lakehouses, and streaming architectures. 

• AI/ML Integration in Data Engineering: Demonstrated ability to operationalize machine learning and automation within production data engineering pipelines, including feature stores and model serving infrastructure. 

• Healthcare Data Standards & Compliance: Advanced knowledge of HIPAA, HL7/FHIR, ICD-10/CPT codes, CMS data submission standards, and PHI/PII data governance requirements. 

• Data Modeling: Ability to design data models for relational and non-relational systems that scale to support healthcare analytics use cases across clinical, operational, and financial domains. 

• SQL & Programming Languages: Advanced SQL proficiency with production-level experience in Python, Scala, or Java for data engineering workloads. 

• Data Quality & Governance: Experience implementing data quality frameworks, lineage tracking, and metadata management within large-scale data platforms. 

Licensure 

Required: None 

Preferred: 

• Microsoft Azure Data Engineer Associate, AWS Certified Data Engineer, or equivalent cloud data certification 

• Certified Data Management Professional (CDMP) or equivalent data governance certification 

Essential Physical Functions 

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. 

1. While performing the duties of this job, the employee is regularly required to talk or hear. The employee regularly is required to stand, walk, sit, use hand to finger, handle or feel objects, tools, or controls; and reach with hands and arms. 

2. The employee frequently lifts and/or moves up to 10 pounds. Specific vision abilities required by this job include close vision and the ability to adjust focus.