Senior Data Engineer

We are seeking a skilled and forward-thinking Data Engineer to design, build, and maintain our data platform, starting from scratch. As a founding member of the US Data team, you will have the opportunity to pioneer our data strategy and build the core systems that will enable this client to lead the industry in data and analytics.

The ideal candidate will bring strong expertise in data engineering, analytics architecture, and modern data technologies. You are entrepreneurial and comfortable working in a fast-paced environment where you will chart your own path.

Key Responsibilities

• Design, build, and maintain a scalable data platform for collecting, storing, and processing raw data.
• Build efficient, performant, and well-tested data pipelines that transform raw data from disparate sources into trusted data products.
• Collaborate with global data teams and business stakeholders to understand business requirements and design solutions that adhere to global best practices.
• Implement data validation, quality checks, and error handling processes.
• Document data architecture, pipelines, transformations, and processes for seamless data governance.
• Ensure compliance with data governance, security, and privacy standards.
• Stay up-to-date on emerging data engineering technologies and design patterns.
• undefined

Key Skills & Competencies

• Strong proficiency in SQL and a scripting language like Python; PySpark experience is preferred.
• Demonstrated building pipelines in Databricks.
• Knowledge of dimensional modeling and medallion architecture.
• Experience working with Azure services. Understanding of data quality, validation, and testing processes, including CI/CD.
• Awareness of data governance, security, and privacy best practices.
• Strong problem-solving, analytical thinking, and attention to detail.
• Ability to collaborate with technical and non-technical stakeholders to align the data platform with business needs.
• Experience working with insurance data is a plus.
• Practical experience using AI tools (e.g. Copilot, Claude, ChatGPT, Genie Code) to accelerate development and improve productivity.
• A track record of challenging existing processes and driving improvements rather than maintaining the status quo.
• Strong bias for action and ownership, able to get things done with minimal oversight.
• Data-driven mindset, backing recommendations and decisions with evidence and analysis rather than opinion.

Qualifications

• Bachelor's degree in a technical or quantitative discipline, or equivalent technical experience.
• 5+ years of experience in data engineering or similar data platform roles. Hands-on experience building and maintaining ETL/ELT pipelines and data models.
• Proven experience deploying and maintaining production workloads on Azure and/or Databricks.
• Willingness to wear multiple hats, and enough knowledge about data visualization, business intelligence, and project management to fill in the gaps as we build out this team.