Senior Data Engineer - Data Platform Engineering

Project description

We are looking for a Senior Data Engineer specialising in Data Platform Engineering to join a project focused on observability and embedded analytics for a leading automotive Client. The project aims to establish a scalable and maintainable data foundation that transforms logs, events, measurements and telemetry from embedded, cloud, test and application systems into trusted and reusable data products. In this role, you will focus on the architecture and engineering of the data platform, including pipelines, orchestration, common data models, data quality and operational monitoring.

Responsibilities

• - Design and implement the target data architecture and production data foundation. - Build and maintain robust, automated data pipelines and transformations. - Develop shared data models, schemas and analysis-ready datasets. Implement data orchestration, data-quality controls, monitoring and lineage. - Integrate data from embedded, cloud, test and application systems using APIs and other data interfaces. - Improve platform reliability, scalability, performance and maintainability. - Support analytical use cases while keeping the underlying data platform reusable. - Produce operational documentation and support knowledge transfer to Client teams

SKILLS

Must have

• - Strong experience designing and operating production-grade data platforms and pipelines. - Strong Python and SQL skills. - Experience with cloud-based data solutions. - Strong knowledge of data modelling, schemas and transformations. - Experience with data orchestration and automated workflows. - Experience integrating systems through APIs. - Experience with data quality, pipeline monitoring and observability. - Experience with version control and production engineering practices. - Understanding of data security, privacy and access control.

Nice to have

- Automotive, connected-car or embedded-systems experience. - Experience with telemetry, event and time-series data. - Data lineage and governance experience. - Experience supporting dashboards and analytical platforms. - Experience optimising data platforms for performance and cost.