Senior Data Engineer (Microsoft Fabric)
Overview
We are seeking an experienced Senior Data Engineer (Microsoft Fabric) to join our Data & Analytics team and support a large-scale data modernisation programme. This strategic initiative focuses on migrating the organisation's analytics platform from Oracle to Microsoft Fabric, enabling scalable, cloud-native analytics and reporting capabilities.
The successful candidate will be a highly hands-on engineer with deep expertise in Microsoft Fabric, PySpark, and SQL, capable of designing and delivering enterprise-grade data solutions. Working within an Agile delivery environment, you will contribute across multiple workstreams, helping accelerate the migration, modernisation, and governance of critical data assets.
Key Responsibilities
- Design, develop, and deploy end-to-end data pipelines in Microsoft Fabric.
- Leverage Change Data Capture (CDC) and Fabric Mirroring capabilities to enable real-time data replication and unified analytics.
- Support the migration of semantic models and analytical workloads from Oracle to Microsoft Fabric.
- Build, optimise, and maintain scalable data integration and transformation solutions using PySpark and SQL.
- Develop and enhance metadata-driven ingestion and orchestration frameworks.
- Design and implement robust data models for analytics and reporting solutions.
- Perform data mirroring activities and support replication of source systems into Microsoft Fabric.
- Execute integration testing and support data quality validation across multiple environments.
- Contribute to the implementation of Microsoft Purview, including:
- Data scanning
- Data cataloguing
- Data governance enablement
- Collaborate with architects, analysts, developers, and business stakeholders across the data modernisation programme.
- Support continuous improvement of platform performance, scalability, and operational efficiency.
- Work within Agile delivery teams, contributing to sprint planning, estimation, and delivery activities.
Essential Skills
- 6+ years of Data Engineering experience delivering enterprise-scale data solutions.
- Strong hands-on experience with Microsoft Fabric, including Lakehouse, Data Warehouse, Data Factory, Notebooks, Semantic Models, and Fabric administration concepts.
- Excellent coding skills in PySpark and SQL with the ability to develop complex data transformations and optimise performance. This is a core requirement for the role.
- Proven experience designing, developing, and deploying end-to-end data pipelines.
- Experience implementing CDC (Change Data Capture) solutions and real-time or near real-time data processing architectures.
- Experience with Microsoft Fabric Mirroring and data replication technologies.
- Strong understanding of data modelling principles for analytics and reporting.
- Experience working with modern cloud-based data platforms, including data warehouse and lakehouse architectures.
- Experience building scalable ETL/ELT frameworks and orchestration solutions.
- Strong understanding of data quality, testing, and validation practices.
- Experience working effectively within Agile delivery teams.
Desirable Skills
- Experience developing metadata-driven ingestion and orchestration frameworks.
- Experience working on large-scale data platform migration and modernisation programmes.
- Experience with Microsoft Purview, including data scanning, cataloguing, lineage, and governance.
- Experience with Oracle databases and Oracle-to-Fabric migration initiatives.
- Experience delivering enterprise reporting and analytics solutions.
- Experience working with Azure Data Platform technologies.
- Microsoft Fabric, Azure Data Engineer, or related Microsoft certifications.
Key Success Factors
- Strong problem-solving and analytical skills.
- Ability to operate effectively in a fast-paced delivery environment.
- Excellent stakeholder engagement and communication skills.
- Ability to collaborate across multiple teams and workstreams.
- Ability to balance competing priorities while maintaining delivery quality.
- Focus on building scalable, maintainable, and well-governed data solutions.
- Passion for modern data engineering practices and continuous improvement.
Why Version 1?
At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability.
Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits
Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme
Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance
Financial Wellbeing initiatives including; Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme
Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies
Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat
Reward schemes including Version 1’s Annual Excellence Awards & Star Awards
Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes.
And many more exciting benefits… drop us a note to find out more.
Version 1 is an equal opportunities employer.
We are committed to building a diverse, inclusive and respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity.
Video links:
#LI-EB1 #LI-Hybrid
Required Skills
Required Languages
🇬🇧 English