Senior Data Engineer

Title: Senior Data Engineer

Location: Stellarton, NS, Canada

Sobeys is full of exciting opportunities, and we are always looking for bright new talent to join our team! We currently have a full time opportunity for a Senior Data Engineer role. This role can be based out of our offices located in Stellarton; NS, Mississauga, ON Senior Data Engineer role will be part of the Data Integration Hub (DIH) within the 'Integration and COEs' department of Sobeys. Part of the enhancement and maintenance of DIH to support major program deliverables.

Work closely with business SMEs, architects and technical leads from various divisions within Sobeys.

Highly experienced in translating data requirements to design and implementation.

Highly skilled in Azure Databricks, specifically streaming and event driven solutions.

Highly skilled in performance and cost optimization of solutions.

Solid expertise in CI/CD practices.

Provides mentorship to junior engineers and serve as trusted advisor to leadership team. #LI-Hybrid What you have to offer: Significant experience (5+) developing with Spark (python/Vscode/Databricks Notebooks preferably) and specifically within Azure Databricks.

Strong knowledge on DLT framework and structured streaming.

Experienced in implementing scalable data ingestion frameworks.

Experienced in enabling and using Unity catalog.

Experienced in building a resilient solution for pipelines supporting operational systems.

Experienced in engaging with the team towards a common sprint goal and be collaborative.

Experienced in establishing Key Design Decisions and communicating with architects and core team for alignment.

Actively engage in performance and cost optimization of the solution.

Ability to identify redundant manual work and share opportunities to enable automation.

Azure Dev Ops - CI/CD.

Proven experience in test driven development.

Azure and Databricks certification is a plus.