Position:
Lead Snowflake Data Engineer
Company:
Luxoft
Location:
India, Bengaluru
Employment type:
Not Specified
Short Summary:
The project is for a renowned science and technology company in the pharmaceutical industry, focusing on AWS, AI, and data engineering initiatives. The role involves modernizing data infrastructure by transitioning to Snowflake, enhancing capabilities for advanced AI solutions.
Responsibilities:
- Develop and maintain scalable Snowflake data solutions and DBT transformations.
- Lead a team of resources: assign tasks, perform code reviews, mentor, and manage performance.
- Collaborate with the project Lead for regular status updates and escalate issues as needed.
- Engage with business stakeholders to define architecture, data models, data flow, and integration patterns.
- Produce high-level architecture documents outlining scope, components, interfaces, risks, and complexity.
- Define and manage project timelines, milestones, and estimates; translate requirements into a practical development plan.
- Ensure data quality, governance, security, and compliance across pipelines.
- Establish CI/CD pipelines for Snowflake/DBT deployments.
- Implement robust testing strategies: unit tests, data quality checks, and validation processes.
- Create and maintain documentation for data models, data lineage, and development standards.
- Identify performance bottlenecks, optimize Snowflake queries and DBT models, and implement best practices.
- Collaborate across teams to ensure alignment with business goals.
Requirement:
- 12–15 years of overall experience in data engineering, with 6–7 years of hands-on expertise in Snowflake and DBT.
- Proficiency in using Fivetran for automated ELT data ingestion.
- Strong SQL proficiency and advanced Python skills for data processing and automation.
- Deep expertise in Snowflake architecture, performance tuning, and data modeling.
- Extensive experience building and operating DBT-based pipelines.
- Experience with CI/CD and release management; familiarity with Azure DevOps or similar toolchains.
- Familiarity with IaC concepts and tools (Terraform, CloudFormation).
- Demonstrated leadership experience: mentoring junior developers and managing small teams.
- Excellent communication skills to convey complex concepts to non-technical stakeholders.
Benefits:
Not Specified