13d 23h ago
Ab Initio Developer
General Data Engineering
🏢Hybrid
|Charlotte, United States of Americaairflowetlgoogle_bigquerygcp+3
Ab Initio Developer
General Data Engineering
Hybrid
Contract
United States of America, Charlotte
Position:
Ab Initio Developer
Company:
Not Specified
Location:
United States, Charlotte, NC
Employment type:
Contract
Work Arrangement:
Hybrid
Short Summary:
We are seeking an experienced Ab Initio Developer to join the Home Lending Data & Insights team, focusing on designing, developing, and modernizing enterprise data pipelines across legacy on-premises platforms and Google Cloud Platform (GCP).
Responsibilities:
- Design, develop, and maintain scalable batch and near real-time data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL.
- Build and optimize Google BigQuery datasets, transformations, and data models.
- Support migration initiatives from Teradata and Ab Initio to Google Cloud Platform.
- Develop and maintain workflow orchestration using Autosys and Google Cloud Composer.
- Implement metadata management, governance, and data discovery using Google Dataplex.
- Build and maintain enterprise data quality controls using Informatica Data Quality.
- Monitor production pipelines, troubleshoot failures, and implement continuous improvements.
- Apply secure data engineering practices including PII protection and access controls.
- Partner with Product Owners, Architects, Analysts, and Engineering teams to define technical solutions.
- Create and maintain technical documentation.
- Utilize AI-assisted development tools to improve engineering productivity.
- Provide technical leadership and mentor junior engineers.
- Analyze complex business requirements and translate them into robust ETL and data engineering solutions.
Requirement:
- 4+ years of professional Data Engineering experience.
- 4+ years of experience with PL/SQL and SQL.
- Hands-on experience with Oracle, Teradata, Python, and/or Google BigQuery.
- 4+ years of experience developing enterprise ETL solutions using Ab Initio.
- 3+ years of experience programming in Python with hands-on PySpark development.
- Strong understanding of enterprise data governance and metadata management.
- Must have experience using AI-assisted coding tools.
Benefits:
Not Specified
Ab Initio Developer
Company:
Not Specified
Location:
United States, Charlotte, NC
Employment type:
Contract
Work Arrangement:
Hybrid
Short Summary:
We are seeking an experienced Ab Initio Developer to join the Home Lending Data & Insights team, focusing on designing, developing, and modernizing enterprise data pipelines across legacy on-premises platforms and Google Cloud Platform (GCP).
Responsibilities:
- Design, develop, and maintain scalable batch and near real-time data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL.
- Build and optimize Google BigQuery datasets, transformations, and data models.
- Support migration initiatives from Teradata and Ab Initio to Google Cloud Platform.
- Develop and maintain workflow orchestration using Autosys and Google Cloud Composer.
- Implement metadata management, governance, and data discovery using Google Dataplex.
- Build and maintain enterprise data quality controls using Informatica Data Quality.
- Monitor production pipelines, troubleshoot failures, and implement continuous improvements.
- Apply secure data engineering practices including PII protection and access controls.
- Partner with Product Owners, Architects, Analysts, and Engineering teams to define technical solutions.
- Create and maintain technical documentation.
- Utilize AI-assisted development tools to improve engineering productivity.
- Provide technical leadership and mentor junior engineers.
- Analyze complex business requirements and translate them into robust ETL and data engineering solutions.
Requirement:
- 4+ years of professional Data Engineering experience.
- 4+ years of experience with PL/SQL and SQL.
- Hands-on experience with Oracle, Teradata, Python, and/or Google BigQuery.
- 4+ years of experience developing enterprise ETL solutions using Ab Initio.
- 3+ years of experience programming in Python with hands-on PySpark development.
- Strong understanding of enterprise data governance and metadata management.
- Must have experience using AI-assisted coding tools.
Benefits:
Not Specified
Required Skills
airflowetlgoogle_bigquerygcpsqlpysparkpython
Required Languages
🇬🇧 English
Key competency: General Data Engineering