Senior ETL Test Engineer
Project description
We are seeking a highly experienced and hands-on Senior ETL Test Engineer with at least 7 years of ETL and Data Warehouse testing experience. You will be responsible for validating complex data pipelines, ETL workflows, database transformations, APIs, and data migration processes across enterprise systems. The three primary requirements for this position are: Strong hands-on Python automation Advanced Oracle database and SQL expertise Extensive hands-on ETL testing experience You need to have strong data testing capabilities with practical Python automation skills. You should be able to independently design test strategies, write complex SQL queries, automate data validation, investigate data discrepancies, and perform end-to-end testing of batch and real-time data pipelines. This is a senior, hands-on engineering position that requires direct involvement in testing, automation, troubleshooting, and defect resolution.
Responsibilities
- Validate end-to-end ETL workflows, including data extraction, ingestion, transformation, loading, and reporting. Review and validate source-to-target mappings, data transformation rules, business rules, and data quality requirements. Design, develop, and execute comprehensive ETL test cases for: Batch data pipelines Real-time and near-real-time data pipelines Data warehouse solutions Data migration initiatives Data integration processes Perform hands-on database testing across Oracle Database and MongoDB environments. Write and execute complex SQL queries for: Source-to-target validation Data reconciliation Record-count verification Duplicate detection Referential integrity checks Data completeness and accuracy checks Transformation-rule validation Aggregation and reporting validation Develop and maintain reusable test automation frameworks and scripts using Python and PyTest. Use Python to automate data extraction, comparison, reconciliation, validation, and test reporting activities. Validate data files and datasets stored, transferred, or processed through AWS S3. Test REST APIs and verify data flow, payload structure, response codes, error handling, and system-to-system integration. Use tools such as Postman and Swagger to perform API validation and troubleshooting. Perform end-to-end testing of data ingestion, transformation, storage, integration, and reporting processes. Execute functional, integration, regression, system, and data validation testing. Test data warehouse components, including fact tables, dimension tables, staging layers, aggregates, historical data, and reporting outputs.
SKILLS
Must have
- 7+ years of hands-on ETL and Data Warehouse testing experience Strong hands-on Python development and test automation experience Advanced hands-on experience with Oracle Database and SQL Strong experience with ETL testing concepts, methodologies, and validation techniques Proven ability to write complex SQL queries involving: Multiple joins Subqueries Common table expressions Aggregations Analytical functions Stored procedures Data reconciliation logic Strong experience validating source-to-target mappings and complex data transformation rules Hands-on experience testing data warehouse and data migration solutions Practical experience with MongoDB and testing MongoDB-based applications Hands-on experience validating data stored and processed through AWS S3 Strong experience with REST API testing Experience using Postman, Swagger, or similar API testing tools Hands-on experience developing automation scripts and frameworks using Python Practical experience with PyTest or similar Python testing frameworks Experience performing: Functional testing Integration testing Regression testing End-to-end testing Database testing Data validation testing Strong knowledge of data reconciliation, data quality, data integrity, and data accuracy validation Experience with defect management tools such as Jira and/or Azure DevOps Strong analytical, debugging, troubleshooting, and root cause analysis skills Excellent stakeholder communication, collaboration, and coordination skills Ability to work independently in a senior, hands-on testing role
Nice to have
N/A
Required Skills
Required Languages
🇬🇧 English