What's it like to work for the Battery Technology Center (BTC)? We are a small group of engineers, engineering technologists, technicians, and additional support staff dedicated to delivering for our customer on a variety of power solutions projects.
The Data Engineer II position will require the following key duties:
- Partner with software engineer, test engineers, test manager, and other stakeholders to translate business needs into technical data solutions
- Design and build reliable ETL/ELT data pipelines to ingest, transform, and move data appropriately
- Develop and maintain data lakehouse architectures and schemas within an air-gapped environment
- Manage job scheduling, monitoring, and troubleshooting using tools like PyIceberg and PySpark
- Implement data quality checks, unit tests, and validation frameworks to maintain high data reliability in a CI/CD framework
- Leverage and maintain an Ubuntu server, having familiarity with GitLab, Docker, and PostgreSQL for proper documentation and data cataloging
- Provide API integration with existing software products, including Jira and Confluence, to deliver reliable data updates
- Maintains a working knowledge of various software languages, including Python, as applicable
- Utilize AI-assisted development tools to improve coding efficiency and documentation
Responsibilities will include key duties, as well as excellent communication with coworkers and management; consistent, timely performance for all deliverable activities assigned; adherence to safe laboratory practices, as directed; maintaining a strong teamwork mentality, with the ability to adapt to a rapid work environment with multiple projects on-going at a time; and a responsive attitude toward all other duties assigned.