Senior Data Engineer
Project description
Our client is a comprehensive-stack digital banking solutions provider empowering banks and financial institutions to scale and modernise at speed. We're looking for a Senior Software Engineer I, Data Engineer to design, build, and operate resilient, secure data platforms supporting structured, semi-structured, and unstructured data at scale. In this role, you'll own the delivery of data storage, access, and analytics components within your assigned scope — implementing secure data access, real-time analytics pipelines, and disaster-resilient replication and backup strategies. You'll work closely with engineering, security, and platform teams to ensure data solutions are reliable, secure, and maintainable.
Responsibilities
- Design, build, and operate structured, semi-structured, and unstructured data stores supporting real-time and batch analytics workloads within your assigned scope.
- Recommend and apply appropriate distributed data and computation technologies for assigned use cases, balancing performance, scalability, and maintainability.
- Implement secure, reliable access patterns for connecting to multiple internal and external data sources.
- Apply encryption and other controls to protect data at rest in line with security standards.
- Build and maintain real-time analytics pipelines using distributed processing frameworks such as Spark and Presto/Trino.
- Containerize and deploy data services using Kubernetes and related orchestration tooling.
- Design and implement data replication strategies to support active/active data center resilience.
- Design, implement, and test backup and recovery procedures for owned data platforms.
- Own code quality, testing, and documentation for data engineering components within your scope.
- Collaborate with engineering, security, and platform teams to ensure data solutions meet reliability and operational standards.
SKILLS
Must have
- 6–9 years of software engineering experience, including at least 2–3 years working with distributed data stores and distributed computation.
- Hands-on experience with one or more distributed data technologies such as Elasticsearch, Cassandra, Hadoop, or MongoDB.
- Strong proficiency in Scala
- Experience with Spark and Presto or Trino for large-scale data processing.
- Experience with microservice-based architectures.
- Hands-on experience with Kubernetes and container-based deployment.
- Working knowledge of NoSQL data stores.
- Experience operating in Unix/Linux environments.
- Familiarity with Agile/Scrum delivery practices.
Nice to have
• Cloud platform experience (AWS or GCP) • Retail banking data experience • Java
Required Skills
Required Languages
🇬🇧 English