Senior Data Engineer

Project description

Our client is a comprehensive-stack digital banking solutions provider empowering banks and financial institutions to scale and modernise at speed.

We're looking for a Senior Software Engineer I, Data Engineer to design, build, and operate resilient, secure data platforms supporting structured, semi-structured, and unstructured data at scale. In this role, you'll own the delivery of data storage, access, and analytics components within your assigned scope - implementing secure data access, real-time analytics pipelines, and disaster-resilient replication and backup strategies. You'll work closely with engineering, security, and platform teams to ensure data solutions are reliable, secure, and maintainable.

Responsibilities

• Design, build, and operate structured, semi-structured, and unstructured data stores supporting real-time and batch analytics workloads within your assigned scope.
• Recommend and apply appropriate distributed data and computation technologies for assigned use cases, balancing performance, scalability, and maintainability.
• Implement secure, reliable access patterns for connecting to multiple internal and external data sources.
• Apply encryption and other controls to protect data at rest in line with security standards.
• Build and maintain real-time analytics pipelines using distributed processing frameworks such as Spark and Presto/Trino.
• Containerize and deploy data services using Kubernetes and related orchestration tooling.
• Design and implement data replication strategies to support active/active data center resilience.
• Design, implement, and test backup and recovery procedures for owned data platforms.
• Own code quality, testing, and documentation for data engineering components within your scope.
• Collaborate with engineering, security, and platform teams to ensure data solutions meet reliability and operational standards.

SKILLS

Must have

• 6 - 9 years of software engineering experience, including at least 2 - 3 years working with distributed data stores and distributed computation.
• Hands-on experience with one or more distributed data technologies such as Elasticsearch, Cassandra, Hadoop, or MongoDB.
• Strong proficiency in Scala
• Experience with Spark and Presto or Trino for large-scale data processing.
• Experience with microservice-based architectures.
• Hands-on experience with Kubernetes and container-based deployment.
• Working knowledge of NoSQL data stores.
• Experience operating in Unix/Linux environments.
• Familiarity with Agile/Scrum delivery practices.

Nice to have

• Cloud platform experience (AWS or GCP)
• Retail banking data experience
• Java