Senior Migration Consultant

Project description

This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue - a foundational shift in how one of the world's largest financial market infrastructure companies handles its data pipelines.

During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration.

The work is technically rich and highly collaborative: you'll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate client's rigorous internal governance - from Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision.

This is the kind of engagement where your recommendations directly shape a multi-phase, multi-million-pound programme: the target-state framework you produce here becomes the blueprint that a larger delivery team will execute against. Perfect opportunity for combining deep data engineering knowledge with architecture leadership, stakeholder influence, and structured delivery planning inside a Tier 1 financial services environment

Responsibilities

• -Wave planning - plan migration waves based on system dependencies and priorities

-Complexity assessment - evaluate complexity of each workload/job prior to migration

-Workload analysis - analyze existing batch processes, their dependencies, schedules, and SLAs

-Orchestration migration strategy - design the strategy for migrating from Control-M to AWS Step Functions (job mapping, dependencies, triggers)

-Cutover runbook - develop detailed cutover runbooks (steps, rollback points, success criteria)

-Pod coordination - coordinate across multiple teams/pods involved in the migration

-Release governance - manage release processes, ensuring quality and compliance with standards prior to deployment

SKILLS

Must have

• - Large-scale migration experience - proven track record on enterprise-scale migration projects
• Wave planning - hands-on experience planning waves in multi-system migrations
• AWS Step Functions - hands-on experience designing and building workflows in Step Functions
• Risk assessment - experience identifying and mitigating risks in migration projects
• Data reconciliation - experience validating data/results post-migration (before/after comparison)
• Release management - experience managing releases in an enterprise environment

Nice to have

• Experience with other orchestration tools (Airflow, AWS Glue Workflows)
• AWS certification (Solutions Architect / DevOps Engineer)
• Experience in financial domain
• Control-M - deep knowledge of Control-M (jobs, schedules, dependencies, calendars)