Data Engineer - Hadoop

Project description

We've been engaged by an Investment Banking client to work on Regulatory Reporting initiative in the Capital Risk portfolio.

Responsibilities

• Develop, maintain, and optimize SQL queries for data extraction, transformation, validation, and analysis across large datasets.
• Design, monitor, and troubleshoot batch jobs and data processing workflows using job scheduling and monitoring tools, preferably Control-M.
• Manage daily production job schedules, monitor job execution, investigate failures, and ensure timely resolution to minimize operational impact.
• Work with Hadoop ecosystem technologies to process, analyze, and troubleshoot large volumes of structured and unstructured data.
• Perform data validation, reconciliation, and quality checks to ensure data accuracy, completeness, and consistency.
• Analyze data and operational issues, identify root causes, and implement appropriate solutions to improve reliability and performance.

SKILLS

Must have

• 4 to 6 years of relevant experience in Data & Analytics.
• Hands-on experience in SQL, Job Scheduling and Monitoring Tool preferably Control M
• Good understanding and working experience in Hadoop.
• Strong analytical and problem-solving skills.
• Ability to work independently and collaborate effectively with cross-functional teams.

Nice to have

• Experience of Agile/Scrum development methodologies is a plus
• Be nice, respectful, able to work in a team
• Willingness to learn