Data DevOps Engineer

We are seeking a skilled Data DevOps Engineer to configure CI/CD for data pipeline rollouts and build robust AWS infrastructure using Terraform, ensuring reliable and scalable data operations. If you are ready to take on this exciting opportunity, apply now!

Responsibilities

• Collaborate with architects and data engineers to gather requirements and translate them into CI and infrastructure setups
• Create and manage AWS infrastructure through Terraform to support data operations
• Document CI/CD processes meticulously to ensure repeatability and maintain standards

Requirements

• 2+ years of experience building and maintaining complex CI/CD pipelines on AWS, including automated testing, artifact management and multi-environment deployments with quality gates, security scanning and infrastructure validation
• Expertise in AWS core services including S3, VPC and EC2, with particular need for operating production-grade systems on Amazon Elastic Kubernetes Service
• Proficiency in Terraform including modular infrastructure design, reusable modules, environment isolation and integration with CI/CD pipelines for automated infrastructure provisioning and updates

Nice to have

• Familiarity with Redshift, Glue, Spark and Athena for data processing and analytics workloads
• Familiarity with AWS Cloud Development Kit, AWS CloudFormation and Amazon Managed Workflows for Apache Airflow
• Skills in Jira and Confluence