APPLYDJIN
Vacancy catalog
EPAM
Open role>14 days

Senior Apache Airflow Engineer

EPAMPoland, Gdansk; Poland, Krakow; Poland, Wroclaw
Apply on company site
Work model
Hybrid
Experience
5+ years
Employment
Not specified
Compensation
Not disclosed
Technology signal
8 tags

Technology context

8

Parsed from the vacancy text; ordered by relevance to this role.

PythonGCPKubernetesCloudDevOpsLinuxRESTAirflow

Full listing

Role description

We are seeking a Senior Apache Airflow Engineer to join our team and lead the development, maintenance and optimization of scalable workflow orchestration solutions built on Apache Airflow.

Responsibilities

  • Develop and maintain custom Airflow Operators, Hooks and Sensors
  • Integrate new Airflow versions with Cloud Composer
  • Fix bugs and implement improvements within Airflow
  • Implement unit and solution testing for Airflow workflows
  • Create internal documentation for work artifacts
  • Coordinate development activities within the team and support delivery planning
  • Collaborate with cross-functional and distributed teams to support delivery and resolve technical issues
  • Support junior team members through knowledge sharing, technical guidance and code review
  • Participate in technical discussions with clients and coordinate prioritization of development activities

Requirements

  • 5+ years of experience in Python development
  • Proficiency in Cloud APIs (REST/RPC)
  • Knowledge of DevOps and SysAdmin practices
  • Familiarity with Linux and Kubernetes including container image building
  • Understanding of Cloud platforms particularly Google Cloud Platform
  • Skills in English communication both spoken and written

Nice to have

  • Expertise in Airflow or similar workflow tools such as Luigi, Oozie, Argo or Apache NiFi
  • Background in working with Open Source communities
  • Understanding of Cloud Architecture including scalability and IaaS principles
  • Google Cloud Certification (e.g. GCP Architect or Data Engineer)