APPLYDJINN
Vacancy catalog
EPAM
Open role

Lead Python Data Engineer

EPAMUkraine
Work model
Remote
Experience
5+ years
Employment
Not specified
Compensation
Not disclosed
Technology signal
8 tags

Technology context

8

Parsed from the vacancy text; ordered by relevance to this role.

AIAzurePythonReliability EngineeringScalabilityDatabricksAzure Data FactoryData Software Engineering

Full listing

Role description

We are in search of a skilled Lead Python Data Engineer to join our team. The successful candidate will play a crucial role in developing data pipelines in Azure, with a primary focus on building a Data Quality framework.

Responsibilities

  • Develop and maintain data pipelines in Azure, with a specific focus on DQ framework development
  • Collaborate with cross-functional teams to design, develop, and implement data solutions
  • Create and implement data models and processes for data extraction, transformation, and loading
  • Optimize and monitor data pipeline performance and reliability
  • Ensure data quality and integrity throughout the data pipeline process
  • Troubleshoot and resolve data pipeline issues in a timely manner
  • Contribute to the continuous improvement of data engineering best practices
  • Provide technical guidance and support to team members as necessary

Requirements

  • Minimum of 5 years of experience in Data Software Engineering
  • 1+ years of relevant leadership experience
  • Proficiency in Python and hands-on experience with Azure Data Factory
  • Strong understanding and practical knowledge of Databricks
  • Ability to design, develop, and maintain scalable data pipelines
  • Solid understanding of data modeling, data access, and data storage techniques
  • Experience with data pipeline orchestration and workflow management
  • Strong analytical and problem-solving abilities
  • Excellent written and verbal communication skills
  • B2+ English level proficiency