Middle BigData Engineer (Databricks + Azure)

ABOUT THE ROLE

In this role, you will develop and maintain reliable data solutions using Databricks and Azure. You will work with batch and streaming data pipelines, support data processing and optimization activities, and collaborate with the team to deliver production-ready data solutions.

RESPONSIBILITIES

• Develop and maintain batch and streaming ETL pipelines on the Databricks Lakehouse platform
• Build and optimize data processing solutions using PySpark, Python, and SQL
• Work with Databricks clusters, SQL Warehouses, and Delta Lake
• Support bronze - silver - gold Lakehouse architectures
• Apply data governance practices using Unity Catalog
• Develop and deploy data solutions using CI/CD processes
• Work with Databricks SQL and BI tools such as Power BI
• Collaborate with team members and stakeholders to understand requirements and implement data solutions
• Participate in troubleshooting, performance optimization, and continuous improvement activities

REQUIREMENTS

• 4+ years of professional experience in Data Engineering
• Hands-on experience with Databricks and Azure
• Good knowledge of PySpark, Python, and SQL
• Experience developing and maintaining ETL/ELT data pipelines
• Understanding of Delta Lake and Lakehouse architecture concepts
• Experience working with Databricks clusters and SQL Warehouses
• Basic or practical knowledge of Unity Catalog and data governance concepts
• Understanding of CI/CD practices for data solutions
• Upper-intermediate or higher level of English
• Good communication and collaboration skills
• Experience with Azure services such as ADF, Synapse, ADLS, Azure DevOps, Microsoft Fabric (nice to have)
• Familiarity with Databricks AI/BI capabilities such as MLflow, Dashboards, Metric Views, or Genie (is a plus)