Senior Data Engineer (Python)

We are looking for a Senior Data Engineer to join our Сlient's data-platform project. The Client is a leading energy SaaS company that delivers highly technical insights and predictive & prescriptive analytics that help customers make decisions that increase profit. Their technologies support Production and investment strategies, energy & commodity trading and risk management, and cost reduction through automated processes across critical business functions. The company is a strategic partner to more than 6,000 customers in 50 countries.

In this role, you will design and build reliable, scalable data pipelines on Databricks. You will also develop Python back-end services and integrations in AWS. You will own technical decisions for your area, set engineering standards, and mentor mid-level engineers.

This role suits someone who enjoys end-to-end ownership, from data ingestion to Production-grade, well-monitored data products, and who is comfortable with secure cross-platform data exchange.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines on Databricks using PySpark and Delta Lake
• Define and evolve data models and the lakehouse architecture (bronze/silver/gold layers)
• Build and secure data exchange between AWS and Databricks, using S3 and other AWS sources and sinks
• Develop Python back-end services and APIs that serve or consume data products, and deploy them on AWS
• Write and optimize complex SQL for transformations, reporting & analytics, and tune performance on both Spark and relational databases
• Implement data quality checks, monitoring, logging, and alerting
• Own CI/CD and deployment of pipelines
• Run code reviews, set coding standards, and mentor Middle and Junior Engineers
• Maintain clear technical documentation

Requirements

• 5+ years of commercial experience in Data Engineering, including 3+ years of hands-on work with Databricks (clusters/jobs, notebooks, Delta Lake, Unity Catalog, Workflows)
• Strong PySpark skills: transformations, joins, window functions, and performance tuning
• Proven experience in designing ETL/ELT pipelines, including incremental loads, CDC, idempotency, and error handling & recovery
• Advanced SQL knowledge: query optimization, complex analytical queries, and data modeling (dimensional, normalized, medallion architecture)
• Solid experience with relational databases (PostgreSQL, MySQL, or MS SQL Server)
• Strong Python back-end skills: clean, testable, Production-grade code, plus experience in building APIs or services (FastAPI, Flask or Django)
• 3+ years of hands-on AWS experience, with practical knowledge of S3
• Experience with Git, CI/CD, and automated testing for data pipelines (unit, integration, data quality)
• Ability to design solutions independently, justify architectural decisions, and mentor other engineers
• English level - Upper-Intermediate or higher

We offer

• Modern technology: projects built on current stacks and tools, with room to explore new technologies and bring better engineering approaches to your team
• Ownership culture: a team of professionals who look beyond the task, understand the client's business, and propose solutions that make the product better. People here own outcomes, flag risks early, and hold a high engineering standard
• Professional growth: lead or join Competence Clubs, speak at TechTalks, get company-paid certifications, grow with our professional library and learning platforms, and improve your English, German, or Polish via courses or speaking clubs
• Flexible work: remote-first, equipment and IT support, plus availability to work from offices in Lviv and Rzeszów
• Time off & well-being: 18 paid vacation days, 12 paid sick days, medical insurance or a monthly health & sports budget*, psychologist consultations, paid leave for life events, and paid maternity leave. *The format varies depending on your cooperation model