Vacancy catalog
EPAM
Open role

Senior Data Engineer

EPAMArgentina; Brazil; Chile; Colombia; Mexico
Work model
Remote
Experience
5+ years
Employment
Not specified
Compensation
Not disclosed
Technology signal
13 tags

Technology context

13

Parsed from the vacancy text; ordered by relevance to this role.

AIAI-Assisted DevelopmentAzurePythonScalabilitySparkDatabricksScalaSQLData ArchitectureData Software EngineeringData Solution ArchitecturePySpark

Full listing

Role description

We are looking for a Senior Data Engineer to build a next-generation retail and omnichannel analytics platform, and we need you to drive hands-on data engineering, platform best practices, and scalable architecture. You will shape ingestion and transformation frameworks, enable self-service analytics, and advance AI-enabled engineering.

Responsibilities

  • Design scalable data ingestion, transformation, and data product frameworks
  • Define Databricks best practices for medallion layers, governance, and performance
  • Build batch and near real-time pipelines using Databricks and Spark
  • Deliver end-to-end data products for retail and omnichannel analytics use cases
  • Develop trusted analytical datasets, semantic models, and governed consumption layers
  • Implement data quality, lineage, monitoring, and observability standards
  • Lead proof-of-concepts to evaluate and adopt new platform capabilities
  • Define AI SDLC and AI-assisted development patterns for engineering teams
  • Partner with cross-functional stakeholders to align solutions and ensure adoption
  • Mentor engineers on reusable frameworks and operational excellence

Requirements

  • 3+ years of data engineering experience
  • Strong leadership skills to drive technical direction and mentor engineers
  • Proven project delivery skills across end-to-end analytics lifecycles
  • Advanced Databricks skills in enterprise production environments
  • Expert Apache Spark and PySpark skills for scalable data processing
  • Strong SQL skills for analytics, modeling, and performance tuning
  • Upper-Intermediate English proficiency (B2)

Nice to have

  • Data architecture experience for lakehouse and enterprise analytics platforms
  • Data solution architecture experience to standardize patterns across teams
  • Scala experience for Spark-based pipeline development