Vacancy catalog
AgileEngine
Open role>14 days

Data Engineer

AgileEngine
India; Poland; Portugal +5 more

India; Poland; Portugal; Bulgaria; Romania; Spain; Slovakia; Slovenia

Work model
Remote
Experience
2+ years
Employment
Full Time
Compensation
Not disclosed
Technology signal
11 tags

Technology context

11

Parsed from the vacancy text; ordered by relevance to this role.

Full listing

Role description

About the role

We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

The mandatory requirements are 3+ years of Python , advanced SQL, Snowflake modeling, Airflow, Kafka, Spark/PySpark, Iceberg , Parquet , AWS S3 , testing/debugging, 2+ years with large-scale Airflow/Spark data, overlap until 12 PM Pacific Time , and upper-intermediate English. Snowflake/Airflow migrations and AI tools are a plus.

Must haves

  • Strong software engineering fundamentals.
  • 3+ years of hands-on Python development experience.
  • Advanced SQL , including complex joins, CTEs, window functions, and performance tuning.
  • Snowflake data modeling.
  • Apache Airflow - developing and testing pipelines in Airflow and Python.
  • Apache Kafka.
  • Apache Spark , including hands-on PySpark experience.
  • Iceberg and Parquet data formats.
  • AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
  • Testing strategy experience, with the ability to hands-on debug and test code.
  • At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
  • Overlap until 12 PM Pacific Time.
  • Upper-intermediate English level.

Nice to haves

  • Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization).
  • Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations).
  • Experience using AI tools for development.

What you will do

  • Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
  • Execute the migration of approximately 1,000 datasets to Snowflake.
  • Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
  • Ensure data quality and reliability throughout the migration process.
  • Support workflow scheduling and monitoring in Apache Airflow 3.
  • Execute time-sensitive migrations, including Airflow 2 to 3, Confluent region migration, and the move to Iceberg.
  • Help accelerate the migration initiatives targeted for completion by the end of March 2027.

Perks

  • Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
  • Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
  • Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
  • Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
  • Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
  • Well-being & support: access local well-being programs and people-focused support tailored to your location