Vacancy catalog
OLD

Long-running vacancy

This listing is older than 30 days but its source has not removed it. Verify availability on the original company page before applying.

SoftServe
Open role>1 month

Big Data Architect (Databricks + AWS)

SoftServeUkraine
Work model
Hybrid
Experience
7+ years
Employment
Full Time
Compensation
Not disclosed
Technology signal
12 tags

Technology context

12

Parsed from the vacancy text; ordered by relevance to this role.

Full listing

Role description

ABOUT THE ROLE

In this role, you will design and help implement scalable data platforms and data processing solutions on AWS. You will work across batch and real-time architectures, contributing to data ingestion, modeling, and analytics capabilities. As part of a collaborative engineering environment, you will partner with technical and business stakeholders to deliver reliable and production-ready solutions.

RESPONSIBILITIES

  • Design and implement scalable data pipelines and data platform components on AWS, ensuring reliability, performance, and maintainability
  • Own end-to-end delivery of data processing solutions, improving data quality, availability, and time-to-insight across use cases
  • Collaborate closely with engineers, architects, and business stakeholders to translate requirements into robust technical designs
  • Build and maintain batch and streaming data processing architectures using modern big data frameworks
  • Develop and manage data ingestion processes, including source-to-target mappings and onboarding new data sources
  • Orchestrate workflows using Apache Airflow or MWAA, ensuring efficient scheduling, monitoring, and error handling
  • Implement real-time data solutions using Apache Kafka, Amazon MSK, or Kinesis to support streaming use cases
  • Contribute to data warehousing and analytics solutions using Snowflake or Amazon Redshift, and maintain documentation and data models

REQUIREMENTS

  • Strong experience designing and building scalable data platforms and pipelines
  • Proven hands-on expertise with AWS services for data engineering and analytics workloads
  • Proficiency in Python, Scala, or Java, with strong SQL skills for data manipulation and querying
  • Experience with big data technologies such as Apache Spark, Databricks, or Flink
  • Practical knowledge of orchestration tools like Apache Airflow or MWAA
  • Experience working with streaming technologies such as Apache Kafka, Amazon MSK, or Kinesis
  • Familiarity with data warehousing solutions including Snowflake or Amazon Redshift
  • Analytical mindset with the ability to translate business needs into technical solutions
  • Upper-intermediate or higher level of English, with effective communication skills in a global environment