APPLYDJINN
Vacancy catalog
OLD

Long-running vacancy

This listing is older than 30 days but its source has not removed it. Verify availability on the original company page before applying.

SoftServe
Open role>1 month

Senior/Lead Big Data Engineer (Databricks + GCP)

SoftServeRomania; Bulgaria; Poland
Work model
Hybrid
Experience
5+ years
Employment
Full Time
Compensation
Not disclosed
Technology signal
13 tags

Technology context

13

Parsed from the vacancy text; ordered by relevance to this role.

AIJavaPythonGCPCloud NativeCloudReliability EngineeringKafkaScalabilitySparkDatabricksSQLAirflow

Full listing

Role description

ABOUT THE ROLE

In this role, you will contribute to building scalable and reliable data solutions on Google Cloud Platform, leveraging modern Big Data technologies and cloud-native services. You will work with batch and streaming data processing systems, helping organizations transform, manage, and unlock the value of their data. As part of a collaborative engineering team, you will participate in the full project lifecycle, from discovery and solution design to implementation and production deployment.

RESPONSIBILITIES

  • Design, develop, and maintain scalable data pipelines for batch and streaming workloads
  • Build and optimize data processing solutions using Python (must), SQL, Java, Apache Spark, and Databricks
  • Create cloud-native data architectures leveraging GCP services including BigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Storage
  • Support development of modern data platforms and analytics solutions on GCP with GCP native services and Databricks
  • Implement data transformation, modeling, and analytics engineering practices using dbt and Dataform
  • Collaborate with business stakeholders, architects, and engineering teams to translate data requirements into effective technical solutions
  • Contribute to technical design discussions, architecture decisions and continuous improvement initiatives
  • Ensure data quality, reliability and performance across data processing workflows
  • Support end-to-end project delivery, including PoCs, MVPs, production deployments and platform enhancements

REQUIREMENTS

  • 5+ years of professional experience in Big Data or Data Engineering
  • Advanced expertise in Python and SQL (Java nice to have) for large-scale data processing and transformation
  • Hands-on experience developing data solutions on Google Cloud Platform (GCP)
  • Experience with Apache Spark and data processing frameworks such as Cloud Dataflow or Apache Beam
  • Proven background building scalable solutions using Databricks and Lakehouse concepts
  • Experience with orchestration tools such as Apache Airflow or Cloud Composer
  • Knowledge of streaming technologies such as Apache Kafka or Google Cloud Pub/Sub
  • Strong knowledge of BigQuery and modern cloud data architectures
  • Experience with data transformation and modeling tools such as dbt and Dataform
  • Strong analytical thinking, troubleshooting capabilities, and problem-solving skills
  • Effective communication with both technical and non-technical stakeholders
  • Upper-intermediate or higher level of English