Senior Data Engineer - Palantir Foundry

We are seeking a Senior Data Engineer to lead the design, implementation, and optimization of enterprise-scale data solutions using Palantir Foundry or Databricks, bringing deep technical expertise in data engineering and strong analytical capabilities to guide delivery teams in developing high-performance data products.

Responsibilities

• Design and implement scalable data pipelines and reusable data products
• Lead the development of complex data transformation frameworks using PySpark and SQL
• Define and promote data engineering best practices across delivery squads
• Drive performance tuning, data quality improvements, and operational reliability initiatives
• Optimize large-scale processing workloads and data models
• Establish monitoring, observability, and troubleshooting standards
• Provide technical guidance and mentorship to junior and intermediate data engineers
• Collaborate with architects and business stakeholders on solution design and delivery planning
• Contribute to platform governance, standards, and engineering excellence initiatives
• Translate business requirements into scalable technical solutions
• Support delivery of enterprise analytics and reporting capabilities

Requirements

• Extensive experience (3+ years) in Palantir Foundry Data Engineering or Databricks
• Expertise in PySpark and SQL
• Proven experience designing large-scale ETL/ELT pipelines and data architectures
• Knowledge of distributed data processing and performance optimization
• Experience leading technical delivery within data engineering teams
• Understanding of data modeling, governance, and data quality practices
• English proficiency at B2 level or higher

Nice to have

• Experience with both Palantir Foundry and Databricks
• Background in reinsurance or insurance industry processes, particularly finance-related data domains
• Experience working in complex enterprise environments
• Knowledge of cloud-native analytics and data platforms