This foundational role consolidates multiple responsibilities into a single, highly skilled position, ensuring the design, development, and maintenance of the full enterprise data lakehouse environment. The Data Platform Engineer will be responsible for architecting scalable and secure solutions leveraging Apache Iceberg, Apache Spark, Apache Flink, Apache NiFi, Kafka, and SingleStore. The role includes managing ingestion pipelines, optimizing high -performance databases, implementing CI/CD for platform deployments, and enforcing governance, security, and data quality across all layers. The engineer will also enable self -service capabilities for internal consumers, collaborating closely with business stakeholders, architects, and data scientists to ensure reliability, performance, and scalability across the platform.
Core Responsibilities
* Design and maintain the entire data lakehouse architecture using Apache Iceberg, Apache Spark, and Apache Flink.
* Manage data ingestion pipelines with Apache NiFi and Kafka.
* Implement and optimize SingleStore databases for high -performance querying.
* Build and maintain CI/CD pipelines for data platform deployments.
* Ensure data quality, governance, and security across all platforms.
* Provide self -service capabilities for data consumers.
Requirements
o 5+ years experience in data platform engineering or platform engineering
o Expertise in your full stack: Apache Spark, Kafka, NiFi, Flink, Apache Iceberg, SingleStore
o Cloud platforms (AWS, Azure, GCP) and containerization (Docker, Kubernetes)
o Infrastructure as Code (Terraform, CloudFormation)
o Python, Java, or Scala programming
o SQL and data modelling expertise
Mandatory strong multi -tool expertise across Spark, Flink, Iceberg, Kafka, NiFi, and SingleStore.
o Ability to manage complex end -to -end data platform engineering with minimal supervision.
Benefits
Competitive salary and long -term project commitment.
Hybrid work model with flexibility for remote days.
Opportunity to work with cutting -edge technologies in a global environment.
Professional growth through exposure to a diverse and highly skilled international team.