Responsibilities
As a Big Data Engineer, you will support the client in preparing datasets and data pipelines, assisting business users, and troubleshooting data-related issues. Your key tasks include:
* Developing XML-based ingestion pipelines into the Data Platform using Hive and S3.
* Building
native IBM MQ-based schemaless data ingestion solutions.
* Collaborating closely with business stakeholders to ensure data availability and quality.
Qualifications
We are looking for a hands-on data expert with strong technical and domain knowledge:
* Proven experience with Big Data technologies and open-source components such as Hadoop, Hive, Spark, Trino, Airflow/NiFi, MinIO, Kubernetes, and Kafka.
* Expert-level SQL skills, ideally across both traditional data warehouse and distributed environments.
* Familiarity with banking data products and the financial sector.
* Deep understanding of metadata management and related tools.
* Strong grasp of data modeling standards, processes, and tools (e.g., cleansing, metadata).
* Experience working in Agile project environments.
Benefits
* Work alongside a highly qualified and collaborative team.
* Opportunity to contribute to impactful data initiatives in the financial sector.
* Exposure to cutting-edge technologies and complex data ecosystems.