Job Opportunity: Data Engineer
Overview:
We are seeking a highly experienced Data Engineer specialized in CMDB to design, develop, and maintain data pipelines and workflows using Apache Airflow for efficient data ingestion, transformation, and loading into the CMDB.
Your Responsibilities:
* Design and develop data pipelines and workflows using Apache Airflow for efficient data ingestion, transformation, and loading into the CMDB.
* Develop and optimize PL/SQL queries and stored procedures for data manipulation and retrieval within the CMDB environment.
* Utilize NoSQL databases for handling large volumes of configuration data.
* Integrate data from various sources into the CMDB using MuleSoft and other platforms.
* Conduct data reconciliation activities to ensure data accuracy across systems.
* Develop inventory data models based on the Common Information Model (CIM).
* Design and implement ETL processes for CMDB data updates.
* Collaborate with teams to align data requirements with business needs.
* Troubleshoot data issues, ensuring data integrity and availability.
* Document data processes, models, and configurations.
Your Profile:
* Proven experience in data engineering and data modeling.
* Proficiency in scripting languages such as Python, Perl, etc.
* Strong understanding of SACM principles and systems like Microfocus Asset Manager or Peregrine Asset Center.
* Deep knowledge of the CIM from DMTF.org.
* Proficiency with Apache Airflow.
* Knowledge of container solutions such as Kubernetes and iKube 2.0.
* Extensive experience with PL/SQL and NoSQL databases like MongoDB.
* Hands-on experience with MuleSoft or similar platforms.
* Strong data reconciliation and quality management skills.
* Expertise in inventory data modeling and ETL processes.
* Basic Anchor Modelling skills.
* Excellent problem-solving, analytical, and collaboration skills.
* Fluency in English; German is an advantage.
About You:
You have expertise in data engineering and a proven track record of delivering high-quality results. You possess excellent communication and teamwork skills, and you're able to adapt to changing priorities.