To strengthen our AI / Data team, we are looking for a Data Engineer that will play a key role in supporting us with data modeling, quality, validation, analysis, governance, warehouse and ETL pipelines. The position of Data Engineer is a full-time and permanent position based in our office in the Basel, Switzerland. As part of our commitment to fostering a collaborative team environment, this role requires working fully on-site.
Tasks & Responsibilities
* Data modelling : design and implement data models that support business requirements and optimise for performance and scalability on large datasets.
* Data quality and validation : provide support and solutions to develop data quality checks within the pipelines to ensure data is always within its expectations.
* Data integration : integrate data from all sources within the company and make it equally available for local and remote organisations.
* Data analysis : develop and maintain insightful reports and dashboards to provide business metrics, trends and performances.
* Data governance : support ensuring data compliance and harmonisation by developing strong and meaningful collaboration with data governance team policies and regulations.
* Extract-Transform-Load (ETL) pipelines : create and maintain fast and efficient data pipelines from different relational and non-relational sources - MySQL, Apache Solr, MongoDB, APIs into a centralised data lake and data warehouse, using the Apache Airflow orchestrator.
* Data Warehouse tuning and optimisation : contribute to the optimisation and performance of the orchestrator and data warehouse to ensure durable environment health and scalability.
* Cross-functional collaboration : collaborate within an international environment to provide your expertise to data scientists, analysts and business stakeholders.
Requirements
* Degree in computer science or data engineering certification.
* Knowledge of Python programming language. Experience with Dataframe libraries (Polars, Pandas, Arrow, ...), and database toolkits (SQL Alchemy, ...).
* Hands-on experience with SQL.
* Knowledge of data engineering concepts and open-source ecosystem (Airflow, DBT, DuckDB, ...).
* Experience with relational databases. Knowledge of MySQL and PostgreSQL-specific features is a plus.
* Knowledge of semantic or hybrid search engines is a plus.
* Excellent problem-solving, communication, and organizational skills. Desire to learn, explore, discover new concepts and technologies.
* Proven ability to work independently and within a team.
What we offer
* The opportunity to contribute to the academic / scientific community;
* Team bond strengthening through team-building events;
* Professional growth opportunities with our global training system;
* Working in a collaborative, diverse, and socially responsible team;
* Company retreat facility;
* Full-coverage insurance for accidents / daily sickness;
* Prime location near Basel train station and city center;
* And more
Data Engineer • Basel · Basel - MDPI Headquarters
#J-18808-Ljbffr