Senior DataOps Engineer
We are seeking an experienced and highly motivated Senior DataOps Engineer to join our international team. This team is dedicated to the design and development of the WinGD Integrated Digital Expert (WiDE) product. As a Senior DataOps Engineer, you will play a critical role in managing our data infrastructure; optimizing and automating our data pipelines, ensuring data quality, and enhancing the overall efficiency of our data operations. You will collaborate closely with the data analytics team and operation support experts, as part of the system and software development team to build and maintain scalable, reliable, and secure system infrastructure.
Key Responsibilities :
* Manage data infrastructure: ensure the health and economical operation of databases (both cloud-based and edge-based), APIs, and data pipelines.
* Data Quality and Governance: Ensure data integrity, consistency, and accuracy through data validation and quality control measures.
* Monitoring and Optimization: Monitor data system performance, troubleshoot issues, and optimize processes to improve data throughput and reliability.
* Data Pipeline Development: Design, develop, and maintain robust, scalable, and efficient data pipelines for ETL / ELT processes.
* Automation and Orchestration: Implement automation solutions for data workflows and ensure seamless integration and orchestration of data tasks.
* Collaboration: Work closely with the data analytics team and operation support experts, as part of system and software development, to understand data requirements and deliver solutions that meet business needs.
* Security and Compliance: Implement and enforce data security measures and ensure compliance with relevant data protection regulations.
* Tool and Technology Evaluation: Stay up-to-date with emerging technologies and tools in the DataOps space and make recommendations for their implementation.
Required Skills and Qualifications :
* Experience: Minimum of 5 years in large-scale data infrastructure management, data engineering, data operations, or related fields, with at least 2 years in a DataOps role. Experience with time series data and logs handling.
* Technical Skills: Proficiency in SQL and experience with databases (MySQL, DynamoDB, InfluxDB). Familiar with IoT solutions. Experience with AWS and cloud services (Lambda, S3, Athena). Expertise in Python and scripting languages. Familiar with data pipeline tools and big data technologies. Knowledge of containerization and orchestration tools (Docker, Kubernetes). Understanding of system interfaces, protocols, and standards (API, Modbus, OPC, MQTT). Experience in data modeling and database design. Knowledge of CI/CD practices and tools (Jenkins, GitLab CI). Familiar with data security best practices.
* Soft Skills: Strong problem-solving and analytical skills. Excellent communication and teamwork abilities. Ability to work in a fast-paced, agile environment. Detail-oriented with a focus on data quality and accuracy. Proficient in English, both oral and written.
* Education: Degree in Computer Science, Information Technology, Engineering, or a related field.
Our offer :
* An opportunity to shape the sustainability and environmental impact of the shipping industry. WinGD is at the forefront of technology shaping the future of shipping.
* A dynamic working environment, blending a long history of technological expertise with industry-leading innovation across a global network.
* Award-winning and extraordinary products.
* Multi-cultural and interdisciplinary teams offering diverse perspectives and collaborative thinking.
* Dynamic and interactive working conditions. WinGD offers a non-hierarchical, agile structure where input and ideas are welcome.
* In-house technology training and professional development opportunities.
#J-18808-Ljbffr