Position: Big Data Engineer
Category: Data Engineer
English level: fluent
Years of experience: 4


Various projects at previous clients in Luxembourg includes:
- Creating in-house framework to transition in different curated stage of the company datalake. Reducing license costs and dependency to exterior data provider.Reduced manpower through automatization and deployment of open-source technologies (Apache Trino, Apache Spark, HDFS, MariaDB ...).
-Building a data-vault to ensure data consistency and adapt to GDPR compliance. Design the layout and define keys relationships between entities.
-Ingest massive amount of critical data on a daily basis, responsible for pipeline deployment and maintenance (Apache Airflow) and curation related tasks (Python/Pyspark). Testing deployment on DevOps technologies (Kubernetes, Docker, Kind)
Part-time teaching at the ESGF-Finance as a Big Data Professor for Master 2 Students and at ECE for DevOps modules (Kubernetes, Docker, Ansible, Vagrant...).