Position: Data Engineer
Category: Data Engineer
English level: fluent
Years of experience: 3


As a Senior Data Engineer, I have: 

1. Designed and built pipelines to stream data from ERP Systems (SAP) using Apache NiFi to be consumed by a Last Mile Delivery application used to manage deliveries of the company. 

2. Ingested data from disparate sources such as SAP, Postgres, MongoDB, and MySQL into a data warehouse (Redshift) integrated with dbt to power transformations. 

3. Designed and implemented a real-time data pipeline to process semi-structured data to extract analytical points on game characters and players by integrating million raw records from the Riot Games API for League of Legends using Python, Spark, Databricks, and Azure Data Factory.

4. Collaborated with data scientists to extract and present analysis and recommendations using Power B.I. on 2 established and prospective customers, competitors, marketing channels, and resources to respond to rival marketing campaigns and improve unique selling points by 55%.

5. Developed a microservice with Microsoft REST APIs to organize and authenticate users and embedded Power B.I analytics into an application using the Django framework.

6. Managed the validation, documentation, and profiling of data to maintain quality and improve communication between teams.