Position: Data Engineer
Category: Data Engineer
English level: fluent
Years of experience: 3

- Improved company’s evaluation significantly by building a client facing reporting dashboard that process more than 2GB of log data daily that helps the company standout from competitors as data driven adtech business.
- Prevent a historical data loss from a third-part platform by ingesting an API call on a daily basis which then partition and load the data to an S3 data lake in parquet format.
Experienced in building and managing high-performance big data pipelines to enrich data for analytics, ML and AI, delivering analytics solutions using BI tools such as Power BI, Tableau and superset, designing and implementing efficient data infrastructure to organize and refine data.

I am currently working as a data engineer. My role involves building data pipelines, developing campaign performance reports that meets client’s requirement, onboarding and coordinating junior data engineers.
- Improved company’s evaluation significantly by building a client facing reporting dashboard that process more than 2GB of log data daily that helps the company standout from competitors as data driven adtech business - providing real time, mission critical, performance boosting, and quality controlling insights and intelligence to clients. It has three microservices, among which two are containerized in docker: React app with ApexCharts, Flask API and ETL pipeline.
- Prevent a historical data loss from a third-part platform by ingesting an API call on a daily basis which then partition and load the data to an S3 data lake in parquet format.
- Diminish the time it take to get a report for campaign managers to almost zero by orchestrating a google sheet report generator python script with AWS Athena and Glue.
- Reduced development time by 10 hrs to develop flask authentication module for all data team by building authenticator package that can be easily used as a decorator.
- Avert incorrect reporting flow that would drive away clients by exploring the data and identifying the cause of a discrepancy.

I am keen to utilize my skills to create data solutions with a heavy emphasis on great user experience and looking to further improve my skills in big data engineering.