Position: Data Engineer
Category: Data Engineer
English level: intermediate
Years of experience: 3

Architected and built a data lake solution utilizing AWS S3 as a storage layer, and Athena and Python as a powerful query and transformation engine, which enabled you to store any data as it is, eliminating the need for costly and time-consuming data transformations.

Designed and implemented a custom ingestion engine that facilitated a 40% increase in data processing efficiency while enabling seamless data ingestion from various production databases into the data lake. That allowed for more streamlined data processing and captured historical data.

Developed a custom Python package that utilizes AWS services and a public Python package to efficiently serve, clean, and transform data from the data lake, resulting in a 60% reduction in data processing time for various teams.

Implemented data documentation using OpenMetadata and hosted it on AWS Lambda to improve data governance and discoverability. As a result, the number of data-related questions to the data engineering team has decreased by 80%.
I have architected and built a data lake solution using AWS S3 as a storage layer, Athena and Python as a powerful query and transformation engine. I have also designed and implemented a custom ingestion engine, developed a custom Python package, implemented data documentation using OpenMetadata, and deployed a credit scoring API using AWS Lambda and microservices architecture. My current role as a Data Engineer at Kifiya Financial Technologies is to ensure that the data stored in the data lake is fit for purpose and meets the diverse needs of data consumers.

In terms of improvement, I am focusing on developing my skills in Big Data Analytics. Additionally, I am working on improving my communication and collaboration skills, which are essential for effective teamwork and stakeholder engagement.
As a Data Engineer, my ideal expectation is to work on challenging data projects that allow me to apply my technical skills and problem-solving abilities. I hope to collaborate with cross-functional teams to design and implement scalable and reliable data solutions that drive business success. Additionally, I would like to contribute to data governance and quality control measures to ensure the trustworthiness and usability of the data. I aspire to become a subject matter expert in the field of data engineering, stay up-to-date with emerging technologies and industry trends, and provide mentorship and guidance to junior data engineers.