Position: Big Data Engineer
Category: Python
English level: intermediate
Years of experience: 3

Created system for keeping databases up to date:
-scrapping open web sources;
- data cleaning and transforming;
- upload data

Automated flow for data extraction and insights creation:
- extraction from DB;
- data processing with business requirements;
- sending to requester
Retail project:
Creation of ETL pipelines for Data Lake.
Performance improvements for Spark jobs.
Mobile advertising project:
Creation of web scrapping tools, data cleaning and verification, ETL processes.Data processing with decision trees and multiprocessing. Creation of PySpark applications for huge data processing. Producing data insights for more business value.