Position: Junior Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 0.5

• Data extractor (xls, docx): I have developed a data extractor for laboratory documentation (the program reads Word file, with regex it takes necessary data and writes it to csv). All code is written in python using pandas, re, docx, math and os libraries.

• Web Scrapers: I have done several crawlers for websites with Scrapy library; the spiders crawl websites and download the required data, including images. 

• Data processing: Experienced in processing raw data with pandas and spark dataframes
Currently, I am involved in ETL project with the following technology stack:
- Scrappy
- AWS EMR
- AWS S3
- AWS Athena
- Elastic Search
- Jupyter Notebooks
- Pandas
- Spark
- regex
My responsibilities include: scrappinh  websites, processing the obtained data and loading it to Athena and Elastic. 

Right before this project I studied at EPAM Big Data Lab where I worked with such tools: 
- Apache Spark / Spark Streaming
- Hive
- Kafka
- Elasticsearch and Kibana
- Airflow
I am looking for a data engineering job with possibilities to learn new things and grow continiously