Position: Data Engineer, Software Engineer
Category: Python
English level: upper
Years of experience: 4

Scraped 28m records during 2 weeks from the site which bans users every 20 requests.
Rewrote old repository with 432 scrapers from python2 to python3.
Deployment of Apache Airflow and synchronizing its DAGs via Amazon S3.
Deployment of TOR as a microservice for proxying requests using HAproxy and Polipo.
Accelerated calculation and processing of geospatial data by 20 times
Worked as Tech Lead in a separate team.
Soft and polite scraping of floorplan images from different data sources (14m+ of images, 1.4+ terabytes).
Proposed and implemented architecture refactoring for P&L calculation which made it stable and 30x faster.
Worked with OpenAI LLM integration (using langchain) to create a chatbot which can use tools to query Elasticsearch and recommends some real estate properties based on users' needs.
Experienced Software Engineer with 4 years of expertise in Python, ETL, microservices, and web scraping. I have contributed to backend application and API development, handled large-scale data scraping projects, and worked on diverse data science initiatives involving satellite image processing, geospatial data, and data collection. Proficient in service architecture and event-driven design. Worked on the refactoring of legacy code. Additionally, I have actively participated in various CI/CD tasks.
Looking for a mixed (opportunity to work remotely and in the office) job, ready to work with backend tasks, data extraction, transformation and load (ETL), and additionally interested in R&D tasks.