Position: Data Engineer
Category: Data Engineer
English level: pre
Years of experience: 3


I have been employed at Alfa-Bank (Sense Bank) since December 2020 and continue to work there presently.

Responsibilities in the company:
Development of decision-making systems for banking systems using Spark (pyspark), Kafka, and Hadoop technology.
Responsible for ETL processes (MSSQL, Pyspark, BigQuery) and construction of pipeline stack technologies (Airflow, Google Cloud Dataflow).
Development of dashboards (Django) and other types of data visualization (Libraries Seaborn, Matplotlib, and others...).
Administration of Windows servers with big data and Linux servers.
       Big data optimization. For example, optimizing a table with a size  of     6 billion records with a physical size of more than 1 TB.