Position: Data Engineer
Category: Data Engineer
English level: upper
Years of experience: 4

Creating  and configuring workspace for data scientists on jupyterhub allowing them to choose their own environment, organizing  all the connection and access to minio, hdfs, and spark cluster.
Creating first version of chatbot using Rasa and telegram bot api. 
Installation and configuration of Apache Airflow on kubernetes. Creating first dags in a company for ETL processes. 
Collecting all money transfer reports from different transfer services and creating unique board for automating it. 
Streamlit app with the functionality of implementing model on datasets, visualization of inputs and results, and automatic plot builder.
Data cleaning using pandas and apache spark. Creating data pipelines using Nifi. Orchestration of ETL processes using Apache Airflow. Creating gitlab ci pipelines for kubernetes deployments. Writing simple data visualization pages on Streamlit. Installation and configuration of services on kubernetes cluster using helm and kustomization (Apache Airflow, Jupyterhub, Grafana + Prometheus, Keycloak). Installation on local cloud using Juju.