lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


Data Engineer/Data Analyst with over 5 years of experience from working at the multinational automative corporation and multinational retail group in Germany.  

Multinational automative corporation. Stuttgart, Germany
- Development of backend (Databases, Tabular models)
- Optimization of data streams and ETL process from multiple sources to central data warehouse
- Coordination of the new requirements with the local markets
- Cloud migration of on-premise data products

Multinational retail group. Neckarsulm, Germany
- Implementation of ETL solutions in Data Migration, Data Integration and Consolidation projects
- Provide technical solutions, preparation of technical specifications and mapping based on functional requirements from Business stakeholders
- Sub-project lead Data Migration project for Master Data Management program

Multinational automative corporation. Stuttgart, Germany
- Data extraction, manipulation and transformation for further analyses and processes
- Build reports, visualizations and create dashboards
- Analyze and identify business requirements for further development of global forecasting application

Software & Programming
SQL; MS Office;
R; Power BI;
GitHub; SAP DS;
ADM (ETL Tool); Jira/Confluence;
Python; Tableau;
Azure; Databricks.

Languages
Azerbaijani: Native
English: Fluent
German: Fluent
Turkish: Fluent
Position: Data Engineer
Category: Data Engineer
Experience: 10 years | English: fluent

Handling large amount of streaming data
Data Engineer -  Data orchestration using Apache Airflow , ETL development (SAP BODS, Pentaho DI, SAP BODS), Data processing using Apache Spark (Scala) | Hive | Impala, Linux | Docker | Git
Data Warehouse Architect - DWH data models and OLAP cubes 
Database Developer - SQL | PL/SQL | T-SQL programming on Oracle | SAP IQ
BI Developer - Semantic layers and dashboards using OBIEE | Tibco Spotfire | MicroStrategy | SAP BO
Enhancing proficiency in cloud environments and possible transitioning to DataOps
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: intermediate


Data Engineer/Data Scientist with 3+ years of experience. Worked
with IBM during work in IBA. Developed ETL jobs for ingestion, transformation,
integration data from from different types of sources like Amazon
S3, Cloud Object Storage, IBM DB2, IBM Box, Rest
API, etc using PySpark, Python. Developed Airflow DAGs. Prepared data for ML and developed ML models using NumPy, Pandas, Scikit-Learn, TensorFlow, Keras, NLP.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


Data engineer/ DB developer / Data Warehouse with production experience in cloud migrations/development and CI/CD. Skilled in database development/administration, data integration, data visualization (Tableau) and Big Data workloads. 
I am always highly enthused about my work and tasks ahead, committed to learning and self-development.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent

- Professional Data Engineer Certification from GCP
- Interviewing/skills assessment
- Requirements gathering, Participating in architecture building
Data Engineer:
• Designing and building a new delta lake. Pyspark, Athena, Glue, Airflow
• Research on the possibility to accelerate Spark computations on GPU. Spark, Rapids
• Designing, and supervising batch/stream data pipeline building. REST, BigQuery, Airflow, Dataflow/Beam.
• Designing, and building batch/stream data pipelines
to support carbon-dioxide emissions reporting. Air-flow, BigQuery, Dataflow/Beam.

Machine Learning Engineer:
• Search intent finding. BERT, DBPedia, Spark.
• Designing a private cookieless data acquisition strategy, model building, and querying. Clustering algorithms. Differential privacy theory. Federated learn-
ing theory.
• Designing and developing large-scale data scoring and optimizer from scratch. Scala, Spark, Tensorflow, Singularity, API.
• Designing and developing of an AB-platform. Bayesian and frequent statistics, python, pySpark, Kubernetes, Singularity.
• Designing and developing of an automatic bidder for advertising trading from scratch. Python, pySpark, statistics, Tensorflow, Kubernetes.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Data Engineer | DW/BI Engineer
English - Upper Intermediate (B2).

Data Engineer with more than 4 years of commercial experience in the IT within different domains.
Professional expertise in database development, ETL processes, data warehousing, BI, data engineering and cloud.
Certified Azure Data Engineer Associate.
Certified Oracle Associate.
Hard-working and reliable team player.

- SQL, PL/SQL, T-SQL, MS SQL Server, Oracle
- Microsoft Azure Data Engineer Stack (Data Factory, Databricks, Synapse Analytics, Logic App, Data Lake, etc)
- Oracle Data Integrator, SAP Data Services, Dollar Universe
- Power BI
- ETL / ELT
- Batch and Streaming Processing
- Data analysis, Database modelling, Data Warehouse architecture
- CI/CD, Azure DevOps Pipelines, Liquibase
- Git, TFS, Azure DevOps Repos
- Agile, Scrum, Kanban, Azure DevOps Boards
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: intermediate


Data Engineer:
Epam, September 2021 - Present
Performed data model synchronization between systems SimCorp and AWS Glue/Athena combo.
Performed ETL using Snowflake and ActiveBatch.
Performed PowerBI data model synchronization.
Performed PowerBI Dashboard update/fix.


Database engineer: 
Innohub, February 2021- September 2021
 Architecting, implementing and operating stable, scalable and
highly performant procedures and functions
 Diagnose and resolve bugs and performance issues 
 Analyzing and optimizing queries
 Create/alter/drop schema’s object: tables, views, indexes and
others
 Preparing and validating data for testing, training ml-models
 Build ETL-process with SQLalchemy (Python library)
Technologies were used:
PostgreSQL, pgAdmin, DataGrip, Jira/Confluence, Docker, PLpgSQL, SQLalchemy 

Oracle PL/SQL Developer: 
UNITY-BARS, November 2019- January 2021
- Architecting, implementing and operating stable, scalable and
highly performant packages of procedures and functions
- Direct work with Oschadbank( the customer), discussion of
the formation of requirements.
- Analysis of the architecture of the current project for the
system analysts department and further evaluation of the work
- Diagnose and resolve bugs and performance issues 
- Analyzing and optimizing queries.
- Creating reports in FastReport.
- Writing reentrant scripts
- Writting technical documentation.
- Create/alter/drop schema’s object: tables, views, indexes and
others
- Preparing and validating data for testing

I've worked on project such as: financial monitoring, implementation of IBAN, integration with SingleWindow (international money transfer systems such as Western Union, MoneyGram), analytics on deposits and loans.
Technologies were used:
Jira/Confluence, PL/SQL, Oracle Database 11g, FastReport, TOAD, PL/SQL Developer.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


Data Engineer (ETL) - DataMola Ukraine/Poland (March 2022 - Apr 2023):
-- develop new, maintain & improve existing ETL pipelines from different sources (Python, Prefect, IBM DB2, AWS S3, 3rd party API, SharePoint, SFTP, SSIS);
-- participate in build unify data flows (data pipelines) for all company projects (Prefect Dataflow Automation, Python, AWS S3,


Senior Pricing Process Optimization Specialist/Reporting and Process Automatization Specialist - Metro Cash & Carry Ukraine (June 2019 -  Aug 2022):
-- create, maintain and improve data pipelines (ELT)/data processing for reporting and working tools in department (MS Office, Teradata, Python, VBA Excel, VBScript, Corporate Storage and Systems);
-- develop promo planning tool (work templates (MS Office), data processing (VBA Excel,VBScript, Python, Teradata, Corporate Systems);
-- pricing process automatization (develop tools for price analysis & price setting (MS Office, Teradata, VBA Excel, VBScript, Corporate Systems).
I am looking for a job where I can deepen my technical and professional skills in field of Data Engineering.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Data engineer ( Februrary 2023 - Present)
GR8 tech ( ex Parimatchtech) | Ukraine (remote)
B2B iGaming company that provides stable, resilient, adaptive, and highly scalable business solutions for iGaming companies.
- Implementation of async connector to OpenSearch for rapid data retrieval
- Implementation of batch & stream metrics consumers
- Increase test coverage of legacy code base
- Adding pre-commit hooks

Data engineer / ML engineer (July 2020 - Present)
PTE LTD “Waste Labs” | Singapore
IT startup building B2B logistics optimization & lead generation services for waste logistics companies to make collection more profitable & sustainable
- Building event-drivern analytical data pipelines in AWS and setting up GIS dashboards on Grafana with Apache Athena
- Implementation infrastructure code using Terraform on AWS cloud provider
- Configuration of CI/CD for projects
- Development & Deployment REST api, data pipelines and their mutual integration
- Repository configurations: semantic versioning, pre-commit hooks, linters, formatters, tests and etc.
- Development internal tools & libraries for geospatial analysis
- Investigation of deployment practices for companies use cases
- Building reusable machine learning modules for integration to products
- Packing mathematical models & their deployment to production

 Data scientist (October 2019 - November 2020)
“Fraudhunter” LLC | Kazakhstan
Company providing B2B services in telecommunication industry to reduce profitability loss & improve quality of services
- Development & deployment anomaly detection in telecom base station logs by profile generation
- Development & deployment call planning module for test call generation system
- Building data ETL/ELT data pipelines


 Junior Data scientist (March 2019 - October 2019)
“DAR tech” LLC | Kazakhstan
Company providing outsource services where i did:
- Research time series analysis for sales forecasting using (ARIMA, FBprophet)
- Research credit scoring for microfinancial organization using classical score cards & logistic regression on python
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent

• Worked for MNCs like Veritas, Seagate, godrej, and Schaeffler.
• Been part of the United nation flood awareness project.
Data Engineer having 5 years of experience in AWS and Azure Cloud, Open-Source Big Data Tools, Python, PySpark, SQL, and AWS Cloud to develop innovative big data solutions for clients to reduce their efforts and give a boost to their workflow.
----------------------------------------------------------

Data Engineer
Schaeffler · Full-time
May 2022 - Present 
Frankfurt, Hesse, GermanyFrankfurt, Hesse, Germany

• Responsible for data migration, creating pipelines, maintaining the deployment, and automating the manual process to reduce time and increase the efficiency of the system.

----------------------------------------------------------

Data Engineer
i2e Consulting 
Aug 2020 - Apr 2022 

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

----------------------------------------------------------

Associate Data Engineer
Mactores 
Jul 2019 - Jun 2020 
• Build Data Lake for the analytics team which includes extraction of data from a wide range of sources, the transformation of data on AWS Cloud, and loading data in S3 for analytics on Tableau.
• Responsible for an 80% reduction in the Data Processing and Re-design of the Dashboard which reduced the loading time from 25 min to 6 Sec.
Looking for better opportunities.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: pre


Data Engineering and Business Intelligence specialist with
expertise in designing, optimizing and supporting Data
Warehouses, Data Marts and ETL processes.
Posseses good communication skills and feel comfortable with intra-team interactions.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Data Engineer interested in distributed data processing, and functional programming with a passion for Spark, have sound theoretical knowledge of main Big Data concepts (MapReduce paradigm). Worked in such domains as AdTech, FinTech, and Retail & Distribution. Have good experience building data pipelines, validation, visualization, and systems performance optimization. Responsible, organized, and business-oriented. Quick learner, able to work autonomously.
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper


Data Engineer / MLOps engineer
Fractal Analytics | Dec 2021 - present
- Building Vertex AI Pipelines. The project's goal is to migrate from Airflow to Vertex. I build a pipeline using the KubeFlow SDK and work with GCP and BigQuery SQL. 
- Data migration project. We migrate data from old storage to GCP.

Data Analyst
City Development Solutions | Sep 2020 - Feb 2021
Responsibilities:
- Data collection, cleaning and processing 
- Analysis of real estate market objects 
- Plotting graphs, creating reports
Achievements:
I've automated and sped up the process of collecting information using Python
Position: Data Engineer
Category: Python
Experience: 1.5 years | English: upper


DATA ENGINEER | NIX SOLUTIONS | Python · PySpark · Pandas · SAS · NiFi · IBM Cloud · Azure | Aug 2021 – Sep 2022
    Ingestion and transformation pipelines for medical data
     • Improved testing of the existing system, raised coverage to 80%
     • Extended, improved, and modified functionality of pipelines
     • Solved performance bug that improved processing time x6

    Large-scale processing of medical data
     • Refactored existing Spark model to new OOP architecture

    Data enhancement of medical data
     • Improved existing CI/CD processes
     • Refactored SAS models to new Pandas architecture

TRAINEE | NIX SOLUTIONS | Python · Spark · Airflow · Flask · Git · Linux · Docker · Postgres · Algorithms · Data Structures | Apr 2021 – Jul 2021
     • Successfully finished DE project using PySpark, Airflow
     • Successfully finished REST project using Flask
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: fluent

IBM Data Science Professional Certificate, 2022
MLOps Fundamentals by DataCamp, 2023
Database Design by DataCamp, 2023
Data Engineer 
Project: RexSys, platform that makes it easier to understand and navigate through the regulations in different countries, and to compare multiple regulations

• Extracted data from various sources and transformed it into a standardized format for analysis by domain experts
• Used Beautiful Soup and Selenium to scrape multiple websites, collecting a dataset of approximately 50,000 documents
• Developed a model, with an 81% accuracy rate, that offers document recommendations based on input document
• Implemented data cleaning and preprocessing, incorporating tokenization, lemmatization, and stemming techniques, using NLTK, spaCy, and gensim
• Automated complex tasks for domain specialists using Python scripts, resulting in significant time savings and improved efficiency

Project: Android application for Smart POS devices 

• Participated in the integration of additional payment methods and alternative payment systems, including Visa, MasterCard, Pure and American Express into the application
• Developed a user-friendly interface for the Android application, ensuring easy navigation and a seamless user experience
• Contributed to the overall project success by writing critical transactions in Java for various payment systems
• Demonstrated expertise in data encryption and decryption algorithms, resolving one of the major project issue
• Gained valuable experience in SQL, successfully applying it to extract and manipulate data

Looking for:
Complex and interesting tasks
Professional and personal growth
Position: Data Engineer
Category: Data Engineer
Experience: 1 years | English: fluent


Data Engineer. September 2022 - Recent
QZhub, Nur-Sultan. Full-time
• Worked with Business Analytics team in different projects.
• Worked with Odoo business management software, mainly - creating, editing modules, connecting modules to PostgreSQL database, troubleshooting on Python.
• Parsed multiple websites using Python and libraries like scrapy, selenium, bs4. 

Risk Advisor. December 2021 – February 2022.
Deloitte LLP, Nur-Sultan. Full-time
• Analyzed accounting entries to identify transactions that are not typical for business and signs of dishonest actions on the part of the organization’s management.
• Analysed system data to identify and designate areas requiring comprehensive expert research using ACL Analytics tool.
• Assigned with more than 7 projects, which involves leading companies in primary, manufacturing and service sectors from Russia, Kazakhstan and Kyrgyzstan.
• Worked closely with an audit team and a client side.

Data Mining Intern. June 2021 – September 2021.
Kazakhtelecom JSC, Almaty. Part-time
• PROTELECOM Internship Program is dedicated for the 3rd and 4th year students pursuing bachelors degree in Kazakhstan.
• Worked in Data Mining and Big Data transfer team under the supervision of 3 mentors.
• The main tasks were: retrieving records of subscribers using SQL scripts, parsing and presenting statistics of the clients with charts in python, using libraries like pandas, numpy and matplotlib.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


Data Engineer | SoftServe Dec 2021 - Present (1 year 8 months)
Integrated new data sources and prepared data pipeline and infrastructure.
Prepared data for business users and optimized legacy SQL code.
Technologies Used: Python, DBT, Bigquery, Google Cloud Storage, Apache Beam, Apache Airflow, Git

Data Engineer | DAXX Aug 2021 - Nov 2021 (4 months)
Integrated new data sources and prepared data pipeline and infrastructure.
Prepared data for business users.
Technologies Used: Python, Bash, Azure Function App, Azure Storage, Git

Data Engineer & ETL Developer | EPAM Dec 2020 - Aug 2021 (9 months)
Developed data marts and gathered business requirements.
Prepared data pipelines and data for business users.
Technologies Used: Python, Bigquery, Google Cloud Products (Container registry, Compute Engine, Cloud Build, Cloud functions), Google Composer (Apache Airflow), Docker, Git

Data Engineer | Letyshops Jan 2020 - Nov 2020 (11 months)
Developed ETL processes, collected and compiled data from different sources.
Prepared data pipelines and data for the analytical department.
Developed corporate BI tools and worked closely with the analytics team.
Technologies Used: R-script, Python, Bigquery, Google Cloud Products (Container registry, Compute Engine, Cloud Build, Cloud functions), Google Composer (Apache airflow), Google Dataflow (Apache beam), Google data studio, Docker, Git

Product Analyst & BI Developer | Letyshops Aug 2018 - Dec 2019 (1 year 3 months)
Developed analytics systems, ETL processes, and marketing campaign plans.
Created reports (ad-hoc, bi-dashboards) and A/B tests.
Technologies Used: R-script, Shiny (R-script framework for dashboard development), Python, Bigquery, Google Cloud Products (Container registry, Compute Engine, Cloud build), Google data studio, Docker, Git

Head of Data Mining Department | 4Service Aug 2017 - Aug 2018 (1 year)
Developed analytics systems, discovery reports, and ad-hoc reports.
Optimized and automated operational reports.
Technologies Used: R-script, Shiny (Rscript framework for dashboard development), MS SQL, Git

Lead Analyst | Доброго дня Аптека Aug 2014 - Aug 2017 (3 years)
Developed analytics systems, marketing campaign plans, and ad-hoc reports.
Optimized and automated operational reports.
Technologies Used: R-script, MS SQL, Excel (Power pivot, Power query), MySQL, Qlikview
Complex and interesting tasks;
Emproovment Skeels;
Green field projects
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper

1. Created parameterized SQL scripts to collect analytics and business metrics, such as applied recommendations, calculating the impact of our decision on client revenue and sales. It was widely used by customer facing and customer success teams.

2. Created and supported automatic data pipeline tests, for Entry (raw client data) and our processed data. Significantly simplified and accelerated QA process.

3. Adapted dataset and whole pipeline for RNN (recurrent neural network).

5. Working with complex billing and invoicing systems for mobile operators.

6. Supported and improved handling of different types of events, such as different balances spendings, regular payments, late landings; aggregating them into daily and monthly aggregates, forming invoices based on the results of the month.

7. PostgreSQL & MongoDB databases profiling and
optimization.
Data Engineer with 1.5 years of experience in two projects, with Google Big Query, Oracle and Postgres.
To gain more experience in interesting projects with a good team; improve my existing skills and get new ones. Interested in trying myself in Product Analyst/Data Analyst positions as well.
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper


Data engineer with 1+ years of experience. 

Data engineer(January 2023 - present):
- migrated data and logic from PostgreSQL to Snowflake using dbt;
- created dbt macros;
- Created tables using Data Vault approach 
- created dags in Airflow;

Data engineer(June 2022 - January 2023):
- created tables, views and functions in Postgresql and MsSql databases;
- created python scripts in Azure Synapse(Pyspark);
- integrated Azure Synapse with Azure key vault and Application insights;
- created pipelines in Azure Synapse;

EPAM DWBI Course (November 2021-May 2022):
- created tables, views, triggers, stored procedures with sql;
- got acquainted with clouds (AWS, GCP, Azure)
- worked with Python(Pyspark, pandas, numpy)
- got basic knowledge of data visualization tools (Tableau, Power BI)

Certifications - Azure DP-203, DP-900
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Data Engineer with 3,5 years experience in the field. Have strong analytical and communication skills. Keen to effectively solve complex tasks, bringing the maximum business value and constantly grow professionally, as well as, personally. Interested in Big Data, Cloud Computing, ETL and ELT systems, Machine Learning

Experience:
- AWS Certified Solution Architect - Associate
- Development of ELT processes for near real-time data analysis(Spark Streaming)
- Automation of orchestration & deployment for
AWS EMR, EC2, Lambda, Spark jobs
- Solid kowledge of Algorithms & Data Structures
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: intermediate


Data Engineer with 3 years of experience 

main skills:
Python
MapReduce stack (mr2, spark, hive, hadoop)
SQL
ETL/ELT data pipelines
cleaning data
maintaining DWH (CDP, Google Cloud)
importing data from various sources
data migration
writing API (Flask, FastAPI)
Tableau/Looker (only data ingestion and solving problems with reports, can`t write reports without design information)
deploying data models in production
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


Data Engineer with 6 years of experience with a key focus on Apache Spark, Apache Kafka, Hadoop, cloud (AWS), and container (Docker, Kubernetes) technologies. Experienced in building and designing data lakes and data warehouses.