lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data engineer
Category: Data Engineer
Experience: 2 years | English: upper


As Data Engineer
(October 2021- present)

IBM Integration Bus: developing REST API, Integration services and apps.
Tools: IIB Toolkit, ESQL, DB2

AWS RDS for Postgres DB – Salesforce integration: designing and developing a solution for DB –
Salesforce integration.
Tools: AWS AppFlow, AWS Lambda, Python

Migration of enterprise reports from SAP Crystal Reports to MS SSRS:
- developing reports
(creating configs, layouts, data formatting, testing, deploying).
Tools: SAP Crystal Reports, MS SSRS, MS Report Builder, Oracle

Informatica Data Integration: 
-building data flows with transformations and mappings according to business requirements.
Tools: Informatica Intelligent Cloud Services

Oracle DB maintaining, PLSQL development: developing and testing PLSQL functions and
procedures.
Tools: ORACLE RDBMS 19, PLSQL Developer, SQL Developer

Commercial experience as  Python Developer: (September 2020 - August 2021)
I was engaged in working with:
- AWS serverless application development with API, Lambda, Step Function, DynamoDB, Rekognition, Athena, Glue;
- ETL pipeline implementation;
- OpenAPI (Swagger), YAML.
I`m open for new opportunities due to the end of current project. I would like to consider the company where I can closely work with highly qualified professionals on inspiring technological  projects. If the potential employer is looking for long-time cooperation, I would love to be part of that company.
Position: Data engineer
Category: Data Engineer
Experience: 1.5 years | English: fluent


As part of the team responsible for the design and implementation of the Quality Engineering datalake, I worked on the extract, transform, and load (ETL) pipeline to ingest data from various Quality Engineering data sources using Apache NiFi for transformation and storing the data in an AWS S3 bucket. I also configured Glue crawlers and used AWS Athena to create views for data visualization on the AWS QuickSight dashboard. These efforts supported the Quality Engineering team in making data-driven decisions related to quality, enabling informed and strategic decision-making.

 As a member of a machine learning project focused on fraud detection, I was responsible for maintaining the quality and integrity of the data used for training and inferencing. To accomplish this, I utilized Apache NiFi to streamline the cleaning and streaming process of mobile money transaction data to AWS Kinesis data streams, and then loaded the data into an S3 bucket for storage. In addition, I monitored the quality and distribution of the data fed to the ML model to ensure its proper training and accurate inferences. Through my efforts, I contributed to the development of a solution that helps detect and prevent online fraud.

 As a key member of the development team, I played a critical role in the creation and documentation of a hybrid automation suite using Robot Framework. This solution enabled the team to use a single tool for the execution of web, mobile, and API tests, improving efficiency and effectiveness through the establishment of clear structure, coding standards, and clean git work. I am proud to have contributed to this significant achievement for the team.
Position: Data engineer
Category: Data Engineer
Experience: 4 years | English: upper


Creating hyperparametrized ELT pipelines
Producing prototypes to demonstrate concepts and ideas
Development of OLAP databases
Introducing new data management tools & technologies into the existing system to make it more efficient
Development of a data extraction system with 170+ connectors (like Meltano)
Development and implementation of attribution models and ontological models to automate report generation Development of systems for building reports
Built and designed data lakes and data warehouses on GCP Big Query
Re-designing infrastructure for greater scalability
Automation of data exchange between different systems and Google BigQuery
Position: Data engineer
Category: Data Engineer
Experience: 3 years | English: upper


Data Engineer | Kapital Bank | Baku, Azerbaijan | Jul 2022 - Present 
- Redesigned and migrated more than 15 ETL packages from former projects to current projects.
- Designed and implemented 30+ ETL/EtLT pipelines using SQL, SAP BODS and various SQL databases. 
- Administered nearly hundred ETL jobs, fixed them when it is broken, monitored and implemented relevant changes to prevent 
possible future errors and performance issues.
- Modelling data and building data marts to minimize execution time of analytic queries.
- Tuning poorly performing SQL queries and typing ad-hoc report scripts.
- Rewriting report queries to migrate that operated on prior data warehouse.
- Searching for alternatives to ETL, data cataloging tools and testing their compatibility and harmony with existing architecture.
Business Intelligence Specialist | Veyseloglu Group of Companies| Baku, Azerbaijan | Sep 2021 – Jul 2022
- Analyzed, designed and developed new data pipelines based on business requirements, using SSIS, Azure blob storage, 
Synapse, Azure DevOps and other tools. 
- Monitored performance of data pipelines and made changes to optimize the overall performance.
- Managed and supported 200+ ETL /ELT packages and 10+ SSAS Tabular models. 
- Developed ETL packages that automated manual tasks and saved 30 minutes of BI specialists daily.
- Analyzed storage and compute costs and reduced them where it is possible.
- Implemented security guidelines by using user filters and row-level security, minimizing private data exposure.
- Writing SQL scripts for ad-hoc reporting, optimizing slowly performing report scripts that runs on ERP applications.
Data analyst | Freelance | New Jersey/ New York, USA| July 2019 – September 2021
- Built out the data and reporting infrastructure from ground up using Power BI, Tableau, Quicksight, SQL and Python to provide 
near to real-time insights into the products and business KPIs. 
- Redesigned and developed ETL processes to optimize data ingestion and check validation rules in various steps of pipelines 
ensuring data accuracy.
- Created dashboards and reports to monitor data quality and performance.
- Analyzed business processes and generated data, suggested solutions which reduced the waste.
Position: Data engineer
Category: Data Engineer
Experience: 3 years | English: intermediate


Data engineer with over three years of experience in ETL. The main technologies are Python2/Python3, Airflow, Scala/Spark, AWS, Docker. 
Worked with Scrum methodology, have experience in SDLC (working with requirements, design, coding, testing, debugging, deploying, publishing).
Interest in data processing, cloud architecture, pipeline design.
Responsible, good team player, good communication skills, result-oriented, fast-learned.
Position: Data engineer
Category: Python
Experience: 11 years | English: intermediate

I always try to do my job as well as can
Design architecture of DWH and data lakes, development data pipelines and flows, improvement performance.
Many different tasks from development to architecture. 
Expiriens with PowerBI, Oracle BI EE,  Snowflake database, PySpark, Scoop, Kafka, NiFi, SSIS, SSRS, SSAS
Position: Data engineer
Category: Data Science
Experience: 7 years | English: upper

Designed and developed in RDBMS Oracle a number of interfaces for CRM channels at Kyivstar.
Development of ETL processes for flat reports delivery via  mail server.
I started my career in IT as a information system administrator. My main responsibility was to maintain the system and conduct its configuration on demand. With time the scope of duties was broadened to writing new feature blocks on PL/SQL as well as SQL tuning. When realized that there is no further professional growth 
decided to move to Business Intelligence (BI) area. On a position of BI Software Engineer was responsible for designing of flat reports, new ETL processes development, SQL tuning, data quality control, setting new and maintaining of existing OLAP cubes. Not long ago made my mind to challenge myself and start on a new job position as a BA.
I'm interested in returning to software engineering tasks that will let me get hands-on experience of using Python and cloud technologies (AWS, Azure, etc).
Position: Data engineer
Category: Data Engineer
Experience: 2 years | English: intermediate


I've been involved in both ad-hoc development projects, as well as projects that are designed to transfer and modify functionality from one repository to another.
Currently I'm designing data marts and building pipelines using Apache Airflow.
Main languages: SQL, Pyspark(scala spark)
Most of the time I work with hadoop and greenplum.
В первую очередь меня интересует современный стек технологий и разработка нового функционала.
Position: Data engineer
Category: SQL
Experience: 6 years | English: intermediate

Stress resistance, desire to learn new, responsibility
MSSQL 2012,MSSQL 2016,ETL, SSIS, DW, BI, Yellowbrick, Tableau, Power BI, Snowflake
part time job
Position: Data engineer
Category: Data Engineer
Experience: 2.5 years | English: intermediate


November 2021 — Present       	 Prime Source LLP, Almaty, Kazakhstan
•	Position: 
    Software developer 
•	Responsibility: 
      Software support from the frontend(JavaScript React) and database using VS Code and ************************************************************
May 2021 — October 2021
6 months	
	Eurasian bank JCS, Almaty, Kazakhstan
•	Position: 
    Data warehouse developer 
•	Responsibility: 
    Developing of reports on Oracle BI, creating of packages, procedures on PL/SQL developer
****************************************************************
Dec 2019 — Apr 2021
1 year 5 months	
	Home Credit Bank, Almaty, Kazakhstan
•	Position: 
    Data analyst of portfolio quality management and late collection
•	Responsibility: 
    Generation of reports in Excel with connection to a database, comparative analyzes, data visualization in Excel, work with PL / SQL database (formation and optimization of scripts using hints, indexes, logging, etc.; procedures, setting up jobs), formation of XML packages for generating SOAP requests to the state database with further entering the received data into the database; parsing web pages and entering data into the database, automating work using Python and Jupyter Notebook (selenium.webdriver, beautiful soap, pandas)
Position: Data engineer
Category: Data Engineer
Experience: 3 years | English: upper

Since the previous year switched to data engineering: took participation on creating ETL pipelines and infrastructure for storing data. 
 
Before I participated in financial and devops projects, where I had the next responsibilities: creating from the scratch  and providing stable automation process, the development and supporting of the automation framework, creating the environment for the integration testing, backend testing, automation of processes of creating test documentation,  building CI process for configuration of different softwares: Jboss, IIS, DB2, WebSphere, Jenkins, Bamboo, Twistlock, Jfrog, Artifactory etc.
The last project was dedicated to data reconciliation, data solution was specific ETL which pulls data from several sources, compares data and returns the difference to the user. The solution is based on python, pandas, spark, aws s3, docker. 

Previous projects related to CI/CD infrastructure and integration with third-party services.
Providing enough time and technical resources and a friendly  management
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate


10+ years experience in Data Modelling, Data Warehousing and Data Engineering.
I have experience with
        BI tools: Oracle BI, Microsoft Power BI, Tableau, Microstrategy, Tibco Spotfire
	ETL/ELT tools: ODI, MS SSIS, SAP BODS, Apache Airflow
	Databases: Oracle, MS SQL Server, SAP IQ, Postgres, Mysql
	Programming languages: Python
	
Good knowledge in Kimball approach, Immon Approach, Data Vault modelling.

Projects:
	Participating in developing Data Warehouse and BI for Central Bank of Azerbaijan Republic
	Participating in developing Data Warehouse and BI for Ministry of Taxes of Kyrgyz Republic
	Participating in developing Data Warehouse and BI for "Kapital Bank" (Azerbaijan)
	Leading of creating and developing process of Data Warehouse and BI infrastructure for Ministry of Education of Azerbaijan Republic
	Leading of optimizing and developing process of Data Warehouse and Self-Service BI infrastructure for "Yelo Bank" (Azerbaijan)
	Leading of process creating DWH and Self-Service BI infrastructure from scratch for "Rabita Bank" (Azerbaijan).
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate

At my current place of work, I developed the on-premise to cloud (Oracle to RDS PostgreSQL) terabyte-scale data migration and post-migration and validation(within a very tight time frame) solutions using the following stack of languages, technologies, and products: AWS Services (DMS, S3, EC2, etc.); Python and Perl scripts; Grafana, Prometheus for monitoring; Ansible, make and CloudFormation for deployment.
10+ years of experience as a DB Developer
5+ years of experience as ETL, BI Developer
2+ year of experience as a Data Engineer
2+ year of experience with AWS (Certified Cloud Practitioner)
Contributions to open source repositories: orafce, MySQL sys schema
I aim to work as a data engineer using relevant modern technologies, products, and tools.
Position: Data Engineer
Category: Data Engineer
Experience: 10 years | English: upper

- OLTP, Data Warehouse design and implementation
- Design, implement and optimize ETL processes 
- Development and implementation of reports (KPI's dashboards, drill through reports)
- Certificates: Microsoft Exam 761; Google Cloud Professional Data Engineer certificate
•	10+ years of professional experience in the Information Technologies (IT) industry;
•	Expertise:
-  DB architecture design;
-  Solid knowledge of SQL;
-  DWH;
-  ETL;
-  Reporting (SSRS, Crystal Reports);
-  Cloud Computing Experience (GCP, Azure);
I am looking for Data Engineer job
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper

Being involved in more than 25 projects that get production. On different roles, mostly related to DB and data flow engineering.
Latest:
- The infrastructure of entity-based continuous data archiving in the mid-loaded system.
- Zero downtime cross DC client migration (11DBs ~1,5 TB, PostgreSQL 10)
12 years of data engineering, development of data structures and stored logic.
Data pipelines.
Optimization, troubleshooting, maintenance;
Common ETL solutions;
Infrastructure stuff, db changes delivery, CI/CD e.t.c.
Up to 1,5 Pb storages, up to 5000 TPS.
Want to create something useful.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: fluent


13 years experience in Software Engineering with: 
OOP/OOD
Agile
.Net (C#)
Scala,
Python,
Spark,
Apache Beam,
Java,
Hadoop, 
Hive,
MS SQL,
Asp.Net
Asp.Net MVC, Web Api
HTML, CSS
JavaScript (several top frameworks)
Remote position as a Data Engineer
Position: Data Engineer
Category: Scala
Experience: 2.5 years | English: fluent

I speak at conferences and meetups (recent is ScalaUA), organize meetups and visit conferences in Europe(Open Source Summit Europe, DockerCon Europe,  etc.).
1.5 years as a Data Engineer at Ciklum. 
Before that, I was a freelance Java developer (10 months)
Professional growth and challenging tasks, flexible schedule
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: intermediate

Deployed to production:
Automation of financial monitoring of customers activity in commercial bank as government regulator requires (ETL, Informatica)
Integration of dictionary with third system by means of stored procedure (PL/SQL, Siebel)
Implementation of mechanism of remote signing of loan agreement by means of one-time password in SMS (Siebel, Web-Services)
Developing non-vanilla mechanism of auto assigning (Siebel)
Improvement of automation of lead management (PL/SQL, Siebel)
Design and maintaine Dev-Test and Test-Prod deployment (Siebel)
15+ years of overall experience developing enterprise software (like ERP, CRM);
9 years experience as Siebel CRM developer;
2-year experience in ETL-processes development;

Data Engineer:
Data warehousing support and development (commercial bank, insurance company).
ETL processes design, development, and maintenance.
Analysis of business requirements and process implementation.
Process failure analysis and correction.

Projects:
* Developed automation of financial monitoring of customer activity as a demand government regulator.
* Migration of DWH and BI from Teradata to Oracle DB.

BI: Oracle BI Dashboards, Oracle BI Publisher
ETL: Informatica Power Center, Oracle Data Integrator
RDBM: Oracle Database, MS SQL Server, Teradata, MySQL (DML, DDL, PL/SQL, T-SQL)

Siebel CRM:
Automation by means of Oracle Siebel CRM for commercial banks, telecom operators, etc. (Ukrainian and foreign companies).
High proficiency in various Siebel tools and technologies: eScript, Workflow, Open UI, Runtime Events, Workflow Policies, Data Validation, ADM, etc.
Experienced in supporting and modifying legacy functionality, developing new ones, and integrating with third systems using various technology (Siebel/non-Siebel). 
Applications: Siebel Sales, Siebel Marketing, Siebel Field Service, Siebel Financial Services.
It would be greate to expand and deep my expertize in Data engineering area with a team of professionals. In Siebel area I can work with same effectiveness like a single developer or as a team-player.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: pre

0. Successfully completed full specialization of "Машинное обучение и анализ данных". Coursera certificate № 6DXHD243CRWF.
1. Create data warehouse for business intelligence.
2. Built models for classifying and clustering customer behavior in the field of consumer lending.
3. Created reports in the field of business analytics based on requests to Sybase IQ servers.
4. As part of the graduation project at the institute, a designer of financial reports for customs authorities was developed. Development language - Turbo Pascal (IDE Delphi 5), DBMS - FoxPro and Paradox.
1. Created predictive models (machine learning) of customer behavior. In tech view these projects are task of classification and clustering using SQL, Pandas, NumPy, Sklearn, XGBoost.

2. Create data warehouse for business intelligence on Sybase infrastructure using Watcom SQL and Java.
An opportunity to develop to a professional level in machine learning and programming.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent

Working with helthcare products as a machine learning engineer
creating multiple recommendation engines based on patient data
Using NLP to recommend best content to help patients with different mental health issues
Developed tools fot deployment and monitoring of the machine learning models

Working as Data engineer for the E-marketing platfrorm 
Developing new and managing existing data pipelines
Taking part in building data-lake on s3 and AWS GLUE 
Developing multiple ETL pipelines using GLUE Jobs and AIRFLOW
1) Data Engineer
Working as Data engineer for the E-marketing platfrorm 
Developing new and managing existing data pipelines
Taking part in building data-lake on s3 and AWS GLUE 
Developing multiple ETL pipelines using GLUE Jobs and AIRFLOW

Working with helthcare products as a machine learning engineer
creating multiple recommendation engines based on patient data
Using NLP to recommend best content to help patients with different mental health issues
Developed tools fot deployment and monitoring of the machine learning models
Developed CLOUD DWH system to store data

2) Data Scientist/Engineer
- Extracting, Transforming and loading data from various sources
- Developing analytical products using telegram-bots and machine learning
- Developing data visualisation solution for Data engineers for creating quick visualisations
- Creating automatic pipelines for data collection and validation
- End to end development of a machine learning solution for churn classification
- Creating Dashboards on Tableau
- Advanced usage of SQL and SQL-optimisation for working with BIG-DATA


3)  Data Analyst
- End to end development of a machine learning solution for credit default detection
- Integrating analytical solutions into CRM
- Report automation
- ETL

4) Data Analyst
- Creating weekly/monthly analytical reports
- Sales analytics
- Evaluating the work of the sales department and setting sales plans based on statistical modeling
I would like to strenghen my skills in deep and machine learning, so 
I would like to work with a project that involves these areas
Position: Data Engineer
Category: SQL
Experience: 3 years | English: intermediate


1)	Epam, development for a banking company(September – March 2020/21)
 Position: Junior Database engineer
Role:
•	Writing new database logic
•	Improving sql queries
•	Working with Airflow
2)	 Epam, development for a cosmetics company(April – November 2021)
Position:  Data Quality engineer
Role:
•	Checking data on different layers
•	Testing data migration
•	Working with relational database in Azure
3)	Epam, development for a Healthcare Company(January 2022 – May 2023)
Position: Data engineer
Role: 
•	Creating infrastructure in GCP
•	Creating data migration 
•	Testing data migration
•	Writing end-to-end testing
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


1) Experience in SAP ecosystem. Developing ETL from 1C (MS SQL) to SAP. Monitoring and troubleshooting. 
2) Experience in ETL with the Informatica DEl tool,
building showcases from oracle to hive, oracle to
oracle, hive to hive;
3) Experience in ETL with the Informatica PC tool, uploading from different sources and uploading to the staging layer ORACLE;
4) Creating datamarts for data analysis team. Communication with business leaders.
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: intermediate


1. Trainee Python Developer
- Supported a drop shipping platform by developing and maintaining robust applications
 - Automated business processes using RPA frameworks to enhance efficiency and reduce manual efforts
 - Developed a REST API using the Django framework that allowed seamless communication between multiple services

2. Trainee Big Data Engineer
- Implemented ETL logic for data from various sources to ensure data quality and consistency
- Developed a cluster environment using Docker containers for efficient data processing and analysis
- Worked with data processing using batch and real-time processing frameworks to handle large volumes of data
- Created analytics solutions using Superset for effective data visualization and reporting
- Developed a small ETL process using Databricks to extract, transform, and load data from various sources
- ETL Process Migration to Oracle Cloud using Terraform
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


1. Worked on a recommender engine based on user analytics data / media items metadata, that provides personal / related recommendations to end users. Familiar with widely used algorithms for processing events sequences (Word2Vec, LSTM).
2. Worked on improvement / maintenance of auto-ML pipelines for models training and deployment in Kubernetes / Amazon Cloud, batch processing of views history, syncing inference results with the application’s back-end.
3. Worked on optimization / reconfiguration of a multicomponent high-load  real-time analytics system based on Apache products, supporting several million concurrently active users.