lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper

Built data lake ground up
Developed complex database solution in-house - cdc (change data capture) on cloud storage (s3)
Leaded transition from traditional data platform to data mesh
Staff Data Developer (Shopify - 09.2022 to 06.2023):
- Ensured data pipeline integrity and established best practices for data development.
- Mentored engineers and guided the data platform evolution process.
- Led the transition to a cloud-based infrastructure and migrated data models.

Principal Data Engineer (SumUp - 05.2021 to 08.2022):
- Developed data platform roadmap and managed risk assessment and mitigation.
- Reviewed design documents and played a key role in shaping team performance.
- Transformed the data platform into a Data Mesh approach.

Software Developer - SRE (Google - 10.2019 to 04.2021):
- Monitored production services and optimized hardware resources.
- Resolved infrastructure issues and deployed code changes.
- Led the migration of monitoring services and implemented database-level isolation.

Big Data Engineer (OLX Group - 01.2018 to 10.2019):
- Built and maintained a data lake, ensuring GDPR compliance.
- Enabled data access democratization and implemented data governance.
- Optimized storage format and developed replication system for RDBMSs.

Data Warehouse Developer (Zalando - 02.2016 to 01.2018):
- Performed data modeling and developed ETL pipelines.
- Conducted performance tuning and mentored colleagues.
- Redesigned core dimension tables and ingested pricing data.

Data Warehouse Developer (Azercell - 01.2011 to 02.2016):
- Created and supported ETL jobs and developed data architecture strategy.
- Calculated data-mart values and ensured data quality.
- Provided online reporting support and facilitated real-time data streaming.
A job with complex challenges in a company which is doing meaningful business
Position: Data Engineer
Category: SQL
Experience: 11 years | English: intermediate


Strong knowledge of software development processes In-depth knowledge of Oracle 10, 11 database, PostgreSQL, RDBMS concepts
DWH, OLTP
SQL, PL\SQL,PL\pgSQL Stored procedures, triggers, collections, partitioning, basic administration
Performance tuning, query optimization
ETL development
Python
AWS - Cloud Practitioner Certificate
C Builder, Delphi, C
XML, XSL – transformation.
CVS, SVN, GIT
JIRA, ALM
Intermediate level of English.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: upper


• Strong knowledge of SQL, PL/SQL, PostgreSQL
• Experience in constructing DWH both 3NF and Star / Snowflake (cleansing and normalizing source data, transformation and loading with PL/SQL procedures)
• Experience in BI Tools: MS Power BI
• Development of multifunctional dashboards using various data sources, editing dashboards and issuing rights to view and edit using MS Power BI
• Familiarity with test documents creation (test cases, checklists, test strategy)
• Novice skills in test automation using Python
• Proficient in analyzing the efficiency and effectiveness of business processes.
• Participation in the discussion of business requirements and proposals for their improvement
• Skilled in assessing risks and control environments.
• Proven ability to provide recommendations for process improvement and risk management.
• High responsibility and reliability, good team relationships.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Summary:

Data Engineer with 3+ years of experience. Extremely interested in building reliable data systems capable of delivering business value. Team player and respectful colleague, fast learner and attentive to details.

Professional Experience:

Data Engineer
Playrix - remotely from Georgia
Jan 2022 - Present
- Working with ETL based on Airflow and Luigi with notifications to Slack.
- Using data lake and data warehouse principles in AWS - infrastructure (s3 and Redshift).
- Using other AWS tools to optimize work of engineering: Athena+Glue for structuring raw data, Lambda functions, CloudWatch for logging, ParamStore for confidential data, DynamoDB and others.
- Set up a lot of APIs with different data formats.
- Developing full-stack systems for analysts to simplify work with various API using Django and Javascript (for example, to simplify the management of creatives, ad bidding rates, etc.)
- Using complex SQL queries, views and query plans.
- Using dbt as the main tool for working with tables and views.
- CI/CD in TeamCity and GitHub.
- Full-fledged work with Git (pull requests, code review, etc.).
- Kanban methodology in Asana.

Data Engineer
DominiGames - remotely from Georgia
Sep 2020 - Dec 2021
- Automated data flow from scratch, integrated main stores - Google Play, App Store, Amazon, Steam and Windows Store.
- Set up the data flow from the Adjust mobile attribution system. The data was exported to Google Cloud Storage and then uploaded to the company's server.
- Configuring API for advertising networks.
- Set up Clickhouse (at the time of employment, Postgresql was functioning in the company, which did not cope well with analytical data).
- Worked closely with Tableau to create dashboards and data sources for them.
- Interacted with Firebase and BigQuery.
- Trained junior data engineers.

Data Scientist
BELTEL
Feb 2019 - Sep 2020
Successfully completed projects:
- An optimization system based on a neural network that minimizes losses in the sugar production process. Bonus: got a master's degree from my university with this project.
- Recommendation system for retail to predict the demand of goods for the period of promotions.
- System for a food distributor for optimizing supplies by using product similarity.
- Analytical system for monitoring deviations from the set modes.
Tools used: PostgreSQL, Flask/Django, Python (pandas, numpy, matplotlib, seaborn), Machine Learning (lightGBM, sklearn), Deep Learning (keras), Dash/Plotly, Azure
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: intermediate


Support and develop ETL pipelines. 
Maintaining ETL process into DHW from client files;
Creating and developing data pipelines in Apache Airflow
Creation of reports for clients.
SQL query optimization.
Interesting and challenging projects, complex and non-standard tasks, professional growth/development of yourself, friendly team, coherent work process, adequate management, flexible hours
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper


Tabular model developer:
- Writing and optimization of SQL queries (creating tables, views, functions, SELECT queries, Openquery, Linked Servers etc.) to load data into Tabular model
- Scheduled jobs administration, logs analysis 
- Using DAX to build calculation formula expressions for Tabular models and PowerBI reports
- Implementation of complex calculation logic for business tasks
- Tabular model modification using VisualStudio, SSMS, TabularEditor
- Developing and maintaining TM structure using JSON
- Working with Azure DevOps boards
- Communication with foreign teams and POs
Professional growth, learning and using of new technologies, deep understanding of the company's product and specializations.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Team lead | Kaspi Bank
Sep 2021 – Present
As a team leader, I assembled a team of 10 employees. Trained and adapted to the work environment. 3 of these employees passed the attestation of their skills in 2022 and got a job promotion.


Risk Specialist | Kaspi Bank
2018 - 2021 - Automobile Scoring system
Implemented developments in automobile scoring strategy.
- Provided thousands of automobile sale & purchase operation in Kz.
- Launched product changes, increased the conversion for 42% in 2021;

2019 - 2021 - Face verification system
  Developing and integraEng face verification system with face anti-spoofing service for mobile app, ATM and Cardomats.
- Decreased time spent to manufacture debit cards from 15 days to 1 min. 
- Prevented up to billions dollars of potential fraud attempts;
- Implemented online service for account opening due to COVID restrictions in 3 days. Thousands of people were able to get government support payments online in quarantine.
Position: Data Engineer
Category: SQL
Experience: 2 years | English: upper


Technical Support Agent (call-center, establishing remote connection with the customers in order to troubleshoot different problems on their computers - macOS, Windows).
Customer Experience specialist (anlyzing the technical part of the cases, where the customers requested their money back and left negative feedbacks due to the dissatisfaction with support team's work).
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

I established deployment process in Azure DevOps and taught team how to use it. 
I mentored junior and trainee teammates. I performed technical and code review of their tasks.
I found point of improvement in code structure and started refactoring process.
I configured Row-Level-Security for reports. I written complex DAX expressions and created data model using Power Query. I used Native Query to connect to databases and written complex SQL queries.
Tech Stack: SQL Server, Power BI, Python, Spark, Airflow, Git, dbt

Project 2: 
I created analytics for big Ukrainian IT comany. I wrote complex stored procedures to transform data (SQL Server). I created reports (Power BI), enhanced performance of existing reports. I established deployment process using Azure DevOps service and helped team with understanding git. I found points of improvement in code structure and began refactoring process.

Project 1: 
I worked on creating Self-Service BI solution. I communicated directly with customer. I created reports using several data sources. I offered my own designs and solutions to best answer business questions by reports.
Strong BI Engineer switching to Data Engineering. Currently I am studying Python, Spark and AWS to enhance my tech stack. Therefore I would prefer projects where I can practice and develop these skills.
Position: Data Engineer
Category: SQL
Experience: 5 years | English: intermediate


The development of new features as well as the introduction of changes to the existing functionality of software products, according to the terms of reference; 
solving problems associated with the use of previously developed functionality;

Technologies used:

T-SQL:
-Writing procedures for loading/unloading data using processing logic and validation;
-Creating different reports;
-Creating procedures for loading data into DWH from OLPT databases of the information system;
-Designing data warehouses, and also individual measures and measurements.

SSAS:
-Creation and modification of measures and measurements, including historical ones;
- Basic understanding of MDX.

SSIS:
-Create, Modification of ETL packages;
-Solving problems associated with the operation of ETL packages.

Auxiliry:
Git;
Jira.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


The latest project is ETL for processing data from gaming applications. We are building it using Airflow, Snowflake, Looker. GCP is used as a cloud provider.
Dataflow and Airflow are used for data processing. Dataflow jobs written in Python are responsible for streaming processing.
Airflow DAGs written in Python are used for batch processing.
All the BI dashboards are built with Looker.
The data are stored in Snowflake.
Also, we use FastAPI as starting point for some pipelines. There is New Relic integration. Terraform is used to manage GCP
infrastructure.
I lead a team of 9 people.
Position: Data Engineer
Category: SQL
Experience: 0.5 years | English: pre


The product is CIM System. Tune SQL scripts, design complex queries and user-defined functions using SQL, fix bugs, test and debug code.
Position: Data Engineer
Category: Data Engineer
Experience: 10 years | English: intermediate

Modeling and create DWH on MS SQL 2017. 
Data Warehouse architecture, modeling, creating. ETL, Merge, Slowly Changing Dimensions use.
Gained more experience for T-SQL.
T-SQL, PL/SQL
DDL, CTE, Windows functions, temporary tables, dynamic SQL, stored procedures and functions
Query plans. Query optimization. Indexes.
MS SQL Server 2017-2019
Microsoft SQL Server BI – Integration ETL, Reporting Services, Analysis Services
Data collected and processed, made Reports and OLAP Cubes  
Data Warehouse architecture, modeling, creating. ETL, Merge, Slowly Changing Dimensions use.
Some experience in  PHP, CSS, Java script
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper

I am confident that achievements will be made in the near future:)))
Under NDA - Data Engineer
May 2022 - current
Develop pipeline which automates processes of data collection from multiple
data sources, cleaning, validation and analytics.

Vodafone Ukraine - Data Engineer
October 2021 - May 2022
Facilitated cross-functional team cooperation in business decisions making processes. Designed and implemented reporting & modeling the data to drive business solutions in the financial domain. Conducted business analysis and
research process. Created Quality Assurance tests.

LetyShops - Data Analyst Intern
January 2021 - March 2021
 Created dashboards in Google Data Studio about statistics on the incidence of Сovid-19 in Ukraine.

Self-employed - Mathematics Tutor
2019 - 2021

Goal:
Looking for a job of data engineer with an 
interesting stack: PySpark, AWS, Azure, etc and with opportunity in future will change Python to Scala.
Excel, Daily dashboards and reports.
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper


- updating database, creating stored procedures, views, complex queries, etc. (SQL, Python);
- data analysis (Python: pandas, numpy, plotly etc);
- ML algorithms (Python: scikit-learn, XGBoost, transformers, torch, nltk etc.);
- Creating and deploying microservices (Python, AWS, Docker, Airflow etc.).
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper

In my first job, I had the opportunity to work with data from large well-known companies, which brings me closer to my dream job in the field of Big Data.
  Then I focused on the goal of becoming a Big Data Engineer, so I dove into the development of skills in this field (current job at DS company), practically gaining experience and preparing for Big Data.
VeraData - Data Engineer, 1 year (current)

- design and develop ETL pipelines
- data integration and cleansing
- implement stored procedures and functions for data transformations
- ETL processes performance optimization

For this jop I mostly used Python(Pandas/PySpark), Alteryx and SQL.

---------------------------------------------

PwC - Data Analyst, 6 mos

- parsing and further data processing
- building ETL workflows
- reporting the results of the analyzed data

For this jop I mostly used MSSQL, MS Excel, Alteryx and Qlik Sense.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: fluent

Did some optimisation and found few flaws in the projects which saved big amount of money. 

Achievements:
- FLEX program. 1 of 200 people that were chosen for the exchange program and scholarship.
- Awarded scholarship for Ukrainian Catholic University by ELEKS.
- SpinOffHack Ukrainian Hackathon. 1st place out of 20 teams.
- M-Start startup competition. 2nd Place out of 30 startups.

Leadership:
- Organizing the charity half-marathon “Values Run” to raise money for kids with cancer from Lviv’s Chernobyl Hospital
- Leading university projects teams with 5-6 people (Problem Solving, Linear Algebra)
- Moved for a year to study in US, live with host family and work on projects for FLEX

Certificates:
Udemy: Big Data Analysis with Scala and Spark, 2021
Udemy: The Complete Programmatic Advertising Course, 2021
Udemy: Streaming Big Data with Spark Streaming and Scala, 2021
Coursera:  Neural Networks and Deep Learning, 2020
Was working as Python Developer on various projects for 4+ years.
Mostly with Flask, PostgreSQL, CouchDB and various analytical tools (Altair, Pandas, NumPy). Also worked for about two years maintaining data pipelines and consumers with Python and various official/unofficial social APIs, have a good knowledge of the adTech domain. Have a solid experience with Docker, Jenkins, AWS.  
For the last year have been working with Scala, Spark, Airflow as my main stack for the adTech domain for an Ad Exchange Platform.
Want to continue working as a Data Engineer interested in trying GCP instead of AWS.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: intermediate


With a background in data analysis and visualization, I've developed into a highly skilled data engineer with experience designing and implementing complex data architectures to unlock the full value of data. My ability to think strategically about how data can drive business value, while also being detail-oriented and capable of handling complex technical tasks, makes me an effective data engineering leader.

My diverse skill set includes a range of data engineering tools and technologies, such as DBT (data build tool), Apache Airflow, and Google Cloud Platform. I've gained experience in machine learning while building customized product designs and forecasting models, and I have a deep understanding of data modeling, data warehousing, and ETL processes.

Throughout my career, I've tackled a range of challenges from building robust data platform and conducting data migrations to mentoring colleagues and conducting code reviews. I'm passionate about building effective data-driven solutions to help businesses grow.
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: intermediate


With over 2 years of commercial experience, I have a strong background in working with the AWS stack. I have successfully completed several projects that involved creating ETL pipelines, scheduling them and developing services for notifications. My primary programming language is Python and I have also worked on tasks that required rewriting Java code with AWS services. I am well-versed in writing PySpark scripts for AWS Glue and EMR and have a solid understanding of SQL. With my technical expertise and strong attention to detail, I am confident in my ability to deliver high-quality solutions.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper

For over 5 years of business expertise, I proved my skill in SQL script-writing and whole database work understanding from the university minimum to the advanced database administrator, who can deal with a great diversity of problems and needs that Data Engineer faces. I am ready to learn new languages/techniques and improve my own knowledge for the new job.
With over 5 years of experience in technical roles such as Data Engineer I have a strong background in SQL, T-SQL, Microsoft SQL Server, and databases, SSIS, Azure Datafactory, Tabular, and have also worked with other technologies such as REST APIs, JSON, XML, XSLT, and Git. Experienced in developing, optimizing, and maintaining stored procedures, triggers, and views, as well as in preparing technical specifications and program and data flow diagrams. Skilled in using various BI and reporting tools, including Tableau and Microsoft Power BI, and have experience in Agile methodologies and working in cross-functional teams. Demonstrated ability to collaborate with stakeholders and global teams, and have successfully facilitated enterprise implementations and product releases.
I definitely want to continue working with Databases and SQL, it is my passion. But I also want to develop myself further as a Data Engineer/Scientist with Python knowledge. I would be glad to work with Power BI, Tableau or other data visualization tools, as well as with Data Factory and Tabular. I would like to be part of the communication function in my new position, like contact with clients and different business functions. I am looking forward to an interesting project which I can dive into.
Position: Data Engineer
Category: Python
Experience: 7 years | English: fluent

Motivate students towards AI/ML applications
Identified a security problem in the organization and come up with internal solution
Contributed to increased revenue for the company through showcasing the work
Certificate on AWS cloud practitioner
Wolfram verification for Cardano on chain data
Setting up dashboard with metrics and scheduling for postgres-bigquery comparison analysis
Data migration using dbt/trino
Develop example queries and graphs in Data Studio for bigquery
CI/CD workflows setup for Pull request( PR) alerts on slack channel
Apply test driven development (TDD) and refactor codes accordingly
Data quality check on tables in database
Provide knowledge base on entities relationships and dependencies
Optimize queries that tend to take up too much resource
Set up scheduled cron jobs in Pgadmin and Kubernetes
Apply monitoring and alerting for various metrics , databases, bigquery, pgcron in Prometheus and Grafana


Design and implement desirability ranking, performance ranking, status of saturation,number of blocks created, ROS(Return on stake) prediction of stake pools building customized ML model on AWS Sagemaker
Integrate customized model result from Sagemaker into AWS Quicksight for better visualization
Perform anomaly detection using amazon Quicksight
Identify address and fund distribution of byron and shelley for cardano blockchain
Classify UTxO ages based on addresses to distinguish the number of old ADA holders from new ones using db_sync data source
Carry out behavioral analysis of client's users with google analytics
Extract cryptocurrency data from CoinGecko, CryptoCompare and CoinMarketCap using mixed analytics
Study patterns and movements of exchange accounts and their liquidity
Perform on-chain analysis on the Cardano platform
Extract data from db_sync source
Differentiate pool owner's withdrawal activity from that of delegators
Categorize stake pools based on their delegation size
Identify public and private rewards on epoch basis
Evaluate new delegation activity
Settlement desk validation/testing -> shift from Redshift to RDS
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper


Work as a Data Analyst more than 2 years in digital marketing and IT companies.
My job involves:
• Built ETL from different data sources (Google Ads, Display and Video 360, payments services, etc.) with Python and Jenkins
• Automatisation of processes in marketing and web departments with Python
• Create dashboards of financial and user data in Tableau and Data Studio
• Analyse data of the web users and create insights
More involve in Data Engineering tasks, with interesting stacks and tools (AWS, Airflow, Data Flow, etc.)