lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 10 years | English: upper


Data Engineer with 9+ years of commercial experience.
Worked in outstaff, outsource and product companies.

Details of experience:
DB: Amazon Redshift, MS SQL Server, Aurora SQL, Oracle, MySQL, Dynamo DB
Technologies: SQL, PL/SQL, T-SQL, AWS services, Python, DBT, Airflow, Databriks, Fivetran, LookML, DAX, ETL, SSIS, Talend
Reporting: Looker, Power BI, SSRS, Apex
Tracking: Asana, Jira, Confluence, Redmine, SVN, TFS
Stable and long-term project
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper


Data Engineer with experience in analyzing, designing and transforming data. Have a strong level in T-SQL, SQL and also have experience working with PowerBI, Azure, SSIS, C#, Python, AWS. A team player and a highly motivated individual willing to learn new technologies and methods related to data analysis. Able to adapt to different work culture and always ready to accept new challenges.
Develop stored procedures, views, tables.
Troubleshooting.
Bugs fixing in C#/VB code.
Data analysis.
Maintained DB.
Improve performance.
Learning AWS.
Learning Python (novice).
For me would be great to work and learn something new or develop my current skills but I also believe i am able to work at any task.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: intermediate

Support and refactoring of legacy projects. Created big data projects from scratch.
Data engineer with leading experience
Years of experience: 6+
Domain: analytics systems for the banks, fintech companies.
Key technologies: Python, AWS
Databases: PostgreSQL, MySQL
Queues: RabbitMQ, Apache Kafka, Amazon SQS

Additional skills: PHP, Javascript, Node.js, Lua, Google BigQuery, Amazon DynamoDB, Redis, MongoDB.
Additional: Have 6 years of experience in software engineering.  I have an experience with a large and complex legacy architecture and with the microservices architecture. I built end-to-end analytics, reports for a business, ad-hocks. I worked as a team leader of data engineers, software engineers and qa engineers. 

Graduation: Specialist's Degree in System software.
Analytics development
Position: Data Engineer
Category: Python
Experience: 9 years | English: upper


Data Engineer with proven practical experience in design and implementation data pipelines from various sources into the targeted data warehouses and data lakes.
Proficient in the assortment of ETL and orchestration technologies, including Airflow, SSIS, IBM Data Stage. Experienced in development of data-ingestion processes from REST and SOAP API.
Proven expertise in database development for Postgres, MS SQL Server, AWS Redshift. Experience in applying AWS technologies to build cloud data storages.
Hands on experience with creating and running Docker images for various applications. Experience in creating Tableau dashboards.
Good understanding of software development methodologies, including Agile (Scrum).
Able to effectively self-manage during independent projects, as well as collaborate in a team setting.
Looking for a job as a Senior Data Engineer.
Interested in opportunities for professional development and learning new technologies.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

Set up Apache Airflow server on Celery Executor and 3 workers on remote VMs.

I facilitated the implementation of Apache Kafka for Change Data Capture (CDC). Before my involvement, data was extracted from databases using batch processing.

I successfully carried out the integration of a data lake with a data warehouse (DWH), a task that had not been undertaken prior to my involvement.

Set up Grafana for Airflow & Kafka monitoring.

Developed telegram bot for pipelines and services monitoring.

I presented at a meetup with the topic 'DWH Architecture'.
Data Engineer:

Worked on Oracle based DWH using Airflow, PL/SQL, Kafka.

Implemented Kafka (Debezium, Confluent Connector) for CDC. Before me, data from PostgreSQL databases were fetched in batches. 

Set up Apache Airflow server on Celery Executor and 3 workers on remote VMs.

Developed telegram bot for pipelines and services monitoring.

I presented at a meetup with the topic 'DWH Architecture'.

Junior Data Engineer:

I've transitioned the legacy pipelines from Informatica to Airflow.

I've also developed a predictive model for the Monthly Active Users (MAU) of the application.

Junior BI analytic:

Designed dashboards for senior management highlighting key performance indicators.

I also tested the new Data Warehouse (DWH).
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: intermediate


Data Enginner
DWH Project
From April 2022 – now
Key responsibilities: 
•	Create SQL scripts;
•	Create mappings, sessions, workflows, connection in  Informatica;
•	Write shell and python scripts;
•	Support 

Data QA
DWH Project
From July 2020 – April 2022
Key responsibilities: 
•	Prepare and execute SQL scripts for testing functionality;
•	Work with PL/SQL  developer;
•	Prepare test protocols;
•	Testing installation with ETL Informatica;
•	API testing (REST);
•	Registered found bugs into Jira bug tracking systems.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: fluent


Data enthusiast with experience in Data Engineering , Machine Learning and Software Engineering. I have been building scalable Data Analytics solutions for the companies around the world. My strongest side is problem solving.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: fluent


Data Ingestion: Pulling data from various platforms and databases 

Data Cleaning and Triangulation: Data validation and reconciliation to ensure accuracy. 

Data analysis and visualization: creating interactive dashboards for internal and external stakeholders 

Designing database queries: Prepare advanced SQL scripts to extract Cardano blockchain data for various purpose
Pull data from various online and offline data sources into staging database and setup automatic incremental refreshing scheme. 
Design data cleaning protocol and apply in data cleaning packages.

Design and implement ETL (Extract Transform and Load) packages for data cleaning, flagging, and transforming on recommended tools including SQL Server Integration Services (SSIS) or Pentaho Data Integration (PDI).  
Analyze project data and design complex queries to extract data per project reporting demand. 

Design reports and dashboards to support management decision making and adaptive learnings. 

Lead data reconciliation meetings with project stakeholders to ensure all data is on expected level of quality and quantity.  
Design and implement innovative ICT4D solutions including web application  

Support capacity building efforts in utilization of ICT4D tools and reports.
Position: Data Engineer
Category: SQL
Experience: 2.5 years | English: upper


- Data manipulation and querying. 
- Data integration. Building and Maintaining SSIS packages. 
- Data Warehousing (SQL, Snowflake) 
- Creation of initial SQL stored procedures to export/import data.
- Maintenance of existing SQL stored procedures according to the changed client’s requirements.
- Communication with BAs and QAs daily.
- Generation of reports from the Salesforce.
- Code review
- Arrangment and driving Sprint planning meetings
 
I'm highly motivated, disciplined, responsible and well-organized. At the present moment, I'm learning Python. 
 

Tools&Technologies: T-SQL, ETL, Data Warehousing, Snowflake, MS SQL Server 2019, SQL Server Management Studio 2018, MS Visual Studio 2019 (SSIS), Jenkins, Scrum, Azure DevOps Server, Salesforce, Jira
Position: Data Engineer
Category: Data Science
Experience: 1.5 years | English: upper

Engaged in self-directed learning, active enhancement of expertise in data science is 
the primary focus. Proficiency in statistical analysis, predictive modeling, and 
programming defines the skill set. The immediate goal is to apply and refine this 
proficiency in the data science field, with an aspiration to secure a data scientist role 
within a forward-thinking organization valuing existing skills and the commitment to 
continuous learning
Data Science Intern Aug 2023 – Present
Standard Bank (Remote)
 Integrated business understanding, data preparation, and advanced modeling 
techniques to execute a machine learning project during Data Science Internship 
at Standard Bank.
 Evinced keen grasp of data understanding and evaluation, resulting in strategic 
development and execution of machine learning project that contributed to 
company's digital transformation goals.
 Pioneered rigorous approach encompassing data preparation, modeling, and 
evaluation to achieve tangible outcomes in machine learning project, enhancing 
organization's analytical capabilities and data-driven decision-making processes.
Data Science Intern Jul 2023 – Present
British Airways (Remote)
 Overhauled efficient web scraping and analysis, leveraging data-driven insights 
to inform strategic decision-making as part of machine learning project during 
British Airways Data Science Internship.
 Trailblazed exploratory data analysis and predictive modeling efforts, producing 
actionable insights that guided decision-making and contributed to completion 
of machine learning projects at British Airways.
 Innovated a natural language processing (NLP) project, demonstrating 
advanced skills in data manipulation, analysis, and project management during 
British Airways Data Science Internship.
Data Science Intern Feb 2023 – Jul 2023
Data Glacier (Remote)
 Demonstrated expertise in business understanding, data understanding, and 
data preparation, culminating in execution of comprehensive data manipulation 
and analysis during Data Glacier internship.
 Bolstered modeling, evaluation, and model selection, contributing to 
development of effective machine-learning projects that harnessed advanced 
techniques for actionable insights.
 Ameliorated version control (Git) and executed model deployment with Heroku, 
ensuring seamless collaboration and efficient deployment of machine learning 
models during Data Glacier internship
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: fluent


Data Scientist - Trementum Analytics
May 2022 - Current
Implementation of similarity search.
- Set up Elasticsearch on Kubernetes cluster on the cloud, further maintenance;
Pipelines to transfer data between databases, and further transformations (ETL). Data cleaning, working with OpenAI embedding model, using Elasticsearch as a vector database for a similarity search engine. All scripting on Python;
- Provide results on dashboards - Kibana or Grafana for simple and Plotly Dash when more complex functionality is needed; 
- Results - developed a new effective method for analysis: efficient text search and powerful cluster algorithm.

ETLs -  extraction from different sources (like APIs) to Postgres database.
-nControl data completeness and quality (with test scripts and dashboards);
Assistance with implementation, testing, and maintaining pipelines on Jenkins (CI/CD)
- Find and fix problems in pipelines when occurs. Provide detailed reports for developers for problems with data extraction methods;
- Results - creating and development of the company's major product, which includes multiple automated data pipelines.

Involvement in implementing new technologies and building teams:
- Research of new services and technologies for the need of the company, comparison, and building demo projects to understand the possible value from them;
- Taking part in candidates' overviews and interviews. Results: successful hiring of two new analysts, who helped our team to advance our productivity and build new products.


Financial analyst/manager, sales department
Petrovets Apartments · Full-time
Mar 2019 - Dec 2021

• A real estate project at the sea resort. In 2,5 years, our department managed to sell more than 200 apartments and to find clients all over Ukraine
• Creating and controlling reports and dashboards using MS Excel, SQL
• Cooperating with the marketing team to improve our performance indicators
• Forecast future earnings and expenditures based on previously analyzed financial data
Position: Data Engineer
Category: Data Science
Experience: 6 years | English: upper

I'm working as a software engineer in a tech company, mostly with databases, with some involvement in web development.  Creating reports, creating scripts for data migration, supporting system, writing specifications, solving client problem requests.  Creating new databases, stored procedures, optimizing current sql-scripts, functions, triggers, views and queries etc. 
Control, monitoring, and Safety Systems.
Technical data support for other departments.
Also Dynamic  CRM
Work with limited direction, usually within a complex environment, to drive delivery of solutions and meet service levels.
Participated in modifying and changing the architecture of the original employee Retention application. Develop plug-ins to synchronize/update payment details to the CRM system.
Worked closely with customers
Team-player, deadline orientated and having the ability to learn fast. Independent, self-motivated team player that is meticulous and methodical in creating solutions.
DB servers maintenance;  
Experience with relational database, data modeling, business intelligence/reporting;
Data transactions updating, fixing, validating, data queries development;  
Experience building and optimizing data pipelines and data sets;
Creating projects app from scratch, including end-to-end processes and workflow;
Experience as a Business developer, delivering software projects with deep understanding of core functional capabilities
Refined problem-solving aptitude and analytical skills;
TECHNOLOGIES: 
JavaScript, PHP, Interbase, MongoDB, MySQL, 
T-SQL, Node.js, jQuery,  JSON, Bootstrap 3, Angular.js, React.JS, Redux, Webpack,  REST API, Websockets
TOOLS: 
WebStorm, PhpStorm, IBExpert, MS DB Management Studio, SublimeText , XAMPP, Denver,  PHPMyAdmin,  Adobe Photoshop, Avocode, K2 blackpearl
OS: Linux, Windows, Mac OS
I'm looking for an interesting job where I can use my skills and experience and looking for a chance to work in an environment where I can enrich my technical knowledge. I would like to join a friendly team where I will be able to grow
I'm interested in long-term projects, professional growth, and development/education.
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: fluent


* December 2018 – February 2019: SDE Intern at Samsung R&D Institute Ukraine.
	* Developed and modified cryptography algorithms.
	* Developed applications for steganography and steganalysis.
	* Evaluated performances of different approaches and algorithms.
* December 2019 – March 2020: Junior Security developer at Samsung R&D Institute Ukraine.
	* Developed key-logger applications for PC and smartphone.
	* Created models for user authentication/verification with data collected from those apps.
	* Evaluated performances of different models.
* June 2020 – February 2021: ML Engineer/Backend Developer at Adoriasoft Inc. 
	* Developed ML algorithms for image and video watermarking.
	* Implemented and tested multiple cutting-edge approaches and models.
	* Evaluated costs of product in production and optimized overall performance of product.
	* Deployed models to production and created APIs for serving deployed models.
* September 2020 – December 2020: part-time Data Scientist at Artellence.
	* Collected needed user-data from social networks.
	* Used collected data in e-commerce and credit-scoring models.
	* Used user clustering and segmentation for internet-marketing models.
	* Worked with big amounts(100+ million users) of client data.
* February 2021 – Now: ML/Data Engineer at Genesis.
	* Led team of 2 data engineers/data analysts.
	* Developed complex ML API’s and infrastructure using Python and AWS/GCP.
	* Developed ML models for photo/video editing and personalisation that were core features of our app → app grew from 0$ to 200k$ MRR in just 2 month after first build. 
	* Introduced Airflow as core of any data pipelines on project, optimized SQL scripts and tables → reduced infrastructure costs from 10k$/month to 3k$/month.
	* Created and led AB-test evaluation automation → saved our team 20 hours/week.
	* Integrated off-site LTV calculation and marketing automation service → saved 10k$/month in marketing costs.

* Tech Stack:
	* Languages: Python, JS.
	* Cloud Computing Providers: AWS, GCP.
	* VSC skills: Gitlab, Github, CI/CD.
	* AWS Stack: ECS, EC2, ECR, Lambda, S3, Redshift.
	* GCP Stack: GCS, GCR, GKE, Cloud Functions, Big Query, Cloud Composer, Compute Engine, Dataproc.
	* Databases: BigQuery, Postgres, Mongo, Redshift.
	* Analytics and Data Packages: Airflow, Scipy, Numpy, Pandas, Pyspark, GCP and AWS libs for python.
	* Analytics Software: Appsflyer, RevenueCat, Amplitude, Firebase(Google Analytics), Algolift.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: intermediate

Own business automatization platform with dinamic GUI of DB
Delphi Developer remoute
Moja Marketplace, USA
Mobile Market Place for Android and iOSMobile Market Place for Android and iOS
(October 2022 - April 2023)
•	Create marketplace in Android (and iOS)
•	Create forms
•	Connection with AWS 
•	Testing
Tools and Technologies: Embarcadero Delphi Studio, FireMonkey, Android, Amazon Web Services (AWS).

DB Developer / Delphi Developer / Project Manager 
Freelance PerfectSoft, Plato Kharkiv, Ukraine
(April 2009 – December 2011, August 2013 – Present) 
•	Created and modernization business automatization platform 
•	Database design and development 
•	Core design and development
•	Business analysis 
•	Support and Installation
 Tools and Technologies: Delphi, Firebird, SQL, Builder C++, CMS WordPress, MySQL.

Director / Manager Projects (not IT)
Rope Park S-Park, Kharkiv, Ukraine		Rope Park Korsar Kharkiv, Ukraine
(June 2009 – December 2011, July 2013 – February 2022)	(October 2013 – March 2019)
•	Business analysis 
•	Result orientation and command work 
•	Marketing and Internet Marketing
•	Make documentation and open LTD
•	Accounting registration. Budget management
•	Opening a branch, opening new directions
 Tools and Technologies: MS Project, Management, Marketing, Sale, Business Analysis.

DB Developer 
Intetics ltd, Chicago, IL / Ukraine, Kharkiv, Development Office 
(June 2012 – June 2013)  
•	Database design and development
•	Portable scripts to Big Data system
•	Download / upload data
•	Validation and investigation root cause of discrepancies
Tools and Technologies: SQL, NoSQL, ETL, Netezza, Oracle.

DB Developer/ Delphi Developer
Trading company OLKO, Kharkiv, Ukraine
(January 2012 – June 2012)
•	Core design and development
•	Database design and development
•	Requirements gathering
•	Estimations
•	Deployments
 Tools and Technologies: MS SQL, Delphi, Fast Reports.

DB Developer / Delphi Developer
Software development company CS ltd, Kharkiv, Ukraine
 (January 2007 – March 2009)
Bank automating system  
•	Design and implement graphical user interface for existing application suites
•	Database design and development
•	Code review
•	Business Analyst
 Tools and Technologies: Oracle PL/SQL, Object Pascal, Oracle database design, stored procedures, triggers, analytical functions etc.
SQL-developer, BI, DataScience, Oracle developer, MS SQL developer, Big Data, Data Engineer
Position: Data Engineer
Category: Data Science
Experience: 8 years | English: upper

Create data model and develop and deploy algorithm to calculate monthly search volume based on Google Trends;
Develop data validation for all ETL pipelines;
Develop CLI based service for automated tableau reports publishing;
Optimize SQL queries;
Develop forecasting and planning processes that required minimum human interactions;
Create a fully automated project's performance reporting system;
Based on statistics methodology develop fraud detection algorithms and reports;
Developed pipeline with acquiring third-party data,  uploading to the data lake, and further delivering to ML systems.
Design and develop ETL pipelines;
Design and develop reporting platform with over 1000+ client reports;
Integrate third party data;
Design and develop data lake;
Looking for challenging and interesting tasks where I can gain data mining, machine learning skills. I like python, and looking for an opportunity to improve my programming skills. Friendly colleagues.

Product company only.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: fluent


Design, development and testing of project deliverables:
- Relational and multidimensional metadata models,
- ETL process,
- OLAP structures,
- Technical documentation,
- End-user training,
- BI platform administration (installation and deployment, content administration, URM, system monitoring and
security),
Technical requirements analysis and solution design.
Involved in system architecture and DWH database model design.
Maintenance of DWH system: analysis of reported incidents and bug fixing.
Performing testing and preparing UAT documentation and operation guides.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: intermediate


Designed, developed, and tested the ETL strategy to populate data from multiple source systems. Designed and developed Power BI graphical and visualization solutions with business requirement documents and plans for creating interactive dashboards. 
• Leads the activities of data warehouse project teams in the design, development and implementation of data warehouses; and the configuration and auditing of data warehouses to ensure quality control of data.
• Oversees the development, operations and maintenance of data warehouse environment, including organizational balance and system coherency between front-end desktop/client environment and data warehouse back-end processing functions.
• Provides guidance regarding the use of data warehouse systems, capability of systems to deliver information, and subject matter expertise regarding current systems and emerging technology.
• Lead team of Data Integration Engineers both onshore and offshore resources.
• Be a thought leader and driving force behind data initiatives
• Learn our client’s users’ needs both from a historical/warehouse perspective and an operational/transactional perspective
• Create standards and conventions for data warehouse, analytics, and ETL systems. Lead governance and enforcement of standards.
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper


•	Designing and implementing Extract, Transform, Load (ETL) processes to efficiently move and transform raw data from various sources into usable formats for analysis.
•	Utilizing cloud-based platforms (such as AWS, GCP) to deploy and manage data engineering solutions, leveraging their scalability and flexibility.
•	Integrating data from disparate sources, both internal and external, to create a unified and comprehensive view of organizational data.
•	Developing and maintaining data models that define how data is structured and organized in databases or Data Warehouses to optimize querying and analysis.
•	Designing, constructing, and managing Data Warehouses to ensure high-performance storage, efficient data retrieval, and scalability.
•	Maintaining version control for code and documentation of data engineering processes, facilitating collaboration and knowledge sharing.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: intermediate


Designing, developing, optimizing, testing, monitoring traditional classic data warehouses and ETL/ELT processes

Communication with businesses, Data scientists etc

2+ years of engineering experience
1 year of BI developer experience