lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: SQL
Experience: 4 years | English: fluent


Migration Project for Life Sciences & Healthcare company from NA (role - Data Modeller):
_______________________________________________________________________________________________
• Performed bulk code refactoring and compiled dashboard source views when migrating from Teradata to Postgres
• Wrote Python data quality tests for checking data correctness returned by new versions of source views
• Analyzed data discrepancies and documentated compatibility issues between Teradata and Postgres
• Conducting POC analysis aiming at evaluaing options for deploying DWH read replica of main instance (Redshift, Aurora DB, RDS Postgres)

Environment:
• Postgres (RDS), Teradata
• PyCharm, DBeaver, Teradata Express Studio
• Postgres plpgsql, Teradata SQL, Git, Python

Enterprise Development for Payment Processing company from UAE (role - DB Developer):
_______________________________________________________________________________________________
• prepared SQL scripts for reports in accordance with incoming requirements
• developed new functionality in way4 manager (menu items related to extracts, scheduler jobs)
• fixed prod defects connected with performance problems and report data discrepancies
• documented reports logic and structure in Confluence
Environment:
• Oracle 11g
• way4 Manager, SQL Developer, Git Bash, Bamboo Automation, Bitbucket
• Oracle SQL/PLSql, Git,WAY4
Migration Project for Life Sciences & Healthcare company from NA (role - Developer):
___________________________________________________________________________________________
• Preparing Data Migration scripts for the upcoming platform release.
Environment:
• PostgreSQL 9.6.5
• DBeaver, Docker, Git Bash, pgAdmin
Position: Data Engineer
Category: SQL
Experience: 11 years | English: upper


More than 10 years of software development, working experience with Financial, Travel, and Industry domains, familiar with Waterfall and Agile development models, strong analytical and problem-solving skills. Have experience of database and data engineering concepts - from SQL, NoSQL to Hadoop and Cloud
Key technologies:
•	Teradata, MySQL, Oracle, Amazon Redshift
•	Big Data technology: Hadoop-Hive, Sqoop, Apache Spark (pyspark, SQL), Amazon S3, Qubole
•	Informatica
•	Bash, Python
•	Perforce, Stash, GitHub, Jenkins
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


More than 6 years of experience in providing reliable and meaningful data solutions for companies from different sectors, including government agencies. It helped to reduce the time to get the expected product by development and automation. My experience spans IT transformation, data integration, distributed storage systems, DevOps practices, cloud solutions, and agile practices.
Position: Data Engineer
Category: SQL
Experience: 7 years | English: upper

Create ML forecasting system in one of the biggest Ukraine retail company.
More then 10 years work with data in FMCG, Retail, Supply Chain. Begin as data analyst, data scientist and now look for Data/BI engineer position. Have skills in mathematical modeling and forecasting.
Good team and new technologies
Position: Data Engineer
Category: SQL
Experience: 2 years | English: upper


More then two years I was working in the Big 4 (PwC) as an auditor. Mostly worked with big international bussiness in cooperation with collegues from CEE region. Vast majority of my time (65%) I was involved to the audit of an global IT company (was auditing set of the entities whole over the world). During my work I developed such skills as: project planning, time managmend, people managment, data analysis, data processing, financial analisys, accounting, auditing, presentation skills, teamwork. 

Ongoing work with data and participation in digitalisation projects of the auditors procedures (which involved close cooperation with data engineering team) made me think about changing the area of my work. 

So for the past two years, I have been working in the data team of an international company that collects, processes and sells data (Enverus). The company has its own product for which we provide tech support. During this period, I became a confident user of SQL, as well as git, grafana, nomad, Azure, c# and am currently taking courses to learn Python.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: upper

Just the ordinary Engineer, whose achievements are yet to come.
Motivated and efficiency-driven with over 5 months of experience in Testing of Web applications and Mobile applications. I have good knowledge of both Web and Mobile testing, Client/Server environment, Agile and Scrum test methodologies. I have experience in writing, executing and managing Test Cases, Bug Reporting and Tracking Defects using TestRail and JIRA. Also, I have basic knowledge of Python, SQL, JavaScript, HTML, CSS. Moreover, I worked with Linux OS and Unix Terminal and have experience in REST API testing (Postman) and automation testing (Cypress).

HYS-Enterprise, Junior QA Engineer, November 2021 - Present

QA, “Joyn.de” (Web/Mobile) test project, November 2021
- Working in a SCRUM team
- Defining the scope of manual coverage for release cycle
- Designing tests for new features including web UI and API interfaces
- Planning, creating and maintaining decomposition, test plan, test cases using test design techniques and RTM for smoke, integration, regression, usability, functionality and user acceptance tests, etc.
- Execution of manual testing (cross-platform testing on real devices to provide better quality)
- Finding, logging and reporting bugs into JIRA and tracking until closure

QA, “Conduit” (test project), October 2021
- Requirements reviewing with Product Owner (Story refinement)
- Developing Decomposition
- Developing and executing Test Cases in TestRail
- Reporting bugs into JIRA 

QA, “Petstore” (test project), September 2021
- User Story reviewing 
- Developing test cases using test design techniques and RTM
- Executing test cases in TestRail
- Reporting bugs into JIRA
Growth both personally and professionally.
Position: Data Engineer
Category: SQL
Experience: 2 years | English: upper


MS SQL Server developer in banking and finance
Business consultant 2nd and 3rd level of support
-Stored Procedures, views, user-defined functions. Create and optimize

-ETL processes

-Migrated data from one database to another

-Develop technical documentations

-Writing user manuals

-Involved in creating DWH structure

-Create, develop and maintain SQL processes for channel performance data warehousing

-Power Bi solutions development

-Reports for banks and MF companies using MS SQL and micro service architecture

-Creating, develop and optimize procedures for dashboards
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: fluent

- 3.77 of 4.00 GPA at Boston University (M.S. ADA)
- designed and deployed a recommendation system for a groceries delivery app (Ryadom, part of Choco Superapp)
- designed and engineered a fraud detection system for a QR payments platform (Rahmet, part of Choco Superapp)
M.S. student at Boston University studying Applied Data Analytics with a concentration in data engineering.

Before beginning graduate school, I worked for nearly 2 years as a data scientist for the largest IT company in Kazakhstan (Choco Superapp). As a result, I worked on various services including food/groceries delivery, online/QR payments, airline tickets, and medical appointments.

I have professional and academic experience with ETL (Python, SQL, and dbt) and DWH design. In addition, I have designed and deployed numerous ML models that interacted with thousands of users every day (Python, scikit-learn, Apache Airflow, AWS S3).

I am currently looking for a data engineering internship for the summer, with a possibility of full-time work after graduation (January 2024).

My available dates are May 15th, 2023 to September 1st, 2023.
I have solid skills in all aspects of data work, including data analysis, data visualization, data engineering, and machine learning. Currently, I would prefer to work primarily with data engineering and ML.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper


My current project stack is Spark Streams, pySpark, pytest, AWS (EKS, S3, Athena, Glue, other), Hudi, Argo CI, Kafka

Few years ago I started with Python and used it as a convenient way to manage different cloud and  bigdata APIs. 
Now I improved Python skills much, cause project requires not only write pySpark code, but also cover it with unit/integration tests on pytest for Spark jobs.

Had some experience with Databricks, Snowflake, Cloudera (Hive, Spark), Azure.
Spark processing on java/scala.

Had some experience with Snowflake and Redshift, got SnowPro certificate.

Overall, I spend >10 years as an Oracle DB developer. 
ERP for Retail chain, DWH for telecom company,
(PL/Sql, SQL optimisation).
Have some experience in Tableau
and much more hands-on experience with QlikView.
I'd like to hone such skills as Python, pySpark, AWS, Snowflake.

definitely no any Reporting, RDBMS.

I set salary in net, for gross there should be ~6500$
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


My experience consists of skills in Hadoop stack, BI (SQL databases), DWH (SSAS, SSIS, SSRS, PowerBI), Cloud Engineering (AWS, GCP, Palantir Foundry, Azure), ETL using Spark (Python, Scala), DevOps Engineering (Cluster Management, IAM, UseCase reporting dashboards development, ELK stack). Additionally, I have knowledge of Java Core, and participated in Java Software Engineering.
I describe myself as self-organized engineer, who is capable of responsibility to manage technical processes in team, problem solving and strong time-management. I have an understanding of business relations, analytics and SCRUM process organizing. 
I managed entire development process starting from getting requirements, analyzing scope and estimating work to implementation, communicating status, testing and release management.
With no hesitation I’m open to new challenges and new opportunities.
Position: Data Engineer
Category: Data Science
Experience: 1.5 years | English: fluent

The credit scoring system I built with a team just in 6 months the system has reached 50,000 businesses, disbursed more than 500 million Birr.
My experience includes building a credit scoring system for small companies with no bank transaction using machine learning, creating different end-to-end data pipelines for various machine learning models, analyzing historical data to help banks make lending decisions, working with geospatial data to optimize a bus ticketing system, speech recognition models for low resourced languages and others as well. These projects have required me to use a variety of technologies, such as python, SQL, docker, dbt, Airflow, and AWS (lambda, glue, Athena, redshift, cloudwatch and more). Currently, I work as a data engineer and am working on improving and experimenting my skills in spark and Kafka.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate

•	Transformed reporting system in according to new account matrix. Reviewed packages/procedures and processes ETL.
•	Optimization processes aggregation and preparing  core data to MIS Reporting 
•	Redesigned data’s for process budgeting and forecasting 
•	Fixed many bug’s of MIS reports based on Oracle Analytics Report (OBIEE)
•	More 50 reports was created in according to business during the last year
•	My major responsibilities are manage of processes software development, implementation systems at fintech/finance domain, data analisys, data science,  business intelligence and visualization;
•	Understanding of principals OLAP/OLTP systems.
• Strong understanding of DWH principals.
•	Strong knowledge  ETL processes and how to build ETL solutions.
•	8+ years of overall database development expertise in DBMS;
•	8+ years of overall Data warehouse & Data Mart modeling expertise;
•	Strong expertise in BI stack: Data Warehouse design, data analysis, automation and implement analytics methods, Data Marts design, BI tools (OBIEE, Qlik, Tableau, Power BI);
•	Strong expertise in business intelligence systems. Experiences in business requirements analyzing and a definition of business processes.
•	Skilled in technical interviewing and evaluation processes
•	Expertise in mentoring for DWH&BI theory and concepts.
•	Knowledge and understanding of relational database design and programming.
•	Knowledge and production experience with developing, tuning and deploying reports and BI solutions.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate

Spark Jobs with Python, I would like to work with AWS / Python
MySQL (SQL) - 3 years
Oracle (SQL, pl-sql) - 8 years
PostgreSQL (SQL, PL/pgSQL) 3 years
Teradata - 2 years
AWS Redshift, EMR, S3, RDS - 3 years 
Apache Airflow - 3 years 

- maintenance and creation database objects;
- development and design of database/DWH, optimisation database structures;
- build queries based upon analytical functions, creating hierarchical queries;
- using collection, dynamic SQL;
- queries optimisation;
- creating SQL scripts for ETL processes organised in the Apache Airflow; 
- creating and maintenance Airflow DAGs
- creating PL/pgSQL functions for parsing json/jsonb PostgreSQL data type with following data transformation and loading to DWH in compliance with required SCD types. 
- creating ETL processes in the Core banking platform based upon different sources (text, xml, csv files; database tables; SQL queries) with using different approaches for data parsing (XQuery, Shell, Python scripting). Building reports based on loaded data;
- AWS: S3, EC2, RDS, Amazon Redshift, Lambda, IAM (basic level), QuickSight
- IBM InfoSphere DataStage (version 8.5)
- Python: pySpark, pandas, BeautifulSoup libraries, creating airflow DAGs
- creating Spark Jobs on Python for data aggregation in ORC, Parquet, AVRO, CSV formats.
- creating a pipelines/DAGs in Apache Airflow to process data from different sources like RDS, s3, kinesis with the using a pyspark jobs which run in EMR and upload final aggregated result to the Redshift tables;
- cost and performance optimisation EMR Clusters;
- cost optimisation of s3 resources.
interesting to work with the following tech stack: Data Engineer with Python, Spark, AWS Services.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: intermediate

- I'm analitical, self-confident and responsible person. 
- I've great communication and negotiation skills. 
- Graduate of EPAM Data Engineering Lab. 
- I'd the opportunity to work with SQL MS, MYSQL, ELT//SSIS, Windows Forms.
- I've experience with such programming languages  as C#, T-SQL.
- Basic knowledge of implementation of ETL solutions using on-premises software (SSIS) 
- I've experience cloud-based services (AWS and GCP) 
- Basic Python skills 
- One of my goals is to continually improve myself
Oct, 2021 – Jul, 2022
Job Position: Trainee Data Engineer
Project Roles: Trainee Data Engineer 
Worked with various tools and technologies:
- wrote SQL queries;
- wrote Python code;
- worked with Git and GitHub;
- worked with Amazon Web Services;
- created S3 bucket, Lambda function, DynamoDB table, SNS, AIM, EC2;
- worked with Google Cloud Platform;
- created Cloud Storage, BigQuery, Composer, Cloud SQL, Cloud Functions; - developed DAGs in Airflow;
- developed Dashboard in Tableau;
- developed Report in PowerBI;
- worked with Hadoop, Hive, Spark.
Database: SQL Server 
Tools: SQL Server, Pycharm, Jira , Visual Studio 2019, SQL Server Integration Services (SSIS), AWS, Power BI Desktop, Tableau.
Desktop Technologies: SQL, ETL with SSIS, AWS, GCP, Tableau, PowerBI, Airflow, Hadoop, Hive, Spark.

Jul, 2022 – Nov, 2022
Job Position: Data Engineer
Project Roles: Data Engineer
Project: Data is stored in CSV files. The CSV files uploaded into Google Cloud Storage named Buckets. From the Buckets CSV files are migrated into Cloud SQL (SQL Server or PostgreSQL or MySQL). Here we build relationships between tables and bring to the third normal form. Next step set up workflow with using Cloud Composer for orchestration. On the Cloud Composer we built on the Apache Airflow and operates using the Python programming language. By using Airflow and Python we are going to create Data Warehouse in the Cloud BigQuery with arranging all staging and aggregation steps on this database. The whole workflow should be built to maintain full load and incremental loads. On Cloud BigQuery in very last step we will create views with data prepared specifically to reports. For the reports can be used any of tools Tableau/Power BI/Looker.Participation- Create a Cloud Bucket and uploaded CSV files and JSON in there; - Create a Cloud Funcion that runs when a CSV file is uploaded to the bucket and uploads the data to Cloud SQL; - Migrated required data from Cloud SQL to BigQuery; - Local work with AirFlow and create pipelines - Analysed raw data in MySQL Workbench and selected those necessary for generating reports;Team Mentors team: 2 members, Dev team: 4 members Database MySQL, MS SQL Server, BigQuery Tools Cloud Storage, Cloud Function, Cloud SQL, BigQuery, MySQL Workbench, GitHub, Jira, AirFlow Technologies Google Cloud Platform.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

Successfully implemented the integration of Apache Airflow and dbt, enhancing the reliability of report pipelines and data transformation processes.
     Implemented advanced partitioning practices that dramatically reduced the processing time of complex queries from 26 minutes to an impressive 4.5 minutes, significantly boosting data processing efficiency.
One of my notable achievements was a highly productive collaboration with data analysts during my tenure at my previous workplace. This collaboration not only enriched my understanding of data but also played a pivotal role in solving various complex challenges in research and development. I thrive on the opportunity to work collaboratively with cross-functional teams, leveraging data-driven insights to drive innovation and progress.
While I am deeply committed to my professional growth and the ever-evolving landscape of data engineering, I also place great importance on maintaining a healthy work-life balance. I believe that a balanced approach to work fosters creativity and productivity, ultimately benefiting both my career and personal life.
Position: Data Engineer
Category: Python
Experience: 4 years | English: upper


One year at a large business project designed to streamline business consulting and auditing with a micro service architecture that makes various calculations, checks and generate reports. 

And half a year I worked on freelance before that. I did various small projects.
Good teamwork and working conditions
Position: Data Engineer
Category: Data Engineer
Experience: 1 years | English: upper


One year of experience as a PySpark Data engineer.
Work with modern technologies (e.g. cloud services, kubernetes, airflow etc.).
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


Oracle Data Integrator Engineer:
supported existing data flows (Oracle Data Integrator), optimized the performance,
integrated new sources of the data (includes a Knowledge Module developing),
developed a new functionality (e.g. transferring data between schemas),
conducted code review activities,
enhanced the deployment process,
took part in migration from ODI 11 to ODI 12
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: fluent


Overall experience in IT and Data Engineering - 12+ years
- Leading Data engineering teams - 4+ years
- Data engineering competency development and conducting technical interviews - 5+ years
- Developing Data integration pipelines(ETL, ELT) and Data Lakes(Delta Lakes) - 7 years
- Data platforms development - 5+ years(using data lake, delta lake, data mesh approaches)
- Cloud providers - GCP, Azure, AWS
I would not like to work on some project where legacy coding needs to be maintained; My preference is to work with up-to-date and new/evolving technologies and approaches.
Position: Data Engineer
Category: Data Engineer
Experience: 8 years | English: upper

- started automation project from scratch 
- Read several books and finished several courses on DE topics
overall experience in software development/testing 5+ years
decided to switch to DE ;
worked in network, automotive, document stream generation areas
preffered small team/company
Position: Data Engineer
Category: Python
Experience: 3 years | English: fluent


Over the past 3 years, I've excelled as a data engineer, crafting ML systems, generating data visualizations, and conducting insightful data analysis. My contributions span agile software development, where I've harnessed technologies like Python, GCP, Terraform, and SQL to achieve remarkable outcomes. Currently, I hold a pivotal role within the team, leveraging my experience to drive efficient and impactful outcomes. I'm eager to collaborate with motivated individuals, further enhancing my skills while making substantial contributions to companies' success. My goal is to continuously elevate my capabilities and deliver high-level value.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: fluent


Over the past five years, my professional journey has been primarily centered around working with data. Initially, I gained extensive experience in utilizing SQL Server and the K2 automation tool. Following that, I spent a year immersed in leveraging MicroStrategy for data analysis and reporting. For the past two years, my focus has shifted towards the realm of cloud computing and data engineering projects. Specifically, I have been actively engaged in tasks involving Azure Cloud, utilizing tools such as Azure Data Factory, Azure Synapse, Azure Databricks, and Python.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Participated in daily meetings with the team, in grooming and planning meetings to organize work. Worked with Agile methodology (Scrum).
Created complex queries and store procedures with SQL.
Created models for ETL work using dbt.
Created datawarehouses, users and databases for different environments in Snowflake using Terraform (Go programming language).
Created Airflow DAGs using Python and with created DAG builders, and set up parameters for the DAGs.
Done data migration between different cloud storages and raw sources with using ETL pipelines and manual scripts.
Worked on the collecting requirements with analyzing.
worked with the No-SQL databases, and created structured tables from them, the tables were updating(dynamic).
Created ETL pipelines(Azure Data Factory/AWS Glue/Airbyte), SSIS packages to deal with ETL jobs.
Created different reports, dashboards and other BI solutions with using Power BI/Tableau/Looker.
Created different paginated reports with using SSRS/ Power BI Report Builder
Position: Data Engineer
Category: Data Engineer
Experience: 1 years | English: upper

- Databricks Certified Data Engineer Associate certification (2023)
- DeepLearning.AI TensorFlow Developer (2023)
Passionate about DE with almost a year of production experience mainly with PySpark, Airflow, Databricks.

I have high level of personal morals and integrity. I am willing to 
work hard and have a great desire to learn.
Databricks; ability to gain experience with visualisation tools (Power BI, Tableau) would be a plus.