lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Senior Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper

NRT data processing
Event Driven data processing in AWS
• AWS Certified Data Analytics – Specialty
• Experience in working with AWS (S3, Lambda, StepFunctions, SNS, SQS, KMS, SSN, DynamoDB, CloudFormation, CloudWatch, Kinesis, Glue, Athena, Redshift)
• Experience in working with Qubole (Hive, Presto, Spark)
• Development of ETL: Prefect 2.0, Airflow (MWAA 2.0), dbt (Data Build Tool), IBM DatatStage, Informatica, MS SSIS;
• Database design and implementation: Oracle, MS SQL, Teradata, DB2, Hadoop Hive, Snowflake;
• SQL-tuning;
• ETL performance tuning;
• Development of Oracle PL/SQL, Microsoft T-SQL, Teradata SQL PL program units;
• Experience developing on Python;
• Experience using bash & PowerShell scripting;
• CI/CD tools: Jenkins, GitHub Actions, Terraform
• Debugging & Unit Testing;
• Experience with Git, SVN, Perforce; TFS;
• Troubleshooting, problem solving.

===========================================
Senior Big Data Developer
EPAM Systems · Contract
Jun 2021 - Present
Customer: EF Tours

AWS services used for data lake hydration using DMS, S3, Glue, Lambdas, Step Functions etc.
Data loading into Snowflake (Cloud Data Warehouse)

Projects pipeline:
- Implement tooling for task orchestration and data transformations using AWS Managed Airflow, dbt (Data Build Tool).
- Ingest and process additional data flows into Snowflake
- Near real-time replication to hydrate data lake and Snowflake DWH

Tech stack: 
- AWS: Lambda, StepFunctions, S3, SQS, SNS, DynamoDB, DMS, KMS, SSM, Athena, CloudWatch;
- Snowflake
- DBT (Data Build Tool)
- Prefect
- Fivetran
- Rivery
- Python
- Terraform
- GitHub Actions
- Docker
AWS
Snowflake
dbt
Python
FiveTran / Rivery
Position: Senior Data Engineer
Category: Data Engineer
Experience: 7 years | English: upper

Worked on all phases of data warehouse development life-cycle, from gathering requirements to testing, implementation, and support.
Big Data Project with (Apache beam,Apache Airflow, Apache Spark).
Good knowledge Google Cloud Platform (Dataflow, Bigquery, Dataproc, Bigtable etc..).
Good knowledge PySpark
•	Exceptional background in analysis, design, development, customization, and implementation and testing of software applications and products. 
•	Demonstrated expertise utilizing ETL tools, including SQL Server Integration Services (SSIS), SQL Server Annalise Services (SSAS), SQL Server Reporting Services (SSRS), Data Transformation Services (DTS), and DataStage and ETL package design, and RDBM systems like SQL Servers, Oracle. 
•	Strong understanding of data warehousing concepts, OLTP, OLAP, Normalization, Star and Snow Flake data models.
•	Create OLAP Cubs.
•	Strong leader with experience training developers and advising technical groups on ETL best practices. 
•	Excellent technical and analytical skills with clear understanding of desig
I am Freelancer :-)
Position: Senior Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


Certified AWS Associate Developer,
Certified AWS Associate Solutions Architect,
Certified GCP Professional Data Engineer,
Took part in Snowflake certification prepering tranings

>1 year of freelance experience (web-dev, not considering it anymore)
~3 years of commercial experience, 2 big projects:
1. On-premises ETL migration project
Stack: IBM DB2(source), MariaDB(target), Talend Studio for Data Integration (ETL tool), Liqubase, Jenkins, Docker, Python (for automating manual tasks), Git/GitLab, Jira

2. Building Data Lake in cloud environment
Stack:
AWS Services: Redshift, Redshift Spectrum, S3, Athena, Glue, CloudFormation, SNS, Lambda, CloudWatch, SQS
Other: Python, PySpark, DWH, PostgreSQL (Redshift version), Jenkins, Git/GitLab, Jypyther Notebooks, Jira

Other activities: technical interviewing (~30), mentoring (1 to 1 in company, 1-to-1s on a project KT (6 times), mentoring team after company Data courses), experience in community speaking (1 company event, couple of project-related events), driving and facilitating SCRUM meetings

Detailed description available in CV, just message me)
Cloud-based BigData projects (AWS, GCP, Azure)
Not interested in on-premises tech stack
Position: Senior Data Engineer
Category: Data Engineer
Experience: 8 years | English: fluent


Data Engineer with a proven track record in designing, building, and maintaining efficient data pipelines and solutions in companies of various sizes including start-ups and established international companies.

Proficient in a variety of programming languages, including Python, Scala, Rust, and SQL, and experienced in utilizing big data technologies such as Hadoop and Spark. 

Strong analytical skills and a talent for translating business needs into technical solutions. Adept at collaborating with cross-functional teams, including data scientists and software developers, to deliver data-driven products and insights.

Worked in consulting in Europe for multiple years. Have successfully enabled small and medium size companies to utilize their data at scale with a data ecosystem built both in the cloud and on-premise. Managed small to medium size teams. Domains: Fintech, Proptech, PharmTech, ChemTech

I have an MSc degree from the University of Leeds and did my bachelor's in Moscow. Playing chess is my hobby.

Able to work B2B from Latvia or Azerbaijan. Open to relocation and/or travel. Remote, or hybrid preferred.

• Python, Hive, Spark, RabbitMQ, Airflow, Git, Bash, Jenkins, Travis, Docker
• Understanding and adhering to concepts of FP and OOP depending on the use case
• Experience in working with AWS services such as Amazon S3, Lambda, EC2, Glue,  EMR, Redshift, DynamoDB, Athena, and IAM
• Experience in working with GCP. Cloud Storage, BigQuery, Functions, Data transfer, Cloud Functions, Firebase, Firestore, Google Analytics
• Experience with Databases, MySQL, Oracle, Microsoft SQL Server, MongoDB, Firestore
----------------------------------------------------------
Position: Senior Data Engineer
Category: SQL
Experience: 5 years | English: intermediate

Snowflake certified
Data Engineer with experience in Snowflake cloud database, AWS, GCP.
ETL tools: Matillion, Talend, SSIS
Reports : Power BI, Tibco.
Programming skill: Python.
Snowflake certified.
Snowflake cloud database, AWS
Position: Senior Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Data Engineer with hands-on knowledge of SQL, Python, Airflow, & AWS cloud. 

5+ years of experience in different data roles (recent 4 years as data engineer). 

Key expertise: code-based data pipelines (ETL/ELT), data warehouse (DWH)/data lake development, data modeling. I also have experience with productionization of ML models (tabular/time-series data).
NOT interested: 
- overtime work
- work at ukrainian holidays, weekends, late or night hours
- employee tracking soft (time trackers, bossware)
Position: Senior Data Engineer
Category: Data Engineer
Experience: 9 years | English: upper

Experience with Data Mesh implementation.  
Experience with development of the Medical Device Class 3 software product. Development of the 3D graphic software product.
Dear all, 
I had a lot of projects as  a Senior Software Developer in different business domains (finance, healthcare, logistic) and with different technologies (Python, Spark, Snowflake, Dbt, Databricks, AWS Cloud, Terraform). 
I'm searching for Data Engineering opportunities. 
Currently learning linear algebra just for fun so will be interested in projects with ML part (ML ops).
I'm searching for Data Engineering project, as currently doesn't have any project at current company.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper

• Design and creation of new data pipelines and maintenance of existing ones
• Optimization of existing mechanisms for speed and cost-efficiency
• Ensuring pipeline stability and best code practices through Unit/Integration testing and CI/CD
• Design and implementation of back-pressure mechanism for log fetcher to avoid data loss
• Design and implementation of disabling mechanism for stuck workers based on statistics collected during particular time window
• Design and implementation of throttling for producers cluster to decrease lag between producers and consumers
• Design and implementation of re-enabling mechanism for failed workers using exponential retry and jitter
• Have added integration with new third party log sources for fetching
• End-to-end delivery of highly scalable cloud native product
• Deep knowledge of modern software development technologies and frameworks
• Experienced in performing optimisation, performance profiling and debugging
• Expertise in designing of scalable software applications from scratch and based on existing solutions
• Understanding of object-oriented and service-oriented application development methods and theories
• On-hands experience in production with SQL/NoSQL databases and DBMS
• Solid knowledge of the most popular Version Control Systems
• Good knowledge of modern operating systems and command line
• Ability to handle a team of software professionals, appropriately dealing with problems inside the team
• Ability to deliver technology solutions which meet business expectations in shortest terms
• Experienced in integration of best engineering practices into existing processes
• Dedicated with proficiency to work independently and in a team
Position: Senior Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Development, implementation and maintenance of models for evaluating credit risk
Aggregation of the data from different systems, development and maintenance of data marts, ensuring data quality  and reconciliation, regulatory and business reporting.
Migration of ETL(ELT) pipelines to open source: performing PoCs of new tools & environments, learning new tools, performing MVPs, defining rules and approaches, migration and development of pipelines using new tools.
DWH (Sybase IQ) & Data Lakehouse (AWS S3, AWS Glue, AWS Lake Fomartion) building: rules, formats, governance, ingestion.
Leading a migration of On-Premise processes to Cloud solutions: helping stakeholders with onboarding to cloud; gathering of requirements and dependencies; data modeling; construction of a migration plan.

Stack: AWS, S3, Athena, Glue, Lake Formation, SQL, Python, NiFi, Spark, Airflow, Docker, Linux, Java.
I am a competitive person, so I love challenges, learning, all kinds of games (sports, computer, board), math and especially data. There is always a way to do more or better with data. And that's why I'm here to improve my skills and put them into good use in projects that socially matter.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


Experienced Senior Data Engineer with 5+ years of expertise in creating strong data pipelines, efficient data warehousing, and ETL processes. Skilled in diverse technologies, optimizing data architecture, and ensuring data quality. Proven in project delivery, cross-functional teamwork, and driving data-driven decisions. Seeking to enhance data infrastructure and uncover insights through innovative technologies
Position: Senior Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper


Experience in IT for over 30 years. Behind many projects using different technologies.
I would like to work in a team of professionals where everyone could develop as a specialist and help the company and a friend to achieve the set results.
I would not like to work in a company where young sprouts of innovation are buried under mountains of papers and reports.
Position: Senior Data Engineer
Category: SQL
Experience: 11 years | English: upper


Highly skilled data engineer with 11 years of hands on experience in DWH implementations on both SMP and MPP systems. Interested in high volume cloud projects, data integrations and sophisticated cloud implementations. 
Expert knowledge of MS SQL implementations and performance tuning;  highly skilled in Teradata with hands on experience with Exadata, Oracle, Postgres etc. Currently working with Postgres.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


I am a data engineer with almost 2 years of commercial experience in data engineering. I have solid data engineering expertise in different domains such as rental, sport, health care, and e-commerce. During my career, I worked on 1 training project and 3 commercial projects (one of them was an R&D one).

Training project - rental domain
Technologies: Scala, Python, Spark (Batch and Streaming), Kafka, Kafka Streams, Cassandra, Docker, Airflow, ELK stack.
Team: 1 lead engineer, 1 senior engineer, and 5 junior engineers (including me).
Project responsibilities: Implementation of big data solutions to optimize the work of the international service for the rental of electric scooters.
	Implemented scalable and high-performance pipelines for data visualization and assistance to enterprises in management
	Participated in each stage of project development and worked with all these technologies

R&D project - sport domain
Technologies: Scala, Java, Kafka Streams, Apache Druid, Debezium, Metabase.
Team: 1 lead engineer, 1 senior engineer, 1 back-end engineer, 1 data scientist, and 2 data engineers.
Project responsibilities: Working with a Ukraine-based team of data engineers, data scientists, and back-end developers to implement machine learning solutions in the sports betting system.
	Developed ETL pipelines
	Maintained integration with data sources, orchestrating jobs, testing code, and visualizing data
	Worked in teams with data scientists

Health-care domain
Technologies: Scala, Spark, Kafka, HDFS, Hive, Cloudera
Team: a big international team of data engineers, DBA, and others
Project responsibilities: 
	Developed ETL pipelines for customer subprojects
	Built CI/CD pipeline
	Tested code and troubleshoot different components
	Orchestrated jobs

E-commerce domain
Technologies: AWS (S3, Glue, EMR, DynamoDB), Python, Spark, Airflow, Snowflake
Team: 5 Data Engineers, DQA Engineer, BI Engineer
Project responsibilities: 
	Building Data Lake
	Communication with stakeholders 
	Building and orchestrating ETL pipelines
Position: Senior Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent


I am Harun Mbaabu Mwenda. I am a data engineer with 3+ years of experience designing, building, and maintaining large-scale data systems where I combine my knowledge of software development and data science to build data-driven products that can solve problems and derive insights from the customers and developers.

A considerable amount of my time is spent doing community work on things that I hope will help humanity in some way and my open-source work is supported by the community.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 9 years | English: upper


I have been working in IT for more than 9 years. My primary language is Java, but I also have good experience working with Scala and Python and know that languages at the intermediate level. During the first four years of my career, I worked as a software engineer where I worked in a large distributed team with big monolithic applications, developing REST API, and working a bit with UI technologies. Also, I act as a mentor for newcomers and do technical leadership for a small team of people. Then I switched to the data engineer role, where I have extensively worked on building data lakes from scratch, extending spark to accelerate its query execution with custom accelerators that were written in C++. That includes extending the spark catalyst rule-based engine and extending the tungsten code generator to generate C++ code and C++ code integration to the scala/java codebase. In data lakes, I mostly worked with batch-processing jobs based on the spark, but I also have a bit of experience working with stream-processing pipelines. In addition, worked a lot in spark job optimization.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 10 years | English: fluent


I’m a Data Engineer with 10+ years of experience in Data Warehousing and Analytics. I help companies to design and implement complex Data+BI solutions, maintain and improve existing platforms and assist on revealing the full potential of data.

The most vivid achievements so far:
• As a Senior Data Engineer/Architect at Arkadium, I helped to migrate the DWH with more than 10 TB of data and up to 50 pipelines from on-prem SQL-Server to the cloud Lakehouse Databricks. We have achieved 40% cost reduce on data processing while ingesting two times more data. 

• As a BI specialist at Huawei, I supported DWH and BI reports of complex billing system for mobile operators

I get excited about opportunities where I make data accessible and useful for decision makers and help companies to manage their data.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper

Designed a Delta Lake and all-around infrastructure that replaced an expensive Redis cluster.

Designed a scalable fault-tolerant Apache Flume setup and migrated it from Cloudera Manager to the AWS Kubernetes service.
Initiate performer with hands-on experience in developing large scalable big data pipelines using trend software and techniques. Strong AWS user and administrator.

Flexible to take the next responsibilities: QA, DevOps, BI, intern training, team lead substitution, etc

Worked on-site in Silicon Valley and several EU locations for months.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


- Knowledge of Hadoop ecosystem and different frameworks inside it – Hive, HDFS, YARN, MapReduce; - SQL-based technologies (e.g. MySQL/ PostgreSQL/MSSQL); - Assembling large, complex data sets that meet business requirements; - Developing ETL processes using Talend; - Troubleshooting performance issues. - Developing of DWBI solutions; - Developing SSIS ETL packages; - Building reports in SSRS, Tableau, PowerBI, TIBCO Spotfire; - Designing and developing of Data warehouse and Integration services; - Troubleshooting performance issues; - Developing of dimensions and cubes within the Analysis Services project; - Writing relational and multidimensional database queries; - Creating complex functions, scripts, stored procedures, and triggers to support application development; - Optimizing database systems for performance efficiency.
Want to work with new technologies. I don't like boring tasks and am ready to have challenges.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper

Took part in school Office and Programming competitions(regional). Participate in University programming competition.
Knowledge of Python, JavaScript, SQL, C, HTML5, CSS3, Oracle, Kivy.
I have learned programming languages in university disciplines such as WEB development, Object-oriented programming, Data Bases, Python.
Practical experience was gained in laboratory and course works.
Want to find friendly and experienced team.
Position: Senior Data Engineer
Category: Python
Experience: 10 years | English: intermediate

Most of my achievements are related to my experience because I don't know, where and when my work was easy.
Oracle and Snowflake master.
Machine Learning Padawan.

In more detail way:
- Developed some custom and generic pipelines on Airflow
- Developed bunch of custom operators, sensors and plugins for Airflow
- Developed application for webscrapping
- Developed application for comparison of customers based on similarity algorithms and ML models
- Developed ETL process and Star schema in Snowflake for application which is making decision based on execution of ML model
- Optimised a lot of Oracle sql-scripts and pipelines
- Developed several APEX applications
- Developed ETL pipelines for Oracle/Snowflake/Teradata using: Airflow, Azure(data factory, batch, storage accounts), Python, SQL
- Reports for BI Analytics based on Snowflake data, using Power BI and Metabase
Developing data pipelines (ETL/ELT) and data warehouses.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


- ORACLE - senior level - more than 10 years experience.
- Amazon REDSHIFT - senior level - 2 y experience
- POSTGRESQL - regular level - 1 year experience
- AWS Data Services (S3, Glue, RDS, Athena) - middle/junior level 
- Python - junior level
- JAVA - junior level 
- ADDITIONALLY have experience/familiar with Linux, shell scripting, ERWin, Power designer, Git, MS Project, Jira, Mantis, Airflow, Jenkins, 
------------
- PROJECT MANAGEMENT - work experience more than 4 years, experience in full cycle of software development and delivery, experience in managing a development team (10-15 people)
---------------------------------------------------------------------
2020-2022 - Senior Data Engineer (AWS)
2019-2020  - IT manager\ Project manager
2018-2019  - PostrgeSQL  developer/ junior Java developer  
2015-2018  - "Luxoft", senior Oracle developer \ teamlead
2014-2015  - "DAXX", senior Oracle developer
2010-2013  - "Юнитех+", Software Architect \ Project manager
2004-2010  - "Юнитех+" , senior Oracle developer
2001-2004  - "Укрзалізниця", Delphi developer, Orace developer
Position: Senior Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate

• Developing and supporting REST API
• Optimization and refactoring of code to improve performance and lead to uniform style
•  Changing the structure of the database
• Creating reports on the work done and monitoring the timely updating of product documentation
• Conducting staff training, documentation maintenance
Project within treat intelligence portfolio, we as a core of operation team provide the following services:
 - DBA administration:
 - Maintains and support the monitoring
 - Maintains and support the infrastructure 
 - Manage user management in AWS
US company
Project Role
Senior Data Engineer, DevOPS
Responsibilities
    • Help DevOps team to improve the SQL request
    • Help to design the MySQL DBA
    • Analyzing of the database structure, making recommendations on changing the structure
    • Add new or update JIRA projects, issue types, screens, fields, schemes
    • Update workflows
    • Create, update, delete users and roles, setting project permission
    • Write Python scripts for behavior
    • Create notification
Tools & Technologies
MySQL, JIRA, Webex, Confluence, AWS, Prometheus, Grafana
2)DB Optimization
The project required performance audit after migration from other database to MariaDB and validation migration correctness
US company
Responsibilities
    • Analyze queries, identify slow queries, optimize queries
    • Analyze indexes, collations, engines, configuration files, general parameters and optimize
    • Provide report of redundancies in DB schema, compare different schemes, validate migration correctness
    •  Created auto tests for slow queries
    • Estimation, prioritization, and distribution of tasks
    • Create pipeline
    • Analyzing of the database structure, making recommendations on changing the structure
Tools & Technologies
Linux; Windows PowerShell; Ubuntu; MySQL; Python, Apache Airflow
Percona (pt-duplicate-key-checker, pt-query-digest, sysbench), vSphere; pfSense, Webex, TargetProcess (for reporting tasks); Scrum
3) Software and hardware system to introduce a new generation of medical infusion devices
The project required database analysis for schema separation into smaller databases for use with microservices as well as creating those smaller databases along with their builder code (C# .Net)
US company
Responsibilities
    • Database analysis and mapping
    • Requirement’s analysis and clarification
    • Architecture and design of new database tables and recreation of the previously
I prefer a long-term contract, I like to work with a product company.

Ready to relocate to another country