lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


Develop data architecture development roadmap in a fast paced industry.
 Give technical support regarding data readiness and availability.
 Develop, design, and schedule data pipeline for new service.
 Monitor and maintain running data pipelines cloud server for services.
 Support and maintain data warehouses
 Develop and design BI reports including executive reports and detail reports.
 Improve data pipeline performance run time by: - migrating old data pipeline into modern data pipeline,
- optimize pipeline schedule, - optimize query.
Tech stack: SQL, Python, Apache Airflow, pandas, dbt, AWS RDS, AWS redshift, AWS S3, AWS Quicksight, Google Cloud Platform, Google Cloud Storage, Google Data Studio, Microsoft powerBI
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent

3 years of Data Engineering/Data Analytics/BI Engineering experience. Worked with financial, marketing, user data. Have freelance experience. 
Certificates: AWS CCP, SnowPro Core.
Currently studying for Masters degree in Data Science in Hungary ELTE/Sweden KTH.
Bachelor's degree in Data Science, Ukraine KPI.
First place in 2017 and 2018 at the all-Ukrainian competition of research works among high school students in the field of Math.
Developed Data Audit and Reconciliation framework for BlackRock Enterprise Data Platform. Tech stack: Python, Airflow, Snowflake, dbt, Great Expectations, S3. Implemented a diverse range of data quality checks, worked on financial data processing orchestration.
Developed BI applications for website and mobile app marketing and user flow analysis. Tech stack: MySQL, Postgresql, BigQuery, Python, Tableau, Google Sheets. Analyzed A/B-test results using bayesian statistics - implemented internal platform to track experiments' flows using Plotly Dash. Integration with third-party APIs such as Google Ads, Facebook, Pinterest etc.
Designed and implemented a BI application for YouTube channel performance analysis. Chosen data pipeline tech stack: BigQuery, Google Cloud Storage, Google Cloud Functions, Data Studio, Python, YouTube Data and Reporting API.
Developed BI applications for mobile game marketing and user flow analysis using BigQuery, R (tidyverse + ggplot2), Google Sheets API, Google Data Studio. Integration with third-party APIs such as Facebook, IronSource, AppsFlyer.
Interested in the Data Engineering position in first place. AWS, Python stack is a priority. Eager to work with new technologies and tools., such as Spark and Databricks
Highly interested in working flexible or late hours due to Master's studies.
Position: Data Engineer
Category: Data Engineer
Experience: 9 years | English: upper

Latest: personally implemented Airflow + Azure Kubernetes(docker+helm) + Github Actions as a standard for basic data engineering
Developed databases from scratch based on different data models
Performance optimization and tuning
ETL/ELT in db, based on Python services or using tools like Airflow, Data factory and dbt
Deployment via Github Actions + Terraform
Kubernetes - maintaining Airflow instances
Some team lead/manager activities in last 4 years - talking to different departments, discussing solutions, providing new tools and platform for data engineering and analytics. Team of 4 + 1 data engineers.
I would like to step back from devops activities and focus more on development and management
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: intermediate


Developed reports for controlling and analyzing
company workflow (SQL scripts + PL/SQL
procedures and functions + Excel automated
via VBA scripts)
Designed ETL processes for collecting and
summarizing data from different sources
Developed cross-validation processes for
international data reports
Develop processes and criteria for analyzing and summarizing data
Interpret data, analyze results using statistical techniques and provide ongoing 
reports
Filter and “clean” data by reviewing computer reports, printouts, and performance 
indicators to locate and correct code problems
Position: Data Engineer
Category: SQL
Experience: 4 years | English: upper

- developed several complex ETL pipelines, ETL plans, real-time processing
- monitoring and supporting up to 80 developed ETL processes  
- SQL optimization
- preparation and development of BI dashboards
- implementation of fixes in the existing dashboard
- data preparation
- quickly learn/use new technologies
- etc
Developing and supporting ETL processes (real-time and scheduled processes).
MSSQL/PostgreSQL/Azure SQL/Presto/Spark querying (DDL, DML, stored procedures, etc), data preparation.
Currently working with salesforce, extracting/updating objects. Creating pipelines to transfer data from/to hive, Snowflake, Postgres, etc.
Interested in new opportunities (full-time/part-time).
Position: Data Engineer
Category: SQL
Experience: 8 years | English: upper


- developing PL/SQL procedures, DWH, tuning SQL;
- providing information for solving marketing and technical cases;
- analyzing and converting business problems into technical requirements;
- creating  reporting system as DB and PL/SQL developer;
- data visualization (Power BI)
- creating tools with alert option for monitoring and tracking data integrity in DB (PL/SQL)
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: intermediate


Development and automation of business
processes;
Creating of push messages;
Analysis of CRM campaigns;
Creating and updating procedure, view;
Automation of reporting;
MS SQL, Oracle
Python(Basic level)
Excel
Json
Jira
Git
Airflow (jobs)
Position: Data Engineer
Category: Python
Experience: 3 years | English: upper


Diverse project contributions, both small and large scale, along with continuous skill development through personal projects.

Most recent project was the development of a reporting automation app for my company. The app is fully automated and built on top of the Google Cloud Platform, leveraging its serverless capabilities to ensure scalability and meet the demands of a growing number of accounts. I was a key member of a small development team, collaborating closely with two other individuals to bring this project to fruition.

In addition to my previous experience, I am currently involved in a cutting-edge project that involves creating a suite of technology solutions powered by a proprietary Marketing Intelligence Engine. This project is designed to enhance decision-making processes within key areas of digital marketing strategy, bringing greater efficiency and effectiveness to marketing efforts.
Position: Data Engineer
Category: Data Engineer
Experience: 7 years | English: fluent

Implemented a version of StyleGAN encoder
, built a Data Studio connector
, competed at Kaggle
, go crazy about dev productivity - have 51 Github gists (and counting), version-controlled VS Code snippets, half a dosen self-built utilities and paid subscriptions to multiple AI-based dev tools
, been developing physics engines - state-of-the-art one at work, and an ordinary one for fun, as a hobby.

Didn't save a forest, didn't sell a company, but well, that's something too.
Doing data engineering in one form or another since 2016. Mostly with Python and AWS, but also worth noting that at different times with - DataHub, Gruntwork, Apache Superset, Thrift, Quantopian.

Work best if trusted with team-level objectives.
Looking for an opportunity to spearhead a data initiative for a company of "Series B size" or bigger
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate

•	SSIS
•	Talend ETL
•	SAP BODS 
•	Oracle ODI / OBI	•	SAP BO   
•	Power BI
•	Qlik View/Sense
•	SSRS
DWH & BI Unit Manager – PayCore Payment Systems - Jun 2021 –  Working
-	Designed, DWH architecture of Payment Management Systems, Mastercard systems and many related systems.
-	Uses SSIS, Talend Open Studio, SAP BO/BI, Power BI
-	Managed an agile team.
Senior Solution Architect – MDS ap Turkey(Midis Group Inc.) - Feb 2019 – May 2021
-	Adaptation of ETL and Business Intelligence projects.
-	ETL/BI project in Türkiye Insurance Inc. 
-	Consolidation project for TWF(Turkish Wealth Fund). 
-	ETL Development project for Rotana Dubai.

Founder - Fox Analytics – Jun 2019 
-	Developed ETL processes and BI Reports any tools
-	Served consultancy solutions and project management

Enterprise Applications Manager – NETAS Telecommunication Inc. - May 2015 –  Jan 2019
-	DWH: Project management for the creation of company DWH in SAP BODS and Oracle.
-	Responsible for SAP BI, Power BI: Created structures in accordance with DB and DWH, developed BI dashboard. 
-	Managed SAP R/3 and Oracle E-BS HR: Team management supporting Logistics, Finance and HR units, managment of consulting firms.
-	Led a team in Salesforce CRM: Management of the team that develops and supports internal and external applications.

Senior Software Developer - Yataş Inc. - Agu 2011 – May 2015
-	Java ADF Developer; developed Store applications with Java within the scope of Mobile Field Sales Applications project
-	Oracle E-BS Developer; developed Oracle Forms, OAF, PL / SQL, Workflow, Discoverer, XML Publisher.
-	After the R12 transition was completed, developed warehouse and shop handheld terminal applications. Made improvements within the scope of Production, Sales, Purchasing, Shipping, Warehouse process improvement projects.
-	As part of Oracle R12 Project, responsible for additional enhancements, personalized and report enhancements in the production and logistics modules.  Re-coded the applications used in the current E-BS 11.5.9 in R12.

IT Project Manager – Tırsan Logistics Inc. - Nov 2009 - Agu 2011.
-	Developed software used by the Shipping, Warehouse, Accounting, Sales and HR unit, project management, process analysis and accounting unit.
-	Executed improvements in logistics operations and oversaw management of projects that were developed according to customer demand. 
-	Headed the team that develops software with .Net, Java and Oracle
-	Met new customer / project automation / integration needs in shipping and warehouse units, coordinated the project at the stage of developing B2B applications
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


DWH developer:
- Python (ETL) / Pandas / Streamlit / SQLalchemy
- Dagster
- FastAPI
- PostgreSQL 
- MSSQL 
- Pentaho 
- GIT / Linux / PGAdmin

Integration engineer (health care):
- PostgreSQL
- HL7, PDF, CSV integrations 
- REST API
- CSV, JSON
- Scrum
- Docker / Elastic / Jira
- Monitor issues and troubleshooting

Technical support (fintech):
- PostgreSQL
- Redmine 
- ElasticSearch
- Logs analysis, troubleshooting

Claims agent (aviation):
Started from customer specialist, was promoted to team manager after almost a year of work. Had an own team in the subordination, so as well was responsible for compliance with the following duties:
- cooperation with foreign colleagues from other countries (calls, emails, Skype meetings, Slack communication);
- increase productivity and quality results of my team;
- productivity reporting for management;
- creating tasks for each day.
Interesting in professional growth, learn new technologies.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


- Enhanced the team's performance by 85% by accelerating data processing speed and generating trends from diverse sources using Snowflake and Databricks.
- Created executive and operational dashboards using Tableau, Databricks and Snowflake.
- Identifying customer requirements, discussing details, and creating a step-by-step plan for problem-solving
- Created TensorFlow-based Machine Learning models (Linear Regression, Random Forest) for the prediction of data fluctuations, encompassing drops and spikes.
- Performed data analysis by using Pandas and NumPy libraries in Python, provide strategic insights based on the existing data metrics.
- Skilled at crafting intricate SQL queries and procedures to retrieve, manipulate, and update extensive datasets proficiently.
- Supervised data quality audits on processed data. Provided mentorship and guidance to junior data engineers.
- Created and updated numerous technical documents
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


EPAM 
2022 June - now
Maintain ETL processes written mainly in Python. Monitor airflow dags. Develop data pipelines in Databricks ingesting from different sources into S3.   

Ru-Center Group 
2021 Oct - 2022 May
ETL development in Python, Spark, Airflow. Maintaining datalake in Hadoop.

BI Innovations
2021 June - 2021 Sep
Work in the customer analytics department. Developed ETL processes using Talend, Python, SQL Server. Responsible for data cleansing.

Geometry
2020 Feb - 2021 May
Collection and processing of data:
    - site parsing (Beautiful Soap, Selenium, UiPath)
    - extracting data from REST Api
    - work with databases (MSSQL, PostgreSQL, MongoDB)

    Skills:
    - Python (pandas, numpy, multiprocessing)
    - SQL (stored procedures, transactions, triggers)
    - Apache Airflow for orchestrating and running tasks daily
    - Power BI
    - RPA (UiPath)
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent

Always work efficiently and carefully, responsible, good team player, quick learner.

Achievements:
Migrated 100+ ETLs from variety of legacy platforms;
Implemented automated file comparison service;
Helped with QA of new platform features;
Implemented configuration of CCPA compliant privacy policy and alerting service.
ETL/ELT processes development (SQL, PySpark);
Work with Databricks, Snowflake, Teradata, SAP DS, GoAnywhere, Talend, Streamsets platfoms;
Work with Gitlab, Rundeck, Airflow, Kafka tools;
Delta Lake data processing;
ETL processes optimization;
Big data tools application.
Position: Data Engineer
Category: Python
Experience: 4 years | English: upper

I became a team lead in small but productive team
Participated in the Django Girls as a lecturer
Contribute to Apache Airflow
Expereance with async server side tecnologes like Tornado,  familiar with ClickHouse + SQLalchemy 
Strong knowledge of Python3, expereance with FastAPI, flask, Aiohttp, Tornado
Experience with building ETL pipelines with schedulers like Airflow.
Unix system administration skills, 
Cloud platforms: AWS, GCP
familar with Vagrant, Docker, Terraform, Ansible
 Redis, Celery, 

Basic knowledge of Java/Scala
Working on interesting, LONG-TERM and FOREIGN project in friendly remote team with new technologies , resolving difficult tasks.

I do not consider fullstack positions!
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


EXPERIENCE

10+ years of outsource experience in software development (including Telecommunication, Regulatory Reporting Projects, Reference Data Services)
15+ years experience in the IT industry
Maintenance and implementation of ETL processes (data extraction, transformation, loading, cleaning, and validation) for data migration and loading large data sets within Transactional Data Warehouse.
Technical Lead / Developer with experience and knowledge in all stages of project life cycle.
Technical Leadership of delivery group (up to 12 FTE). 
Strong communication skills, experience working with USA, UK and Asian customers and multi-vendors interactions.

TECHNICAL SKILLS
RDBMS: Oracle 10g/11g/12g/19c/Exadata, SAP Sybase, MS SQL;
ETL Tools: Informatica (PowerCenter 8.6.1/9.1.0/10.1.0);
Data Modeling: ErWin, Rational rose, BpWin;
Languages/Utilities: SQL, PL/SQL, Java SE, Shell script, Python, JavaScript, C++, C#, Pascal , Batch, XML/XSLT/XSD/Xpath;
Issues tracking: Jira, ALM;
Version control system: SVN, GIT, Rational Clear Case Explorer;
Continuous integration: TeamCity/Jenkins;
Database Tools :  PL/SQL Developer, SQL*Plus, SQL*Loader, SQL Developer;
BI Tool: Oracle Business Intelligence Discoverer
Other Tools: Control-M, Hadoop, dBusJMS, IBM MQ, Altova XMLSpy, Confluence, Informatica Data Validation Option (DVO).

PERSONAL QUALITIES

Responsible, detail oriented and results driven, good organizational skills, open to new ideas/opportunities, capable of focusing and working under pressure,  critical thinking skills, creative, honest, with a good sense of humor, positive team player.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

Made fully-automated ETL process for small company.
Have certificate "Python" from coursera.org
Have certificate "Data Engineer" from robot-dreams.cc
Experience (4.5 years):

- "Amanat Insurance" (2021 feb - 2022 feb)(1 year) :

Data Enginner(1 year): 
Build DWH (PostgreSQL) from the beginning and automated ETL processess (Talend). Also, I had work with GITLab for the first time. All CI/CD and ETL/ELT orchestrated by Airflow. In the end, made views on SQL for DA team.
Instruments: Python, PostgreSQL, Talend,  Airflow, Git
Team: 2 members

- "DAR ecosystem" (2017 oct - 2021 feb)(3.5 years):
Data Engineer (2 years): 
Made ETL/ELT processess on Pentaho for structured instances. And used Python for non-structured databases. Had great experience in integration with GA, YM, FA by rest API. Worked in different projects and different spheres 
Instruments: Python, PostgreSQL, Pentaho, Postman
Team: 4 members
 
Data Analytics (1.5 years):
In the first part of my career, I made visualisations in Power BI and wrote SQL quieries for table aggregation. I was part of reporting team.
Instruments: Power BI, PostgreSQ, Pentaho, Excel
Team: 5 members

Now, I want to work as Data Engineer
Today,progress in IT sphere is rapidly developing, So I want to learn new technologies (Docker, Cloud Databases, Apache Spark) and gain experience from foreign companies to be strong competetive person.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper


Experienced Data Engineer(5+ years)
Have a solid understanding of classic DWH and Data Lake architectures, ETL&ELT solution design. Communicative team player, with strong analytical skills. Still young and proactive. 
Upper-intermediate+ English.

Experience:
- Scala, Python.
- Implementation of classic ETL workflows (SSIS, DataStage, Talend, etc.).
- Building real-time high-load Big Data pipelines (Spark Streaming)
- Collecting and parsing data from different sources (DB, Parquet, JSON, CSV, EDI X12, API endpoints).
- Processing of large amounts of data, and performance optimizations.
- Building a cloud data platform from scratch (AWS, Azure).
- Working with a wide type of data storages (Hive, Data Lake, Relational database, DWH, Kafka, Elastic). 
- DataOps stuff. 
- Data validation and tests.
Not interested in big old projects with thousands of unnecessary meetings. The product should be interesting and useful for humanity. I don't want to be a part of a project where the main idea is to get money from customers.
No russian co-workers, projects, or targeting russian markets.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


Experienced Data Engineer. AWS Certifications, Python/Scala and SQL/NoSQL databases experience.

Located in Ukraine.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent


Experienced Data Engineer with a demonstrated history of working in the computer software industry. Skilled in SQL, Python, data transformation cycle (ETL/ELT), and data warehousing. Self-paced, proactive, and result-oriented person who can work independently with a high sense of ownership.
Below please find a list of my experience in key technologies:


Programming Languages:

- Python - 5 years. Object-Oriented, functional programming, developing ETL/ELT solutions;
- SQL - 5 years. Working with transactional (MySQL, PostgreSQL) and analytical (BigQuery, Redshift) databases. Skilled in query performance optimisation (both on time and memory);


Clouds:

- GCP - 3 years. Working mostly with BigQuery, Cloud Functions, Cloud Compute, Cloud Composer, Cloud Scheduler, Cloud Storage. Have solid experience working with GCP API, optimising data warehouse / storage, as well as IAM management;
- AWS - 2 years. Worked with Redshift, Aurora, EC2, Athena, Lambda. Experienced in dwh modelling and optimization;


Orchestration:

- Apache Airflow - 3 years. Experienced in building the tool from scratch, as well as in complete management of executors, dags and other key features;


DE Fundamentals

- Data Warehousing: Experienced in Design, Implementation,
Optimisation of differently structured warehouses (Normalized/Denormalized, using Inman/Kimball approaches).
- Data Quality Assurance: Implementing processes and checks to ensure the accuracy, completeness, and reliability of the data. This can include data validation, outlier detection, duplicate removal, and data profiling techniques.
- Data Governance: Establishing policies and procedures for data management, including data privacy, security, and compliance.
- Documentation and Collaboration: Documenting the data engineering processes, workflows, and system architectures to facilitate collaboration among data engineering teams and other stakeholders.

List of recent job experiences:

- Senior Data Engineer in FinOps Startup
- Senior Data Engineer in hardware Startup
- Data Engineer in big e-commerce corporation
Flexible schedule, possibility to work from home and passionate team.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent

- Improved company’s evaluation significantly by building a client facing reporting dashboard that process more than 2GB of log data daily that helps the company standout from competitors as data driven adtech business.
- Prevent a historical data loss from a third-part platform by ingesting an API call on a daily basis which then partition and load the data to an S3 data lake in parquet format.
Experienced in building and managing high-performance big data pipelines to enrich data for analytics, ML and AI, delivering analytics solutions using BI tools such as Power BI, Tableau and superset, designing and implementing efficient data infrastructure to organize and refine data.

I am currently working as a data engineer. My role involves building data pipelines, developing campaign performance reports that meets client’s requirement, onboarding and coordinating junior data engineers.
- Improved company’s evaluation significantly by building a client facing reporting dashboard that process more than 2GB of log data daily that helps the company standout from competitors as data driven adtech business - providing real time, mission critical, performance boosting, and quality controlling insights and intelligence to clients. It has three microservices, among which two are containerized in docker: React app with ApexCharts, Flask API and ETL pipeline.
- Prevent a historical data loss from a third-part platform by ingesting an API call on a daily basis which then partition and load the data to an S3 data lake in parquet format.
- Diminish the time it take to get a report for campaign managers to almost zero by orchestrating a google sheet report generator python script with AWS Athena and Glue.
- Reduced development time by 10 hrs to develop flask authentication module for all data team by building authenticator package that can be easily used as a decorator.
- Avert incorrect reporting flow that would drive away clients by exploring the data and identifying the cause of a discrepancy.

I am keen to utilize my skills to create data solutions with a heavy emphasis on great user experience and looking to further improve my skills in big data engineering.