lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: SQL
Experience: 1 years | English: intermediate

SoftServe IT Academy 

Responsibilities: Relational, Staging, DWH design;
Creating stored procedures, views, functions;

Tools & Technologies: T-SQL, MS SQL Server, Jira, Confluence.
Experienced in:
Creating stored procedures, views, and functions;
Visual Studio SQL project
Position: Data Engineer
Category: Data Analyst
Experience: 3 years | English: fluent

AWS Certified Solutions Architect
Experienced python engineer with expertise in developing data pipelines, ETL processes, and data warehousing solutions. Skilled in Python, SQL, and cloud-based technologies such as AWS. Passionate about turning complex data into valuable insights that drive business growth. Looking forward for interesting collaborations.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Experienced, result-oriented, resourceful and problem-solving Data engineer with business management skills.
Adapt and met challenges of release dates. Over 3 years of diverse experience in Data engineering fields,includes development and implementation of various applications in data processing environments.
Willing to provide systematic solutions to complex challenges in competitive environments. Ability to create automated data management systems for recursive data processing operations.
Working with:
- New technologies - especially Cloud Based technologies.
- Large datasets
- International team 
- Develop ETLs from Flat files, RDBs, online spreadsheets, online applications, API endpoinds (POS systems), cloud storage systems. 
- Interested in IOT systems, real time data processing
Position: Data Engineer
Category: SQL
Experience: 11 years | English: fluent


Experienced Senior Engineer with a demonstrated history of working in the broadcast media and financial industry. Skilled in Automation, NoSQL Technologies and Cloud Platforms.

* Full support for NoSQL databases (Cassandra, Mongo, Couchbase) and Analytics platform (Apache Spark) inside the department:
** Creating scripts for automating installation and support:
*** Ansible 
*** Puppet 
*** VMware 
*** AWS 
*** OpenStack 
*** GCE 
*** GKE 
** Creating guidelines for implementing monitoring for this platforms: 
*** Graphite 
*** Prometheus 
*** ELK 
** Creating support documents 
** Creating docker images and documentation for its use with orchestration technologies: 
*** Kubernetes 
*** Swarm 
*** Mesosphere 
** 3rd level support for this platforms 
** Data modelling and tuning

Technologies: Cassandra, Couchbase, Mongo, Apache SPark, ELK, Ansible, Puppet, Python, Bash, AWS, VMware, OpenStack, GCE, GKE, Kubernetes, Swarm, Mesosphere, Graphite, Prometheus, Nagios)
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Experienced Software Data Engineer with machine learning skills. Skilled in development, building and maintaining ETL pipelines using Python, designing data architecture, and SQL performance tuning. Also, I am engaged in developing pet projects which can be found on my GitHub, as well as studying new technologies and ML for NLP tasks.

Experiences:
– Development of data acquisition pipelines for retrieving data from source systems and development of data transformation pipelines using Databricks with defined Lakehouse architecture
– Report performance optimization: query optimization, data migration, incremental update configuration 
– R&D: Trend analyzing system, Interactive map of the full-scale invasion 
– Development of data infrastructure (data migration to Synapse, defining data model) and ETL pipelines for the retail clients
– Data analysis and demand forecasting functionality for retail clients 
– Development of a custom instrument for monitoring Azure resources using a microservices architecture with Python Azure Function for custom monitoring of Azure resources

Skills: 
Azure (Databricks, ADLS, Data Factory, Functions, Log Analytics, Key Vault, Synapse Analytics, ML Service)
Python, Apache Spark (PySpark, Scala)
SQL (creating and performance tuning of SQL queries, views, stored procedures, and functions) 
Machine learning (developing time series forecasting models, NLP)
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


Experienced Software Engineer with a demonstrated history of working in the computer software industry. Skilled in Python, Data Engineering, Web-technologies and Databases. Got a Master of computer science degree at the Computer science field.
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper

Programming Languages/Technologies
SQL/T-SQL

RDBMS 
MS SQL Server

Development Tools 
SQL Server Management Studio
MS Visual Studio
PowerBI
Tableau

Methodologies
Agile, Scrum
Certified Student of Management School

Language 
English C1

Frameworks/Libraries/Tools
SQL Server Data Tools for Visual Studio
SSIS

Version Control
Git/Github

Tracking
Jira
Confluence

Operating Systems
Microsoft Windows
Experienced Tableau Report Developer and highly qualified Data Engineer with 1+ year of experience. I am thrilled about data science and making it more visual and interesting. 
I participated in designing and maintaining OLTP Database as well as OLAP Database using MS SQL Server, SSIS and data visualization tools such as Tableau and PowerBI. I have mainly worked on writing SQL queries, store procedures and creating SSIS packages. 
I have experience in Tableau and PowerBI Report Developing.
I would like to concentrate on data reporting but I am also interested in learning new technologies and evolving.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

- Build event-driven pipeline for data collection from the social media platform
- Build ML pipeline for ranging videos for posting
- Developed ETL pipeline from scratch (using Airflow and Docker) so it got much better in terms of monitoring, configuration, and execution time 
- Refactored dashboards from static to more interactive and informative.
- Built a notification system about changes in business processes, so it became possible to do process analytics by analyzing logs from this system (eg. reporting based on log files)
- Detected fraud (which wasn't detected by ML) based on basic descriptive analytics and saved the company's money
Experience in:
- Building dashboards (Tableau/Data Studio)
- Building ETL pipelines (Airflow\Docker)
- Data modeling/DWH
- A/B tests analysis
- Using statistical and ML techniques to solve business problems
- Project management

Interested in further developing in:
- Programming
- Statistics/Data Mining/ML
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: intermediate

Completed courses: Functional Program Design in Scala, Functional Programming Principles in Scala, Parallel Programming in Scala, Big Data Analysis with Scala and Spark, Apache Airflow: The Hands-on Guide.
Experience in creating Big Data applications and ETL pipelines.
CI/CD software.
Experience in working with Data Warehouses, like Snowflake.
Experience in working with Cloud Providers, like AWS.
Familiarity with Data Lakes technologies, like Delta Lake.
Experience in Python - 1.5 years.
Looking for interesting job in a friendly team, where I can combine and apply my skills, energy and knowledge in order to be productive and useful for a company and also grow as a professional.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: fluent


Experience in database development, data engineering. Throughout my career, I have successfully executed the complete Data Warehouse Lifecycle, encompassing essential aspects like data modelling, performance tuning, ETL architecture. Over the past five years, I have expanded my knowledge and proficiency in software engineering and database services in a cloud platform, further enhancing my ability to contribute to diverse projects.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: pre


• Experience in migration to new DataPlatform (S3, MinIO, Apache Hive, Apache Spark)
• Development of ETL\ELT: Airflow, dbt (Data Build Tool), MS SSIS;
• Work with databases: MS SQL, PostgreSQL, ClickHouse, Hive, Trino;
• Some experience with Apache Kafka;
• Experience developing on Python;
• Development and support web service for internal clients (Django Framework);
• Experience using bash scripting;
• CI/CD tools: TeamCity, GitLab CI/CD
• Experience with Kubernetes, Docker, Grafana, Greylog, OkMeter, Apache Superset;
• Experience with Git, GitLab, TFS;
• Troubleshooting, problem solving.
Need to further develop as a Data Engineer with Python used in a modern team with advanced skills and technologies
Position: Data Engineer
Category: Data Science
Experience: 10 years | English: upper

Hi,
I'm working currently at a big IT Company as a data analyst more than one year in Kyiv and I'm interesting in developing myself in Data Science. Unfortunately, there are not projects in my Company where I can improve my skills as a Data Scientist. So, I'm interesting in your suggestions.
Experience in processing and analyzing large amounts of data with Python;
Awareness of Agile;
Upper English language skills;
BS in Computer Science;
Experience more than 1 year in IT Company as a data analyst (data engineer) and 7 years in analytics, risk-management analytics at big industrial companies
I would like to improve my skills in Data Science
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: fluent

Successful projects and leadership roles in both large international customers and product companies;
Driving data architecture and performance optimization;
Driving complex data ingestion and streaming pipelines;
Successful ML models training, delivery and serving in production;
Significant cloud costs optimization;
Expert Data & Machine Learning Engineer

My overall experience can be described but not limited to:
* 5+ years data engineering (ETL, DWH, Big Data)
* 5+ years data science and machine learning
* 4+ years with cloud computing and Big Data technologies
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: intermediate


Focused Data Engineer dedicated to staying apprised of all new engineering tools and techniques. Committed to applying emerging technologies to streamline product development and business operations. Adheres to ascribed business and engineering goals by driving constant analytical skills, process innovation and iterative improvements.

Current position:
Data Engineer at Epam Systems, RMG Event Base Billing Project
Participation in development of  big data integration application based on GCP and Airflow for business users and benefit is the ability to surcharge their customers manually and automatically for infractions.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: intermediate


For the last three years I have been working with BigData. This is a huge high-load project on Google BigQuery. The work takes place both in BigQuery UI itself and in two other related projects in Python and NodeJS. Before that, there were 6 years of development in PHP. Before this, 4 years of developing software applications in C++ and C#. I am also involved in scientific activities and have published on arxiv.org.

At current place of work:
 - working with a Google BigQuery columnar database - creating and optimization of queries, views, functions; creation of ML models; architecture optimization;
 - working with a Python project interacting with BiqQuery;
 - working with a NodeJS project interacting with BigQuery;
 - working with the Adverity data intake platform;
 - working with Google Apps Scripts;
 - data analysis in Google Data Studio and JupyterLab.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


For the last year I have:
- Created an ETL process for Marketing Data from different source systems;
- Created Grafana Dashboards for further Data Analysis;
- Created Airflow pipelines;
- Created SQL scripts for cleaning and transforming data for PostgreSQL and Amazon Redshift;
- Created pages for table data using Paper Dashboard;
- Analyzed and visualized data;
- Worked with Google Cloud Platform for ETL process and app deployment;
From the new work, I expect, first of all, the opportunity to develop in technology, an interesting project, and a friendly, experienced team.
Position: Data Engineer
Category: Python
Experience: 2.5 years | English: intermediate


Freelance 2018-08-01 - 2021-08-30
Python and Web-developer
On freelancing, I took orders for front-end development (HTML/CSS/JS), the development of telegram bots (Python/PyTelegramBotAPI) and web-sites (Flask/Django).

Alnicko 2021-08-30 - 2022-05-21
Python Developer
I am writing an interface (PyQt5) and a backend part(Python, Mosquito, InfluxDB, SQLite, Flask API, etc..) for electronic devices, deploying them on boards (Raspberry PI, Docker, Bash). I also write unit tests for all of this.

Epam 2022-05-21 - now
Data Engineer (Python)
As a data engineer I am working on developing pipeline (ADF) and notebooks (Databricks/Spark), performance optimization and investigating new development approaches.

Mate Academy 2023-01-27 - now
Mentor (Python)
As a mentor I am helping students with questions regarding tasks on Python, checking homeworks and conducting teck-check (test interviews) for them.
I would like to get into a company with a good, friendly and responsive team, which gives you the opportunity to "grow" and develop in your favorite business.
Position: Data Engineer
Category: Python
Experience: 0.5 years | English: fluent


From my perspective, I have had a valuable experience in the field of big data and data analysis. Throughout my career, I have had the opportunity to work on a variety of projects that have honed my skills in data modelling, data visualization, and data cleansing. I have also gained experience with several programming languages such as Python, SQL, and Java.

However, my primary interest lies in the field of machine learning, which I am eager to explore further. I have had the opportunity to work with machine learning algorithms, particularly in natural language processing. I have applied machine learning techniques to practical problems such as sentiment analysis and topic modelling.
As I am finishing my Bachelor's degree in the Artificial Intelligence department, I am excited to continue developing my skills in machine learning. I believe that this field has tremendous potential to make a positive impact on society, and I am passionate about contributing to it.

Overall, my experience in big data and data analysis has provided me with a strong foundation for pursuing a career in machine learning. I am enthusiastic about exploring the possibilities of this field and applying my skills and knowledge to solving real-world problems.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper

Databricks Lakehouse Fundamentals Accreditation (February 2023);
Neo4j Certified Professional (January 2022);
dbt Learn badge: dbt Fundamentals (January 2022);
Confluent Fundamentals Accreditation for Apache Kafka (October 2021);
Astronomer certifications for Apache Airflow: Fundamentals, DAG Authoring (August 2021);
Snowflake badges: Data Warehouse, Data sharing, Data applications (August 2021);
Redis Certified Developer (July 2021);

Co-founder and lecturer of the NGO “GenomicsUA”. 
Contributor to many open-source projects such as Apache Airflow;
Ukrainian translator for Scala and Python documentation;
Lecturer at Kyiv Data Science Club;
Full-time: python developer / data engineer in GlobalLogic: Jul 2022 - Apr 2023;
Project: Division of a cybersecurity company focused on machine learning, large-scale scientific computing architecture, and information visualization. 
Tasks: Internal framework development for Big Data transformations, data ingestion, query optimization, and data pipelines management;
Stack: AWS (S3, Lambda, MWAA, EMR), Snowflake, Python, GitHub Actions;

Full-time: data analyst / data engineer in TEAM International Services: Aug 2021 - Jul 2022;
Project: Account-based marketing, advertising, sales intelligence, and data company.
Tasks: Web crawling, stream processing,  query optimization, optimization of legacy data pipelines;
Stack: GCP (BigQuery, DataStudio, Cloud Storage, Composer, Dataproc, PubSub), AWS (S3, EMR, RDS), Astronomer, Apache Spark (Scala), GitLab CI/CD, Grafana;

Full-time: data analyst in National Health Service of Ukraine: Nov 2019 - Jul 2021;
Project: NHSU is the central executive body that implements the state policy regarding state financial guarantees for healthcare servicing.
Tasks: medical data analysis and visualization, report generation and sending, disease spread modeling, automatic monitoring, fraud detection;
Stack: CentOS, Python, PostgreSQL, Microsoft PowerBI, TeamCity, Gitlab;

Full-time: family doctor: Aug 2015 - Nov 2019;
Interested in healthcare data analysis, bioinformatics and data engineering.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

Achieved:
* built various data services/integrations from scratch and reached desired reliable performance rate;
* improved various existing solutions with cost, resource consumption optimization in mind. In several cases reached 5 figures worth of optimization effect;
* set up several knowledge sharing team activities, which lead to positive impact on team performance, new tech/approaches adoption rate;
* successfully launched 4 Python- and data- related courses. Reached 75-95% student participation rate and high GPA according to university-standardized measurement tool.
Gained experience:
- built and maintained various data services/integrations using python 3 stack, dagster orchestrator, dbt and postgres/redshift DBs;
- maintained code quality with unittests (pytest), loadtests (via locust), black, ruff and related.
- set up and maintained data quality with great expectations / dbt tests;
- wrote and maintained easy understandable documentation;
- created data acquiring utilities for non-api sources using Scrapy, Selenium;
- created data visualizations using scikit, matplotlib-related, Altair-related, Jupyter Notebooks/Colaboratory tools.
Looking for a Data engineer position in a data-driven company. Preferable to work with dagster+dbt based ETL/ELT stack.

Expect a collaborative / friendly environment with a "growth mindset in the air".

Expect possibilities to form / impact on decisions about approaches, tooling, tech stack.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


- Gathered the business requirements from the stakeholders to design the data-sourcing project outcome.

- Integrated data sources below by creating a Databricks Python operator to run on the Databricks cluster, processed the data using Apache Spark, wrote the data into AWS S3 buckets, and automated the tasks using Airflow DAGs.

- Created an operator to push the Braze events into Mixpanel, and saved 30K USD / year by replacing the paid connector provided by Braze with my operator.

- Sourced the Leads, Accounts, and Opportunities data from Salesforce using the Bulk API.

- Sourced the data from Tickets, Users, Organizations, Groups, and Ticket Management endpoints using the Zendesk API via the cursor-based pagination method.

- Sourced the Campaign and Traffic Source data from Hubspot using the Analytics API.

- Sourced the App Performance data of our Apps and Competitor's Apps from the AppAnnie using the data.ai App Performance V2.0 API.

- Sourced the Amenity, Shop, Tourism, Leisure, and Landuse GIS data for 27 cities from OpenStreetMap (OSM) using the Overpass API.

- Sourced the required financial data using the Microsoft Business Central API.
Position: Data Engineer
Category: Python
Experience: 0.5 years | English: intermediate


GR8 Tech, Data Engineer
My responsibilities at this position:
- Maintain existing Data pipelines. Configure extracting data from different sources (Kafka topics, another API), filter/transform and load to the database (Postges)
- Build and maintain REST API for CRUD operations with database
- Build new data pipelines. Schedule extracting data from external API and load do database
- Set up monitoring and alerting (Grafana) 
- Write tests for new functionality
Position: Data Engineer
Category: Data Science
Experience: 0.5 years | English: intermediate


Graduated from a paid internship program offered by the German-Ukrainian project DigiJED. Completed a six-month practical training and received a certificate. Currently enhancing my technical skills in analytics and machine learning, as well as working on a project related to machine learning and information security.
Used:
Python programming language,
Tensorflow,
Pandas,
Numpy,
Matplotlib,
scikit-learn.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: pre


Green professional service P.L.C
My duty was analyze the dataset for missing values, duplicates, and outliers and deal with them accordingly. Make a new variable based on the multiplication of two columns. Create three Data Marts and establish relationships between them using foreign keys and primary keys. Load selected columns into the data warehouse for future use and visualize the three Data Marts.
The technology I used for the project is PostgreSQL, Jupiter Notebook and power bi.
Position: Data Engineer
Category: Python
Experience: 1 years | English: upper


Had an opportunity to perform a Business Analysis of Boeing work processes in Spares Engineering project, System Analysis of available software and systems on workstations and by using Excel Visual Basic for Applications, as the only accessible development environment, built a team efficiency and quality monitoring system, which collects and shows all data in some Data Analysis reports and charts. It led our team come to 96+% of quality and producibility. The same as at Spares Engineering project after making Business Analysis of workflow stages at Product Development project and System Analysis of available software used by our team, created new metrics system, using the only available Visual Basic for Applications in Microsoft Excel, to rise up our efficiency and time planning. Also as a freelance project has been analyzing credit banks database.
I dream in some days become an experienced Data Scientist. Hate inefficient work processes, and always try to create the improvements on them.
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: intermediate


• Handle the development cycle end-to-end: from learning and understanding the requirements, translating them into code, and deploying to a production environment.
• Collaborate on ETL (Extract, Transform, Load) tasks on Informatica, maintaining data integrity and verifying pipeline stability.
• Extract data directly from relational databases, data warehouses or other data sources using SQL to solve business problems.
• Assess business needs, compile necessary data and develop dashboards/reports on Cognos to provide strategic insights for stakeholders.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


- Hands-on experience on Python using Pandas, NumPy, scikit-learn + Plotly & Matplotlib
- Strong SQL skills + ETL operations + Spatial querying ninja (PostGIS, pgRaster, pgRouting)
- ArcPy, PyQGIS, GDAL/OGR
- Building pipelines with Apache Spark & Apache Solr, scheduled and monitored with Apache Airflow
- Google BigQuery + Elasticsearch + ClickHouse + Greenplum
- Google Cloud Functions and Azure Functions Deployment
- Web scraping using Scrapy & automation using Selenium
- Django & Flask Web Development
- Broad experience in ESRI Suite (ArcGIS for Desktop Advanced, ArcGIS Pro, ArcObjects C#.NET)
- Solving problems with scientific methods