lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: fluent


Inter Cars / Link Group, Data Engineer, present - 2022-07 (~1 year)

Technology: Scala, Spark, Kafka, Hive, Airflow, Kubernetes, GitLab, Podman

Data Engineer – B2B Contractor.
• Building an event sourcing platform which is the main information hub in the company (on-prem).
• Supporting new team members in the on-boarding process and creating new documentation.
• Basic usage of Kubernetes: Pod, Job, CronJob, Deploymnet, ConfigMap and Secret.
• Setting up new Team and Project.
• Setting up GitLab CI/CD pipelines, PagerDuty, Service Accounts for the Team.
• Rewriting a legacy Python project to Scala Spark.
• Creating Containerfiles and using Podman to improve developer experience in the Team.
• Presenting a talk on Improving Developer Experience at an internal Big Data Community event.
• Working with Business Stakeholders on new features and business requirements.

AXA, Data Engineer, 2022-05 - 2021-09 (~9 months)

Technology: Scala, Spark, Azure, Databricks.

Data Engineer - B2B Contractor.
• Migrating on-prem big data platform and databases using Spark and Scala.
• Working on skill matrix for the team and proposing internal training topics.
• Providing training to the team to fill the skill gaps. 
• Working with business stakeholders to tailor the solution to their needs.

JLL, Software Engineer, 2021-08 - 2019-11 (~2 years)

Technology: Scala, Azure, Docker, Python.

Software Engineer - B2B Contractor.
• Development of web app for JLL LightHouse Data Quality.
• Preparing JLL LightHouse for internal architecture review including SDLC.
• Setup and management of Azure DevOps for the project.
• Documenting architecture decisions.

Volunteering for JLL Building Pride Network (Part of Diversity & Inclusion)

EPAM / UBS, Scala Engineer, 2019-11 - 2019-02 (~10 months)

Technology: Scala.

Scala Engineer - Contractor for UBS.
• Development of NGA (Next Generation Archiving) which provides global capturing, document processing, archiving and retrieval solution to all business divisions.
• Working on setting up monitoring and logging for NGA project using Splunk, Netcool and Miro+
• Backup for Scrum Master.

Volunteering as Lead of UBS Wroclaw Pride Network (Part of Diversity & Inclusion)
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: intermediate

Took part in development of antifraud system for detecting gsm terminators. Had important role in integration with government services. Rewrited balance and payment parts of payment aggregator to a different technology for better performance under high load.
I participated in development of electronic document management using cuba framework. Took part in development of anti fraud system, CRM, payment system and other internal projects. Languages and technologies used: Java 8, typescript, golang, java ee, JSF, spring boot, spring mvc, graphql, thymeleaf, rxjava and angular framework.
Interesting project with room for growth. I've been working as a Big Data Developer writing ETLs for last 9 months, but I'd like to get back to the web development using mainstream frameworks and technologies.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: upper


I switched to Data Engineering from .NET.
I have experience developing Data Warehouse on Azure SQL database and different ETL processes with Data Vault pattern. Experienced in Azure Services like Functions, Logic Apps and especially Data Factory. 
Was involved in different kind of Data Integrations tasks and sometimes in data analysis dealing with Power BI and report generating
Looking for a place where I can develop and sharpen my skills on real interesting projects
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent


I usually work on creating and maintaining ETL pipelines. I work with Python and use AWS as a cloud plus other supportive technologies like docker, sql, spark etc. Currently, I learn scala as well to be more flexible and improve my AWS knowledge.
Position: Data Engineer
Category: Data Engineer
Experience: 1 years | English: fluent


I've been actively studying data engineering/analysis for more than six months, completing various hands-on projects, and will do more.

I've gained theoretical and practical experience in DevOps, DataOps, Analysis, ETL, Machine Learning, Computing, Networks, Visualization, and Architecture on the Google platform.
Certified Google Cloud Professional Cloud Architect and Data Engineer => which helped to structure my knowledge.   

2 years in an American company. I was responsible for vendor and customer communication, as well as the integration of Oracle Netsuite API.
Position: Data Engineer
Category: Data Engineer
Experience: 0.5 years | English: upper


I've been engaged in ETL projects holding responsibilities of extracting and delivering data from various sources for further processing using Spark, building automated data pipelines with Airflow, and analyzing data using Kibana;

Implemented monitoring solution using Elasticsearch and Kibana;

Wrote/Read data using Kafka;

Implemented DAG to run pipeline on AirFlow;

Converted data to different formats with Spark;

Implemented docker-compose file to create environment on Docker;

Stored and managed data in HDFS.
Can be discussed
Position: Data Engineer
Category: Data Science
Experience: 0.5 years | English: fluent

In both my academic and extracurricular endeavors, I have made significant progress.

One of my greatest achievements was winning several hackathons where I used my data science and machine learning expertise to solve actual issues. In addition to polishing my technical abilities, these experiences helped me develop vital teamwork, communication, and problem-solving skills that are essential in the tech industry.

I have taken various trainings and courses in AI and data science, including hands-on projects that allowed me to obtain particular expertise in these subjects, in addition to hackathons. These encounters have given me a thorough understanding of the algorithms and tools that underlie AI and data science, as well as how to apply them to tackle challenging issues.
I've completed a number of projects involving data modeling and analysis. As an example, I created a face verification application with computer vision techniques and a home prediction model that required web data to be scraped and cleaned. I've also won numerous data science and machine learning competitions at regional universities.

As the president of the Data Science club at my university, my current role in the team involves organizing events and workshops related to data science and machine learning. I also mentor team members on data science projects and facilitate discussions on current developments and trends in the industry.
I have a lot of experience with Python, as well as frameworks and libraries like TensorFlow, PyTorch, Scikit-learn, and Pandas, among other technologies. For machine learning projects, I have also employed cloud infrastructure like Google Cloud Platform and Amazon Web Services.
Moving forward, I also have good comprehension of Tableau, a data visualization tool, and  MS SQL for querying the data for the projects. Also, I want to keep learning about the most recent developments in deep learning and machine learning and explore new tools and technologies that can improve my data science skills.
Position: Data Engineer
Category: Data Science
Experience: 3 years | English: fluent


I've worked on a AI Semantic Search project using Pinecone, openAI API, and python.
Also worked with a team to build a categorization web app using AWS resources lie AWS Cognito, Lambda, S3, Code build, cloud front.
Presently developing my data engineering skill learning tools like spark, kubernetes terraform in other to be able to develop a robust and orchestrate scalable, reliable and agile systems and products.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


I was working as data engineer in product company that scrape and analyze data all across the web. My main responsibilities are:
•	Create and maintain various production microservices with Python, asyncio, multiprocessing, grpc, FastApi.
•	Update and maintain different internal libraries and tools.
•	Provide solutions for parsing data from various web sources.
•	Create ETL pipelines for data processing using Python and Airflow.
•	Configure monitoring and alerting systems using Prometheus and Grafana.
•	Write and optimize some Java code. 
•	Integrate DS algorithms into production environment.
•	Work closely with DS team to create optimal database structure and ETL pipelines.

I am looking for work in product company with data oriented team. I want to grow as engineer, get new experience, work with highly motivated and dedicated colleagues and provide SOTA sollution for real world challenges. I would be really enthusiastic to work on products that produce significant social value.
Position: Data Engineer
Category: Python
Experience: 0 years | English: pre

I have been learning Python and Data Science in 2022 at the ITEA courses.
I worked at the Government Service untill 2021 on the position "Head of a structural unit". There, I acquired soft skills such as: personnel and resource management, coordination of people's work to achieve results, organization and control over the execution of tasks, document circulation management, crysis managment, analysis.
I am looking for a job. I want to improve my knowledge in Python and develop in the field of Data Science.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper

Took part in successful re-designin and re-implementing cloud-based Datalake into alternative service stack: AWS EMR/Kinesis + Redshift DWH into AWS Glue/Lambda/StepFunction + Snowflake DWH
I worked on:
- Implementing ETL pipelines, using Spark and AWS stack

- Optimizing Spark jobs for lower memory, cpu and time footprints 

- Migrating data-processing stack from on-premise to completely cloud-based(Java + Sybase into Scala + AWS)

- Writing general use libraries for specific data transformation/data migration purposes that were used among multiple teams inside company
Position: Data Engineer
Category: Data Engineer
Experience: 1.5 years | English: upper


I work in FinTech project as a Middle Big Data Engineer at one of the biggest IT companies in Kazakhstan. My journey started in May 2021 when i graduated from Big Data School by Alfa Bank Kazakhstan. I use Airflow, Git, Python, SQL, Hadoop, Spark, Mesos everyday.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: intermediate


I work on designing, building, and maintaining the systems that manage data within an organization. This includes creating and optimizing databases, developing ETL processes to extract, transform, and load data, and integrating data from various sources.

In order to accomplish this, I use my knowledge of programming languages such as SQL and Python, as well as experience with database management systems like PostgreSQL, Snowflake or BigQuery. Additionally, I am familiar with cloud-based technologies like GCP, which I use to set up and maintain scalable, fault-tolerant systems.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: fluent

I am certified AWS Certified Solution Architect Assotiate and Data Vault modeller .

I have 3+ experience with AWS and 2+ experience with Data Vault and Dimentional Modelling
Jan-2017 - Jun-2017 - Student, EPAM Systems, 
Customer: EPAM
Project: BI Lab 2017
Team Size: Students: 8 members
Project Role: Student

Jul-2017 - Mar-2020 - Software Engineer, EPAM Systems, 
Customer: EV - Telecommunication
Project: This project covers all NDC related work for Telefonica O2 (Germany).
Team Size: Dev Team: 30 members
Project Role: DWH Developer, Oracle package development for DWH

Mar-2020 - Mar-2021- Software Engineer, Godel Technologies 
Customer: Insurance
Project: UK Insurance company Compare The Market (CTM)
Team Size: Dev Team: 5members
Project Role: DWH Developer, Redshift, AWS, DWH development

Mar-2021 - Now - Senior Software Engineer, Soname Solutions
Customer: Insurance
Project: Allianz Deutchland
Team Size: Dev Team: 10 members
Project Role: Data Modeller, Data Vault 2.0, Business Vault, Erwin, Erwin Fet Templates, Synapse Azure, Python, Kubernetes
I would love to continue working in AWS Cloud with Data Vault modelling pattern
Position: Data Engineer
Category: Java
Experience: 9 years | English: upper


Java - 8 years
Spring - 6 years
Hadoop - 5 years
Kafka - 3 years

Worked with Microservices and container-oriented technologies on bare hardware and cloud(Docker, Kubernetes, EKS)

Was working on data-driven projects including BigData technologies and streaming.  

Was team leader on two projects(from start to support phase).
Have experience with MapReduce and Spark.

Last two years working with micro-service architecture from scratch based on Spring Boot/REST/Kafka and Kubernetes
Looking for BigData project with competitive tasks in Lviv. 
Would like to get leading role(Team/Tech leader) to develop better soft and technical skills.

Would love to get my hands on big amounts of data and writing analytics system to solve business problems.
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper

Honorary Decree for the highest GPA score from Azerbaijan Technical University (97/100)
Google Data Analytics Professional Certificate
IBM Data Science Professional Certificate
IBM Data Analyst Professional Certificate
Data Analysis and Visualization Foundations Specialization
Data Engineering Foundations Specialization
Hands-on Introduction to Linux Commands and Shell Scripting
Introduction to Containers w/ Docker, Kubernetes & OpenShift
Fundamentals of Kubernetes Deployment (LearnQuest - Coursera)
HackerRank SQL (Gold Badge)
HackerRank Python (Gold Badge)
Job-related skills	Tools and Components of Data Architecture.
Create an interactive reports via Excel (Pivot Table), Tableau and Apache Superset
Data extraction from different (excel, RDB, flat files, Google sheets) sources, transformation, preparation
Manipulating, cleansing & processing data using python, Excel, SSIS and SQL Analyse large datasets to improve process flow and quality of data on it
In-Depth Knowledge of SQL and Other Database Solutions. ETL or ELT processing via SSIS.
Data Warehousing and ETL Tools.
Data Analysis via Tableau and Python Reporting (SQL, Tableau)
New experiences, working with cutting-edge data technologies and satisfied salary.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: intermediate

IT Team Management program
Knowledge of Software Testing Life Cycle;

Design and development of technical documentation (test cases, checklists);

Processing tasks in Jira;

Analysis of the internal clients’ requirements to the desire software tool;

Adapting and conducting the unit testing through creating SQL queries;

Development of the validation rules and requirements to the incoming data.
.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


Last job description
My job was to develop and maintain the whole data engineering part of the analytics department.
The data lake model was used where data came in to Redshift dwh or S3 (+Spectrum) from backend sources like MySQL and Mongodb replicas and RabbitMQ. It then got transformed with Lambda jobs and Airflow tasks. The final set of data was used in Tableau reports, in alerting, web API Dreamfactory.
The infrastructure heavily relied on AWS.

Technologies used:
- Python, some JS, some Java, some Scala
- Airflow for scheduling tasks. Written many custom plugin Operators
- Redshift + Spectrum. Querying and maintenance
- RabbitMQ, binlog MySQL and oplog Mongo streaming. NiFi
- Timescale + Grafana. Influx for small legacy use case
- AWS. EC2, Kinesis, Lambda, S3, Glue, LEX, Cloudformation
I want to get a challenging Data Engineering position solving business needs with cutting-edge on-premises and cloud technologies.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Machine learning algorithms design and implementation.
Data engineering
Position: Data Engineer
Category: Data Science
Experience: 11 years | English: intermediate

12 years Oracle database;
 7 years Data Warehouse and Business Intelligence;
 1-year  Big Data.
 participated in 10 projects (insurance, telecommunication, banks, goverment)
Machine learning, Data mining, Data Science,
Hadoop, Hive, Flume, Spark, Pig, noSQL, 
SQL, PL/SQL,
Java, Python, R, 
OOP, Database, Data Warehouse, Business Intelligence
Participate in Big Data, Machine Learning or Data Science projects.
Relocation opportunities.
Remote job
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper

Administrative professional with technical background who backfilled the VP of EPAM. Delivered services to the one of the biggest hedge fond of the world (financial/trading domain).
Macroeconomic data analysis
extract macroeconomic data (gdp, cpi, ppi, flow of funds) releases from provider web site
convert to custom format using python scripts
check for mistakes, anomalies in data on test environment, launch appropriate reports,
load data to platform 

Market (financial) data analysis:

analyze structure, types of data,
ETL/ELT practice,
relations, define metadata/time series fields and measures of market datasets (export/import commodity data, ownership, equity, financial statements),
used Python libraries to extract and transform data: selenium, pandas, numpy(depends on source of data),
discuss with client results of analysis and provide it to business analysts.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: intermediate


Main responsibilities:
- build new data pipelines and support existing ETL pipelines
- optimize existing bottlenecks (query performance etc.)
- data validation
- interact with internal data consumers to understand data needs
Position: Data Engineer
Category: Data Engineer
Experience: 8 years | English: intermediate


Mar-2021 - Till now Tasks performed: • Developed ETL batch Spark job, covered with unit tests • Gained experience with AWS services(Glue, SNS, CloudWatch, Cloudformation, SecretsManager, IAM, S3). Environment: • AWS services, Github, Maven, Git, Jenkins, Jira • Spark, Scala, Java, AWS Services Oct-2020 - Mar-2021 Project: Aim of the project is to gain experience in production like tasks that included simulation of ETL process that included implementing and orchestrating multiple Spark jobs. Multiple batch and streaming jobs were implemented to clean, transform and load raw data into datawarehouse. As datawarehouse solution Hive was used. Hortonwork Data Platform was used as run all needed software. Gained experience with AWS services(EC2, EMR, S3) Tasks performed: • Developed ETL batch and streaming Spark job, covered with unit tests • Working with Hive managed and external tables • Implemneted solution for tracking already processed files • Gained experience working with Kafka API and managing offsets • Gained experience with AWS services(EMR, EC2, IAM, S3). Environment: • Hive, MongoDB • Intellij IDEA, Virtualbox, HDP, Data analytics studio, Maven, • Apache Hive, Apache Hadoop, Kafka, Spark, Spark Streaming, Java 8, MongoDB May-2020 - Oct-2020 Project: Project to track RD-related activities and education costs in UA Office, to separate it from other GDOs and mid-term to replace huge and old EPM-FARM. Large amount of tables for store information about test, users, topics, groups of testers, liquibase information, test sessions for testers, permissions for test manager and so on. PostgeSQL is using for RD Portal, it contains information about students, locations, time slots of testing and so on Tasks performed: • I worked with DB: searching, retrieving, sorting, updating and etc. Wrote REST end-points, covered code with JUnit-test, bugfixing, change/add configurstions, work with email- notifications, create/improve/change scheduled tasks, refactor code. • In case of difficulties with the work process, I contacted the team lead or project manager. • Worked in SCRUM team, completed tasks according to SCRUM sprint. Completed tasks was checked by Team Lead. Environment: • MySQL, PostgeSQL. MySQL is using for Test Portal. • Intellij IDEA, MYSQL Workbench, Git, JIRA
Looking for an interesting project with progressive technologies, infrastructure and professional team
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: upper


• May 2021 - present. Data engineer. NDA.
Building/enhancement/development/maintaining of ETL pipelines, new data sources integration into existing DWH. Interacting with data analytics team for requirements gathering and defining. Initial data analysis using Spark/Python/SQL. Implementing automated data quality control. Main technologies: Spark/PySpark, AWS, Apache Airflow.

• February 2020 - April 2021. Data engineer. NDA. Building ETL pipelines, integrating new data sources(API/scraping), data validation and quality check automatization. Architecture planning, requirements defining. Legacy code refactoring. Main technologies: Spark, Airflow, Databricks, Python.

 • December 2018 - February 2020.
Python developer. NDA. Development of analytical system(data crawling, testing, servers managing). Integration of new data sources. Requirements defining, mentoring and interviewing. Implementation of distributed crawling system. Main technologies: Kafka, MySQL, Python3, Selenium.

 • July 2018 – December 2018. Python developer. NDA.
Development of procurement’s system backend(API endpoints, data validation, autotests, unit tests) using Python, Redis, pyramid, Coach DB.

 • September 2017 – July 2018. Python developer. NDA. Game stimulator development  (multitenant functional, registration procedure, permissions system, notifications system) using Python 3 and Django/DRF. Product deployment on client’s servers.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper

DWH Development 
Master Data Management Development
Middle Data Engineer more than 4 years of experience in Data Engineering, Database and Data Warehouse development and Master Data Management.

My experience briefly:
Experience with DWH development/ETL pipelines ,BI architecture and solid experience in the designing and implementing of database-based solutions.
Working with Database architecture and development specifically via PL/SQL.
Hands on experience in data integration.
Basic skills on database administration (Oracle, MS SQL).
Performance tuning  or SQL query optimization.
Solid experience in Master Data Management - Master Data Services.
Business Intelligence Architecture and Administration.
Report generation and analysis using various Business Intelligence tools, using them to visualize data to get much more valuable insights from data.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper


Middle Data Engineer with 2.5 years of experience. Graduated with, Bachelor’s degree, in Computer Science, Artificial Intelligence Systems.  I have a good knowledge of T-SQL, PostgreSQL, Redshift, and MySQL. Also experience with Amazon Web Service(like S3, EC2, IAM, Glue, Lambda), Python, and PySpark. Used to create the CI/CD pipelines via Jenkins, create ETL jobs using Stored Procedures in SQL, SSIS packages, and via Rundeck. Have created a lot of DB objects for reporting services like PowerBI and Tableau. Worked using SCRUM and Kanban methodologies. Ready to study something new and improve my tech skills.