lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


- Have attended several projects in different industries like Healthcare, Insurance, Banking, Finance, and so on. 
- Collaborated with experts to draft source-target mapping documents for migration.
- Designed data warehouse process models, encompassing source data sourcing, loading, transformation, and extraction.
- Leveraged SSIS for ETL processes, enhancing both existing and new data loading operations.
- Orchestrated and deployed SSIS packages, configuration files, and automated schedules for data generation in CSV.
- Implemented Event Handlers, Error Handling in SSIS packages, and communicated results to stakeholders.
- Demonstrated proficiency in creating parameterized, user-friendly reports using Power BI, inclusive of charts, graphs, and drill-down functionalities.
- Engaged in data migrations from on-premise SQL Server to Azure Data Lake Store using Azure Data Factory (ADF V2).
- Configured Azure components like data pipelines, blob storage, and data lakes. Automated data flows via Azure Data Factory.
Position: Data Engineer
Category: Python
Experience: 3 years | English: upper


Have strong skills in designing scaleble software for different purpose. During my web-experience created strict RESTful APIs using FastAPI, Flask frameworks, Postgre, MongoDB, Redis databases, JWT authorization and other modern tools to create software. Also opened myself as a Data Engineer designing data lakes, data processing and validation modules using pandas and airflow. Always trying to automate testing, staging and deployment pipeline as much as possible as well as to write understandable code for every one who will read it in the future.
Big data processing and analysis with great team, where I can be useful and improve my skills. Also do like to write APIs to access this data from UI (as an example).
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent

- Successful migration of Looker Explores based on Snowflake DWH to GCP BigQuery
- Team growth from 2 to 6 engineers when leading
- Creation of data processing pipelines and DWH (based on GCP) for multiple customers' plants
- Creation of the PoC product for detecting credit fraudsters that started to bring the company revenue (data science project)
Have worked in both startup and enterprise environments both in local and distributed across the globe teams. My experience is focused mostly on Data Engineering and Clouds, I posses  knowledge and practice in Data Science projects as well though. From technological perspective right now I am working mostly with Python, SQL, dbt and various GCP services (certified) and devops stack (GitHub Actions, Terraform). Led teams on 2 projects.

Projects:

- Snowflake DWH migration. 
   Responsibilities:
   - Spinning up the GCP environment 
   - Consulting the customer's team
   - Migrating data processing from Snowflake to BigQuery, Composer, dbt, Python

- Clinical Data Lake assessment
    Responsibilities:
    - Assessment of the Data Lake implementation state (based on GCP services)
    - Preparation of the corrective actions report based on the assessment results (included data ingestion, working with sensitive data, orchestration)

- Application for mining engineers
   Responsibilities:
    - Leading the data engineering team
    - Elicitation of requirements
    - Data pipelines design and implementation (BigQuery, Dataflow, Composer, Storage)
    - Trainee/junior engineers mentorship

- BigQuery Omni Alpha evaluation
   Responsibilities:
   - Implementing PoC with BigQuery Omni private alpha service
   - Documenting results as an article on C2C global

Those are some of the projects that I was working on. We can go more in depth into my experience during the interview.
Position: Data Engineer
Category: Data Engineer
Experience: 11 years | English: upper


Having 10+ years working on data migration projects across the globe. Experienced in data discovery, profiling, quality, cleansing and data modeling.
 - Skilled at data migration ETL, bulk data manipulation.
 - Working knowledge in Telecom - Products and Services domains.
 - Experienced in SQL and SQL performance tuning.
 - 10+ years’ experience in Oracle SQL, PL/SQL.
 - Oracle APEX.
Position: Data Engineer
Category: Data Analyst
Experience: 1 years | English: fluent


Hello :)

I aim to be involved in projects on automation, Big Data, infrastructure engineer and cloud computing

My skills are described as:


- Big Data: Development and administration on top of Hadoop ecosystem. Ingestion Data Flows, Data Driven Development with Spark;

- Operating Systems: More than fifteen years of experience on Linux and *BSD systems.

- Programming: Python, Scala, bash as well as experience on build tools and SCM (Maven, GNU Make, Git ). Knowledge in collaboration and continuous integration tools ( Bamboo, Jenkins, JIRA, Confluence ).

- Networking and security: TCP/IP stack, firewall and network services configuration.

- Processes: ITIL v3 process management and through Lean, Scrum
and Continuous Delivery

- Infrastructure as Code: Design, coding, and tests of infrastructure components with Chef.

- Cloud Computing: Provisioning and orchestration on OpenStack, AWS and Azure providers

- Virtualization: Research and knowledge on Unikernels, Docker Containers, and KVM.

- Application Servers and Java: Virtual machine tuning, administration, and provisioning of WebLogic application servers.
Position: Data Engineer
Category: SQL
Experience: 8 years | English: upper

Here are some results for the last 3-5 yerars
1) migration 200+ jobs from ControlM to Stonebranch enterprise scheduler;
2) developed a solution extracting data from pages. I used here a few technologies such as database development, scraping, restapi. Hence, such programming languages as sql, bash script, python were actively used during the implementation;
3) helped to migrate both data and stored functions/procedures from Oracle DB  to PostgreSQL. Besides that I developed a detailed guide how to do data migration in Windows environment,
4) was able to build up a big data environment in Docker Swarm taking into account a fact that I had never worked with Apache Livy, Apache Knox, Docker swarm tools before that moment
Hello there. 
Am an experienced data engineer. Started my career as a DBA/System Administrator in 2007. Here are some notes regarding noticeable activities:
1) DB2 migration 8.2 - 9
2) Informix migration 9.4 - 11.50
3) DB2 replication (from z/OS to AIX)
4) Oracle -> MS SQL data migration
5) building data pipelines in Hadoop with leveraging Hive/bash
6) migration sourcecode of stored procedures from Oracle to PostgreSQL
7) scraping data from a few platforms, and storing all the records in a DB
8) implementation of a delta lake and buliding up a dockerized big data environment (hadoop, spark, knox, livy) from scratch
I:
1) avoid monkeyjob, 
2) don't like working on boring tasks
3) am against of working in a huge office spaces.
My dream is a small development team (up to 10 employees).
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Hey!
I`m data engineer with almost 4 years experience.
Currently looking for opportunities for senior position
Position: Data Engineer
Category: Data Engineer
Experience: 1 years | English: upper


Highly-motivated person, that is always eager to learn and improve
Experience:

Junior Data Engineer:
Data processing, modeling, and maintaining pipelines
Analysis of diverse data sets
Visualization dashboards

Internship at the company:
Main Tasks:
build DWH using open data, learn AWS Services such as S3, CloudFormation, Amazon EMR, RDS, PySpark
Position: Data Engineer
Category: SQL
Experience: 11 years | English: upper


Highly skilled Freelancer, with 10+ years experience in Database Development/Administration & Business Intelligence Developer.

Certifications earned
Microsoft Certified Solutions Expert: Data Management and Analytics — Certified 2019
Microsoft Certified Solutions Associate: SQL 2016 Database Development - Certified 2019

Known for non standard thinking with strong development abilities, building and maintaining the solutions based on SQL Server family products, working in stressful situations, i deliver the most of my capabilities in desired result.



As part of my Database Administrator position, i got big experience in:
 Backing up the databases and ensuring that they meets the businesses Recovery Point Objective;
 Configure SQL Server monitoring;
 Install and configure new SQL Servers;
 Expertise of current or upcoming needs for the hardware, that will assure excellent working of SQL Server environment;
 Elaborate documentation for organisation database environment;
 And much more :)

As a Database Developer, i got experience in: 
 Development of solutions using T-SQL scripts, such as: stored procedures, functions, functions, views, triggers, in-line functions and so on;
 Ensure that developed code meets standards for performance, readability and reliability;
 Design of indexes for existing applications;
 Dealing with query performance issues and help developers to resolve it;
 Table design with picking proper datatypes;
 Using traces to find the most the frequently running queries.

Another good stuff that i am good at: 
 SQL Server Integration Services (3+ years)
 SQL Server Reporting Services (5+ years)
 SQL Server Analysis Services (1+ years)
 Microsoft Power BI (2+ years)
 PostgreSQL Development/Administration (2+ years)
 MySQL Development/Administration (2+ years)
 Oracle SQL Developer (1+ years)
 AWS Redshift (1+ years)

 Python development (8+ months)
 C# development (2+ years)
 Powershell (1+ years)

 Windows Server 2012 R2 Administration (2+ years)
 Git (2+ years)
Position: Data Engineer
Category: Data Analyst
Experience: 3 years | English: fluent

Azure and Power BI certifications
Highly-skilled professional with a background in designing, building and maintaining large databases and data warehouses in a team environment, as well as playing an impactful role on the BI & data visualization front. My main data skills are around SQL and Power BI (Microsoft Fabric). Experienced in Python for data cleaning, processing and statistical analysis. Passionate about the combining expertise in Finance, Operations & Procurement with engineering to drive comprehensible business reporting and consistent decision-making.

During my work experience, I have used different tools and technologies to deliver business value, such as R in R Studio, DAX & M language in Power BI, Python in VS Code, T-SQL in SSMS, Spark in Databricks and MS Fabric.
Position: Data Engineer
Category: Data Science
Experience: 11 years | English: upper

I have experience in:
 - Development of realtime data pipelines from scratch
 - Building automated reporting system
 - Improvement and optimizing existing solutions to save costs and speed up processes
 - Development of a successful open source projects
Hi! I am a Data Engineer with strong software development background. I like to build tools that enables data-driven business decisions. I have extensive experience working in distributed teams as well as with foreign colleagues.
I am ready for new offers where I can grow as a professional and I can go up a notch. I give preference to product-oriented teams and new projects.
Position: Data Engineer
Category: SQL
Experience: 11 years | English: fluent


Hi,

I have 10+ years experience of in development in all major database systems including Oracle, PostgreSQL, SQL server, Snowflake etc. .
Let's connect and start our journey. 
Hope to hear you soon.



Regards, 
Aram
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper

•Databricks Certified Associate Developer for Apache Spark 3.0
•Academy Accreditation - Databricks Lakehouse Fundamentals
Hi, I'm a Data engineer. I thought I would just write my experience here, but if you are interested, I can send you my CV.
	Had experience with Azure, AWS, Python, PySpark,  SQL, Airflow, Jenkins, and Scala.
	I'm interested in working with AWS or Streaming Data. I am not against new technologies. I will gladly master them at 150% learning speed. Trying to always learn and develop myself in the Big Data domain.
	So, if your company appreciates employees who are always eager to learn something and, in addition, learn quickly and immediately use their knowledge in practice. We might have a perfect match :D
Position: Data Engineer
Category: Data Engineer
Experience: 7 years | English: upper

I tend to be owner of the project regardless of what it takes to deliver. When setting up new data pipeline - it's not just technical steps for me. For me it's talking to all stakeholders to understand requirements, making sure that data is being generated in expected way (especially with manual input and automations), making sure data being collected in the most efficient way from data source, making sure that ELT transforms data per stakeholders needs, making sure visualisation of data clear and user-friendly.

I was mostly working with marketing data, some key results:
- Defined process flow and build data pipeline for automatic channel attribution in Salesforce
- Set up data pipelines for measuring full circle of Inbound Leads processing by Marketing team: incoming, qualified leads, tracking of the time lead was in work and communication activities
- Defined and set up process flow for automatic leads qualification in Salesforce
- Set up process flow and automatic leads attribution by Markets
Hi there! I have 7 years of experience (3 years as BI Analyst + 4 years as Software/Analytics/Data Engineer), currently working as Data Warehouse Engineer in one of the unicorn companies. I love my current job, but have some spare time for interesting projects on a part-time basis. Ideal projects scope right now: help setting up analytics framework from the scratch, consultations, ad-hoc analytics, mentoring analytics team.
Overall I worked with such data stack: AWS (s3, Athena, Glue, Redshift), Snowflake, Python, custom data ingests from various APIs, Airflow, Stitch, _dbt, Matillion, Hightouch.
I can't work full time at the moment.
Position: Data Engineer
Category: Data Engineer
Experience: 2.5 years | English: upper

AWS Certified Developer – Associate
I am a Big Data Engineer with 2.5+ years of experience. I have a master's degree with a data science specialty.
I have experience with a wide technology stack, so it is not a problem for me to teach or investigate something new. I am open to new experiences and changes.
February 2021- until now
Third Party Data Team: works on the delivery of a variety of data sources to Data Lake, then configures Data Lake to process it.
Developing a custom framework in Scala to process (unarchive, change structure, rename, etc.) different types of data into EMR
Developing the Python API to query data from PostgreSQL and Elasticsearch
Developing lambdas and step-function workflows to process (ingest, read, etc.) data through our frameworks
Working with glue jobs: writing custom jobs on Scala to transform, ingest, and populate data
Supporting and extending the Spring Boot application.
Developing custom Bash and bat scripts. 
Developing SQL procedures and schemas
I also have experience with DynamoDB and other AWS services.
October 2020-January 2021
The project was focused on data migration from on-premise Oracle DB to cloud GCP Big Table.
My main responsibilities were:
Ingestion Tables from Oracle DB to GCP
Write complex sql queries for BigQuery
Development and configuration Airflow Dags
Write share knowledge documentation about project
Set Up and configuration clusters on DataProc
Prefer work with Java/Scala, AWS.
Position: Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


I am a Big Data Engineer with experience in designing and implementing large-scale big data solutions using cutting-edge technologies such as Hadoop Ecosystem tools (such as Hive, Spark, and Pig) and NoSQL databases (such as Cassandra and MongoDB), and programming languages such as Python and Scala. I have utilized k8s, Docker, and Docker-compose to deploy and manage scalable and fault-tolerant big data applications, and integrated them into a continuous integration and delivery (CI/CD) pipeline using tools such as Jenkins and GitLab.

I have also created and maintained efficient data pipelines for seamless data processing and storage using tools such as Apache Nifi and Kafka, and automated the deployment and monitoring of these pipelines using tools such as Ansible and Terraform. I have analyzed vast amounts of data using data processing frameworks (such as Spark and Flink) and machine learning libraries (such as TensorFlow and PyTorch) in Python and Scala to uncover insights and support data-driven decision-making.

In addition, I have experience in SQL scripting, ETL processes, and data analysis and reporting using tools such as Tibco Spotfire, BI Publisher, and SAP Data Services. I have worked with various databases such as Sybase IQ, MS SQL Server, Oracle, and PostgreSQL. I also have advanced proficiency in English and fluency in Azerbaijani, as well as a range of digital skills including programming languages, databases, cloud computing, BI reporting, and data warehousing systems.

With strong communication and teamwork skills, I collaborate well with cross-functional teams and communicate technical information to both technical and non-technical stakeholders. I am always seeking to stay up-to-date with the latest advancements in the field and apply new technologies to improve processes. I provide technical support and troubleshoot issues to ensure the smooth operation of systems, and I am committed to continuously improving my skills and knowledge.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper


I am a Data engineer at Space International. I am Creating, optimizing and maintaining data sources for analysis using MS SQL, Python, SSIS, SSRS; Developing reporting database; Taking part in creation of data analysis models and charts with data scientists and data analysts
using Python and Power BI.
I have 5 years experience in SQL, 2 years experience in python, 2 years experience in working on ETL using SSIS and creating reports in SSRS as well.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper

500+ problems solved on Codesignal
Actively solving problems on Leetcode, Kaggle
I am a data engineer with 8 years of professional experience in ETL processes and analysis. My practical knowledge of the most popular database management systems and languages, including Python and SQL, allowed me to participate in exciting projects where I managed to extend my experience with requirements gathering, and customer communication.
I have a solid background in Database Design and Architecture, and some data science skills. also have good knowledge and working experience with Agile Scrum methodology.
I am a good team player with solid self-motivation and communication skills. 
Passionate about learning new technologies and solving complex problems. Good knowledge of algorithms and data structures, ability complete projects efficiently, find non-trivial solutions and satisfy customers with qualitative results.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper

- AWS Cloud Practitioner certified
- Azure Foundation AZ-900 certified
I am a data engineer with almost two years of commercial experience in data engineering. I have solid data engineering expertise in different domains. I worked on training and commercial projects during my career.

Training project - E-commerce domain
Technologies: Python, Python, Spark, Airflow, AWS (glue, lambda, emr, dynamoDb, Kinesis, Firehose)
Team: 1 lead engineer, one senior engineer, and one junior engineer.
Project responsibilities: Implementation of big data solutions to optimize the work of the high-load service for online banking. 
I have implemented scalable and high-performance pipelines for extracting, transforming and loading data.
Participated in each stage of project development and worked with all these technologies.

E-commerce domain
Technologies: AWS (S3, Glue, EMR, DynamoDB), Python, Spark, Airflow, Snowflake, DBT
Team: 5 Data Engineers, DQA Engineer, BI Engineer
Project responsibilities:
- Building Data Lake
- Migrate tables/columns from on-prem database into cloud
- Creating and orchestrating ETL pipelines
- Data testing
- Improving existed CI/CD pipelines
- Providing Snowflake ingestion
Position: Data Engineer
Category: SQL
Experience: 4 years | English: intermediate


I am a Data Engineer with excellent knowledge in the following areas:
dimensional data modeling, ETL development and Data Warehousing. Proficiency with 
RDBS; NoSQL; Clouds; ERP. Passion to automate everything. Have an experience of 
working on several projects in parallel.
Position: Data Engineer
Category: Data Engineer
Experience: 3 years | English: fluent


I am a data engineer with In-depth data analytics and engineering skills and experience working on Big data. I am very good with descriptive, predictive, and inferential statistics. I have worked on data projects requiring big data migration using pipelines.
Position: Data Engineer
Category: Data Engineer
Experience: 2 years | English: upper

- Migrated hundreds of ETL pipelines from Teradata to Snowflake using Airflow and AWS S3
- Maintained legacy ETL pipelines using Teradata and WhereScape for internal direction
- Performed bug fixing and troubleshooting of the migrated ETL pipelines
- Communicated directly with the stakeholders
- Mentored newcomers
I am a Data Engineer with two years of experience in data migration and enterprise data warehouse maintenance. I am looking for a team that develops a high-end data-driven project that matters and where I can constantly implement best practices.
- No russia or belarus
- Remote mode or on-site in Lisbon
- Meaningful project
- Professional growth
Position: Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent


I am a data engineer with vast experience in building and optimising pipelines. I use tools and technologies such as SQL, Python, Kubernetes, Kubeflow, Docker, Big Query, Amazon Redshift, Postgresql, Numpy, Pandas, Web Scraping and several others.

Built ETL data and machine learning pipelines involving data scraping and collection from a variety of sources for analysis, model training and evaluation.
Built and designed data lakes and data warehouses on GCP Big Query and AWS S3
Set up Apache Airflow for pipeline orchestration and monitoring.
Led a team that implemented a climate change project from data collection to analysis and model training.
Position: Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper


I am a data/ETL engineer with 6 years of experience of data engineering in leading Ukrainian and European companies. As a data engineer I have been involved in several gamedev and one telecom project, have been working with requirements, design, integration, testing and automation of data pipelines. I have experience working with Unix OS, BASH scripting. As a data/ETL engineer I am working with Python, orchestration tools - Apache
Airflow, Agile/Scrum, Cloud services – GCP, AWS, containers - Docker.