lang-uk/recruitment-dataset-candidate-profiles-english huggingface dataset:
Position: Senior Data Engineer
Category: Python
Experience: 7 years | English: upper

- World Yandex Algorithm competition final 2011 (12-th rank)
- ACM semi-finals SEERC 2010 and 2011 in Romania (4/5-th rank) - TopCoder and other online competitions
- have written own chess engine)
Python, Spark, Big Data, ElasticSearch, Solr, CouchDB, Django, Jenkins, Redis, Java, AWS, SQL
- high technically skilled team
- good challenges
- communicative team
- good management
Position: Senior Data Engineer
Category: Java
Experience: 9 years | English: upper

* Developed dozens of services and apps of various kinds
* Successfully leading 5 sub-projects simultaneously, 14 remote devs in total
* Have experience of taking ownership of huge infrastructure with 100+ polyglot microservices (new team creation, platform upgrade, reducing costs for hardware, migration to open-source solutions)
* Participated in the creation of several BI departments for different products
* Successfully collaborated with the Data Science team to integrate several Machine Learning solutions into the production
Recently participated in the development of:
* Microservice-based systems (Spring Boot, resilience4j, Kafka)
* Batch processing ETLs (Spark / AWS Glue, AWS S3, Parquet)
* Streaming ETLs (Spark Streaming / Storm, Kafka, Scala)
* Automated data transfers between S3/Kafka/RDBMS/MongoDB/etc (Java / Scala)
* REST API for analytics data querying (Java)
* REST API for Machine Learning, Model as a Service (Python)
* BI data flows and ML training automation using Jenkins (Groovy pipelines) and GitLab CI
* Remote only (business trips - ok)
* Product company / startup
* Big Data or Data Science related project is preferable
Position: Senior Data Engineer
Category: Data Engineer
Experience: 6 years | English: upper

- Spark ELT frameworks from scratch 
- Spark Streaming applications 
- Data lakes on AWS
Seeking for positions to work with architecture and big workloads, big data, optimizations, devops. Product companies are preferred.
NO to frontend, full stack, enterprise, legacy
Position: Senior Data Engineer
Category: Data Engineer
Experience: 5 years | English: fluent

- Rated TOP 20% in McKinsey x Tinkoff and TOP 35% in McKinsey x Alibaba hackathons. 
- Certified Alteryx designer.
Self-directed and driven Data Engineer with a background in Data Science, having good problem-solving skills.

- Years of experience: 5
- Domain: banking, fintech, healthcare.

- Technologies stack: Python (Spark, Trino, SQLalchemy, Airflow, FastAPI, MinIO, Boto3), Postgres, Kubernetes, Docker, AWS (S3, Athena, Lambda, Glue, QuickSight, LakeFormation), Dask.
- BI Tools: SAP, Alteryx, PowerBI, Tableau
- Version control: Git, BitBucket
- Documentation: GitLab, Confluence
- Pipeline: ArgoCD
- Monitoring: Grafana/Loki

- Education: Carnegie Mellon University (2019)
- Major: Data Analytics/Data Science
Position: Senior Data Engineer
Category: Data Engineer
Experience: 10 years | English: upper

Implemented Datamart for Sales system from the scratch. Passed Microsoft certifications 70-761, 70-762, 70-464
Senior DW/BI Engineer with 10 years of experience. Participated in 5 long-term projects. 
Qualifications: 
- Data Engineering
- Database Design 
- DWH 
- ETL 
- DB Development
Work with Cloud (AWS, Azure)
Position: Senior Data Engineer
Category: Data Engineer
Experience: 6 years | English: fluent


Software/Data Engineer with expertise in
- architecting & implementing data pipeline components in Python and Scala
- gathering requirements and building PoCs for novel parts of the tech stack
- maintaining AWS-based ETL pipelines and large-scale Snowflake warehouses
- setting up data incident management workflows from scratch
C1+ English.
Looking for an awesome data team in a product company :)
Position: Senior Data Engineer
Category: Data Engineer
Experience: 4 years | English: upper


Software Engineer at FAANG, have a solid background in Data Engineering and Data Pipelines. Worked on different projects with Big Data and Fast Data technologies. Has a good knowledge of building distributed and large-scale systems.
Was responsible for leading a team of 10+ people and mentoring newcomers.
Position: Senior Data Engineer
Category: Scala
Experience: 9 years | English: upper


Software Engineer with 9 years of Big Data related experience. During this time I've got an extensive experience of using Hadoop ecosystem frameworks and cloud computing platforms. Highly interested in projects where high performance and scalability are needed. Also my area includes research and POC implementation.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 3 years | English: upper

Got certificates in DB direction: DB development (IT Academy), BrainBench (sql server administration), hackerrank (sql, python), oracle (LinkedIn), MongoDB (mongoDB university), Sql. 

Also I am certified by AWS Certified Cloud Practitioner (CLF-C01), Microsoft Certified: Azure Data Fundamentals (DP-900), Astronomer Certification for Apache Airflow Fundamentals, dbt fundamentals.

All information you can see at my LinkedIn profile.

In 2011 I was 4th in the rating of students in mathematics in Ukraine.
Some company [2020-present]:
Current project: Having joined the team as data engineer for two years now, I grew up to the position Team Lead, so for 9 months now I’ve been leading the team and migration for legacy products into brand new platform. Moreover, my responsibilities included delivering releases on time, team planning using OKRs, hosting all discussions, maintaining ETL and creating new validation areas for customers, supporting legacy applications, participating into on-call activities.
Tech stack: AWS, MSSQL, T-SQL, MySQL, Java, ASP.NET, F5, DataDog, Splunk, Gerrit, PowerShell, project specific language to validate data.

Previous project: My main responsibilities included developing and maintaining DWH, ETL, CI/CD pipelines, generating test data based on customer needs, sustaining support activities.
Tech stack: Azure, MSSQL, T-SQL, Python, Apache Airflow, Jenkins, Docker.
------
My way was started from IT Academy in 2019, then the job offer was received. I was immersed into DW techniques and methodologies, practiced with MSSQL, Power BI, built and deployed SSIS packages. I learned how to operate with Oracle, PostgreSQL, MongoDB and Vertica.
I’m eager to be challenged in order to grow and further enhance my skills related to databases (RDB's and NoSql) and Scala development. So, if company is not promoting and offering professional growth I will not join the team.
Position: Senior Data Engineer
Category: Data Engineer
Experience: 8 years | English: upper


The main stack: Snowflake, AWS, MS SQL Server,  Git, Bitbucket, Kibana, Jenkins, TFS, PostgreSQL, PowerShell, SSIS

Was involved in developing of different OLTP/ETL projects on Snowflake and MS SQL stack as Tech Lead

Currently, Team Lead in Data Engineering team

Ready to grow up in data-related technologies (Azure Database, AWS stack, Spark, Python)
Several technologies related to DB development and opportunity to work with cloud stack (AWS stack, Snowflake, Azure Database for ex.)
Small team
Ideally - product company
Main responsibilities is development 
Clear requirements for development
Career opportunities
Possibilities to change development processes
Position: Senior Data Engineer, Architect
Category: Data Engineer
Experience: 11 years | English: fluent

– Built mobile app Analytics SDK with 20M DAU (daily active users) sending 1B+ events. 
– Built analytics function and key data models in 1500+ ppl company (team, architecture, data modeling for CRM, SaaS, sales/finance, growth forecasting, product analytics, machine learning use cases).
Built analytics function in 4 companies: 2x as an employee, 2x as a consultant. 
– 6 years in the data and analytics space (engineer, architect). 
– 6 years as a full-stack software engineer before that.

Implemented in production:
– Designed analytics data stack and architecture (2 large projects).
– Created data models for SaaS analytics, product analytics, usage behaviour analytics, growth forecasting, marketing and lead pipeline, finance. 
– Built analytics teams (from 2 ppl to 20).

I value:
– good communication, measurable outputs
– code quality, source control, CI/CD
– data model performance, data quality testing
– repeatable data pipelines, proper snapshotting
– planned and well-communicated data migrations
Ideal company: 
– SaaS startup which needs help building dbt SQL data models. 
– Looking for full-time or part-time remote data modeling jobs.

Preferred tech stack: 
– ELT, Fivetran/Stitch, dbt, Snowflake, SQL.
Position: Senior Data Engineer (Azure / MS SQL / DB / DWH / ETL / BI)
Category: Data Engineer
Experience: 11 years | English: intermediate


Data Engineer with more than 15 years of overall commercial experience in IT, including Data Engineering, Support Engineering, 1C development, and System/Database Administration. Solid knowledge of developing solutions using Business Intelligence, ETL, and DWH. Has experience in troubleshooting and resolving database problems. Always willing to learn new tools and technologies. Responsible, detail-oriented, and results-driven team player with good organizational skills.

Certified Azure Data Engineer.
Position: Senior Data Engineer / BI Engineer
Category: Data Engineer
Experience: 5 years | English: fluent

Google Cloud Certified Professional Data Engineer
Google Cloud certified professional Data Engineer with more than 2 years of hands-on experience in developing ETL processes and modeling DWH with cloud-based and on-prem solutions. 

Active skills:
- Cloud providers: GCP, AWS
- Programming languages: Python, shell, JS (Google AppsScript), R
- BigData technologies: Hadoop, HCFS (GCS, S3), Spark, Cassandra, MongoDB, Hive, Google BigQuery, Zeppelin
- Data streaming: Apache Kafka, Cloud Pub/Sub
- ETL: Google Cloud Dataflow, Talend solutions
- Pipelines orchestration: Apache Airflow
- Business Intelligence: Google Data Studio, Tableau, Google Sheets, BusinessObjects, Looker
- Machine Learning models deployment: Kubeflow, Cloud ML Engine
- Data Science basics: Supervised/Unsupervised models (mainly with sklearn), Deep Learning (Tensorflow, Pytorch), Natural Language Processing (bert large models, text classification), models tuning (GridSearch)
Looking for a part-time project as a Data Engineer or Data Analyst
Position: Senior Data Engineer, BI Engineer, Database Developer
Category: SQL
Experience: 11 years | English: upper

Performance tuning that achieved to optimize long-running queries from several hours to several minutes
I have 22 years of experience as a Software Developer, primarily in databases technologies (OLAP, data warehouse, OLTP, BI, ETL, database design performance tuning). 
I had been taking part in several projects as Senior Software Developer, including projects based on large data warehouse (terabytes of data).
I took part in all development stages: from discussing requirements with customer and designing requirements specification to the end software and its maintenance. I was responsible for logical design of database, development, deployment, maintenance, database administration, designing user interface, analytical reports development, data analysis, users’ support.
Good problems solving and analytical skills and independent development, quick learner.
Looking for project with large amount of data.
Flexible work schedule.
Remote work.
Position: Senior Data Engineer (big data, back-end)
Category: Data Engineer
Experience: 5 years | English: fluent

Through two successful stack migrations, I have honed my ability to learn new technologies at an impressive pace, taking just 0.5 months instead of the typical 1 month timeframe. My passion for rapid skill acquisition has resulted in a diverse skillset, enabling me to adapt to ever-changing technology landscapes with ease.

I have also taken the initiative to create a comprehensive project on-boarding guide for newcomers. This guide, which covers everything from opening their laptop to making their first commit to the corporate repository, has led to a remarkable increase in project involvement speed. The average time frame has been slashed from 2 months to just 1 month, resulting in significant improvements in productivity.

Additionally, I have developed a Proof of Concept (POC) titled "Spark: Comparison of data storage formats", which has increased overall productivity by an average of 20%. My dedication to innovation and efficiency has been a driving force behind my accomplishments, and I am always eager to tackle new challenges and push boundaries.
With a wealth of expertise spanning 5 years, I have successfully implemented Big Data solutions for leading retailers and media companies in the United States. This includes the development of projects from scratch, building of data pipelines with batch and stream processing, and adjustment of infrastructures while integrating external systems. My proficiency in Scala, Python, and Spark stacks based on GCP, AWS, and Airflow have enabled me to deliver tailored solutions that meet my clients' unique needs.

My skills extend beyond Big Data, with experience in Back-End IoT software systems utilizing Scala stacks and developing low-level protocols. I have also amassed 8 years of experience in electronic devices, further bolstering my technical expertise.

Mentoring engineers comes naturally to me, and I take pride in developing the next generation of experts. I have received positive feedback from my teammates, who acknowledge my contributions as a collaborative team player.
Preferable main languageы Scala, Python.
Nice to have: IoT, HealthCare domains
Position: Senior Data Engineer / Data Architect
Category: Data Engineer
Experience: 11 years | English: fluent

Microsoft Certified Solutions Expert (MCSE): Data Platform
Microsoft Certified Solutions Expert (MCSE): Data Management and Analytics
Microsoft Certified: Azure Data Engineer Associate
Certified Scrum Master (PSM I)
Databricks Introductory Learning
11+ years of experience in data engineering. Strong experience in data modelling, data migration, data warehouses/lakehouses, ETL, performance troubleshooting & tuning. Able to work in a team or independently. Have experience in mentoring junior developers, performing technical interviews, presales and audits. Able to participate in full cycle of data integration from source data to end user report.

I mostly focus on Microsoft BI stack (SQL Server, SSRS, SSIS, PowerBI) and Azure Cloud (Synapse, Data Lake, Delta Lake, Data Factory, Databricks, SQL DB). I am certified in Microsoft Data Platform as well as in Azure Data Engineering.

Right now located in Turkey while working through Ukrainian business entity (private entrepreneur).
- A technical role, not people management role;
- Projects with MS BI and especially MS Azure stack;
- An opportunity to get familiar with new technologies;
- Projects that are not on the phase of support or testing;
- Not interested in opportunities with on-call support, shifts, etc.
- Remote only;
Position: Senior Data Engineer / DB Developer
Category: SQL
Experience: 11 years | English: intermediate


I'm professional Database developer with 15+ years of experience in IT industry.
All time I'm looking for interesting projects and always ready to non-standard challange/solutions.
I expect the long-term relationship with my clients and I will be glad to provide the qualify services in the term-of.

I'm experienced in:
1. Database development and design:
	- MS SQL Server, MySQL, PostgreSQL, Amazon Redshift, MongoDB, Cassandra, SnowFlake, BigQuery;
	- Index tunning, query optimization, performance optimization;
	- Database design;
	- Stored Procedures, Functions, Triggers, Views etc.;
	- T-SQL;	
2. Python:
        - Machine Learning (OpenCV, Keras, NLP);
	- Web scraping (Scrapy, BeautifulSoup, Selenium, XPath);
	- Web development (Django Rest Framework, Flask);
	- Data processing/ETL (CSV, Excel, Pandas, NumPy, SciPy, PySpark);
	- Other (GZip, Celery, SQLAlchemy, Redis, Multi-Threading, Regular Expression, RESTful, JSON etc.);
3. ETL development:
	- Python, Matillion;
	- MS Integration Service (SSIS);
        - Apache NiFi;
        - Talend;
        - Airflow;
        - Azure Data Factory;
4. BI (Business Intelligence) and tools:
	- QlikView, Tableau, Power BI, MS Reporting Service (SSRS);
5. Other:
	- Google Cloud Services;
	- Amazon Web Services, S3, EC2;
        - Miscrofost Azure;
Position: Senior Data Engineer / DevOps
Category: Data Engineer
Experience: 5 years | English: fluent

Ported CI/CD workflows for building containers from bitbucket pipelines to aws codebuild

Developed and deployed data pipeline 
"incoming webhooks -> snowflake" using AWS Api gateway, SQS, Lambda, Kinesis datastream/firehose, snowpipes.

Implemented a feature for an internal tool that allows it to build data warehouse replica containers for both amd64 and arm64 architectures.
Data Engineer/DevOps (ad-tech domain) 
Apr 2022 - present
Working with internal tools to support analytics team Main such tool was a sampling engine to create Snowflake sampled replicas in a form of a Postgres container for local work.
Deploying cloud infrastructure on AWS using terraform. Services used: S3, IAM, Lambda, Kinesis, Kinesis Firehose.
Developing containerised ETL jobs to move data from anywhere to snowflake dwh using snowpipes.
Implementing CICD for purposes of testing and building containers.
Working on snowflake stored procedures used for compliance with PII related regulations.
Performing admin-related Snowflake tasks (roles, schemas, integrations) using Schemachange

Data Platform Engineer, contract, (retail) Apr 2023
Architecture planning (GCP: Cloud Run Jobs, Bigquery, Looker, Pub/Sub; Other: DBT, Slack integrations, Google Sheets integration).
Deployment of the above (Terraform).
Porting workflows from excel reports to the cloud.
Training staff on working on this platform.

Data Engineer  Nov 2020 - Apr 2022
Developing python scripts for semi or complete automation of data collection and preparing for ingestion into proprietary system using various sources.
Financial data sets analysis.
Writing and maintaining documentation of implemented solutions and user workflows.
Communication with customer’s stakeholders, clarifying task requirements and making changes according to business needs.
Communication with data providers across the globe
 New employee onboarding

Data Analyst Mar 2018 - Nov 2020
Developing regular and ad-hoc reports in Excel and Power BI
Establishing data pipelines for automated reporting
MSSQL DB administration
Power BI server management
Position: Senior Data Engineer or Python Developer or/and Database Developer/Consultant or/and Tech Lead
Category: Python
Experience: 11 years | English: intermediate

15+ years of development experience; Over 25 successful projects were in areas: software R&D, Internet-portal, bank, stock exchange, wholesale / retail trade, logistics, warehouse;

Ability to learn complex technical material and troubleshooting complex problems; Ability to work independently; Willingness to learn new skills; Interest in technical progression and growth; 10-finger method skill;
* Data modelling, Designing DB schemes
* Google Cloud Platform (GCP, BigQuery, Storage)
* Python, Linux, Git, PostgreSQL, Apache Airflow
* SQL, MySQL, Oracle PL/SQL, T-SQL 
* OOP, API, XML, JSON, Backend, HTML, CSS 
* ERP, CRM, ETL, DWH (data warehouse), BI
Adequate management. Professional growth.
Position: Senior Data Engineer (Python)
Category: Data Engineer
Experience: 5 years | English: fluent

*AWS and Microsoft certifications
*Coordinated DE students' education stream: interviewing, mentoring, and guiding other mentors
*Reimplemented the ETL logic to improve the data quality and performance of the scripts (f.e. from ~20 minutes to ~1,5 minutes)
*Automated the deployment process of a few applications on the last project
Data Engineer with 5 years of versatile experience. Performed a wide variety of tasks: wrote SQL, Python, and Java code;
designed database structures; have some experience with CI pipelines configuration; created Terraform scripts (IaaC tool).
Have solid experience with AWS cloud. Achieved Microsoft and AWS certifications.
Apart from that, constantly participate in non-project activities.

# Analytics Platform
• Wrote Python and Java code for processing data for the analytical models
• Worked with AWS: Aurora, EC2, Lambda, Step Functions, Cloud Watch, ECR, IAM, S3, and other services
• Supported existing data load process from external sources to the database
• Created Terraform scripts
• Configured Concourse pipelines
• Led a subteam
• Communicated with POs and other teams
• Wrote documentation for the project components and processes

# Applications for USA banks
• Developed and managed MS SQL Server database objects (tables, stored procedures, views, etc.)
• Created new reports and provided performance tuning and query optimization for existing reports
• Analyzed existing ETL (SSIS) and worked on ETL reimplementing
• Constantly communicated with stakeholders
• Took part in grooming, planning, and estimating new features

# Healthcare application
• Developed backend logic for applications using T-SQL and custom framework
• Reimplemented existing reports to improve performance
• Created database objects (tables, stored procedures, functions, etc.) for reports and applications
• Communicated with the customers to clarify business logic for the new features
• Used SQL Server Agent jobs
Highest priority: Python
Would be great: Cloud (preferably AWS)

Do not consider companies that work in the RU domain
Position: Senior Data Engineer(Python)
Category: Data Engineer
Experience: 8 years | English: upper


More than 8 years of experience in developing projects in various fields, such as Big Data/ETL/Data mining, Blockchain, Web Dev.
Worked in startups, product company and leading outsourcers.

Key technical skills and technologies: Python, Kafka, Airflow, PySpark, AWS Serverless Stack(Lambda, Step Function, Fargate, Athena, RDS etc)
Databases: PostgreSQL, Snowflake, Elasticsearch
Frameworks: Django, Flask, Falcon, aiohttp, Scrapy
DevOps tools: Jenkins, Octopus, Jfrog, AWS Codebuild, Docker
Paradigms and concepts: microservices architecture, event-driven applications, serverless, micro batching
Full remote, work-life balance, flexible working hours, lack of unnecessary meetings
Position: Senior Data Engineer (Scala)
Category: Scala
Experience: 9 years | English: upper


I have extensive experience with BigData and cloud, especially in performance tuning and optimizing data pipelines.
E.g. on my current project in last 2 years:
I built all the infrastructure for Aiflow(MWAA) + EMR in AWS.
Rewritten and optimized all data pipelines.
Which resulted in cost savings on AWS infrastructure more than 20k USD per month.
Wrote the POC and moved all configs we have to Vault. Configured and introduced a staging environment (before we had only prod).
Wrote a POC to sync data from GCP(BigQuery) to AWS.

Used technologies:
• Scala, Python, Java
• AWS (S3, Redshift, EC2, EMR, MWAA, Lambda, RDS, SQS, Athena, Glue)
• GCP (BigQuery, GCS, PubSub)
• Akka, Play
• Cats, Cats Effect, Shapeless
• ScalaTest, ScalaMock, Mockito, Cucumber
• Sbt, Maven, Gradle
• Postgres, Cassandra, MongoDb, Oracle, SqlLite, MSSQL
• Spark, DeltaLake, Presto, Druid, Hive, Impala, Zookeeper
• Etcd, Vault
• TeamCity, Jenkins
• Kafka, RabbitMQ
• ELK, Grafana, Prometheus, Graphite
• Ansible, Terraform
• Airflow, Luigi
• Docker, Kubernetes
For last 3 years working in startups