Position: Data engineer
Company: GlobalLogic
Experience required: 2y
Category: Data Engineer
English level: intermediate
Published: 2022-08-01T00:00:00+03:00

You will be responsible for the planning, design, implementation and maintenance of data driven solutions in AWS along with EMR SaaS. It is a great chance to become a part of a distributed, cross-functional team based in Poland.

Requirements:

Experience in working on AWS  – EC2, EMR, S3;
Solid experience in Terraform;
Knowledge and experience of Python & Spark;
Experience in EMR configs, IAM policies, observability;
Expert in the following 3rd Party Tools – BitBucket, OpenVPN, Artifactory, JIRA, Confluence;
Good understanding of SDLC life-cycle (Dev, test, preprod, production and the CI/CD pipeline);
Agile technologies (Git, Gradle/Maven, Jenkins, TDD).

Job Responsibilities:

Work with Data Lake on Cloud.
Create tool-chains for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data and models devOps (dataOps) architecture is consistent throughout ongoing projects.
Create and maintain optimal data and model data Ops pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.