Position: Senior Data engineer (IRC162712)
Company: GlobalLogic
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-08-01T00:00:00+03:00

**Job Description**
 
**Must have**

- Working experience of Hadoop;
- Knowledge of any programming language (ex: Java, Scala or any OOP language);
- Knowledge and experience of Python & Spark;
- Knowledge and experience of writing ETLs in Scala;
- Database fundamentals;
- Efficient in SQL;
- Experience of working on AWS  - EC2, EMR. S3;
- Expert in the following 3rd Party Tools - BitBucket, OpenVPN, Artifactory, JIRA, Confluence;
- Good understanding of SDLC life-cycle (Dev, test, preprod, production and the CI/CD pipeline);
- Agile technologies (Git, Gradle/Maven, Jenkins, TDD).
 
**Job Responsibilities**
 
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud-based ‘big data’ technologies from AWS.
- Create tool-chains for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data and models devOps (dataOps) architecture is consistent throughout ongoing projects.
- Create and maintain optimal data and model data Ops pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

**Department/Project Description**
We are looking for a Data Engineer for the financial project, providing asset management for institutions to help them select their investment strategies. In this position, you will be part of our “Business Intelligence and Reporting Team”. The successful candidate will be responsible for the planning, design, implementation and maintenance of data driven solutions in AWS along with SaaS. It is a great chance to become a part of a distributed, cross-functional team based in Poland. This Project is a part of the Multi-Year Program Plan.

**Skill Category**
Data Science
**Keyskills - Must Have**
Hadoop Java Scala Python Spark Database AWS SQL
**Keyskills - Nice to Have**
BitBucket Artifactory JIRA Confluence