Position: Middle Data Engineer
Company: Avenga
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2022-08-01T00:00:00+03:00

As a Cloud Data Engineer, you will play a key developer and/or tester role on a global program working with senior business leaders, product owners and technology teams to deliver a new technology platform to support Client strategy.

Working as a practitioner/engineer in the Data landscape, you will need to utilize your experience of working in Cloud application and/or infra engineering to assist with the engineering aspects, design, definition, exploration, and delivery of the end-to-end solution to service a scaling global Investment Management business. If you are interested in developing your career with us, get in touch with us today! We’ll be happy to have you on board!

**What you bring along:**
3+ years of total professional experience;
Deep expertise in Python and SQL;
Strong analytic skills related to working with unstructured datasets;
Knowledge and practical experience with AWS serverless services:
Understanding of IaC concepts and hands-on experience with one of such tools (Terraform and/or CloudFormation);
Understanding of containers – Docker/Kubernetes, Cloud build/deploy;
Understanding of cloud-based MPP processing and experience with at least one of such tools (Azure Synapse, BigQuery, Redshift, or Snowflake);
Practical knowledge of data extraction methods from various sources (especially API);
Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and continuously identify opportunities for improvement;
Experience in software delivery in Agile methodologies;
English – Upper-intermediate or higher.

**This is your mission:**
Write code for delivering functional stories, and test cases, and create CI\CD pipelines using the AWS platform;
Configure environment using proper security rules, infra configuration scripts, and provide monitoring capabilities;
Build and optimize data pipelines, architecture, and data sets supporting data transformation, data structures, metadata, dependency, and workload management;
Design data storage layer for both data lake and data warehouse.

**Nice to have:**
Experience with AWS services such as EMR, Glue, Redshift, Kinesis, MWAA(Airflow);
Hands-on exp with a few of the DevOps tools like Jenkins, etc;
Knowledge of UNIX- based systems;
Understanding of financial domain or previous experience in this area;
Experience in delivering data-related Non-Functional Requirements like:
Dealing with large volumes of historical data across markets/geographies;
Manipulating, processing, and extracting value from large disconnected datasets;
Generic handling of standard business scenarios in case of missing data, holidays, out-of-tolerance errors, etc.

**Your benefits:**
Flexible remote policy;
Reimbursement of education and certification;
Medical and sports services compensation;
Paid out of reach, sick days and public holidays;
Language school on site; 
Accounting and legal support.