Position: Data Engineer with AWS+Snowflake, Banking System
Company: DataArt
Experience required: 3y
Category: Data Science
English level: intermediate
Published: 2020-08-01T00:00:00+03:00

DataArt's experts together with developers on the client's side are creating new banking apps and upgrading the old ones.

The Data Engineer will be a part of the data engineering community to deliver opportunities to support the organization’s strategic direction. The specialist will use Data Lake, Data Science, and Streaming technologies to help shape the data flow and architecture of large programs of work like Customer Due Diligence.

Responsibilities
- Modelling, sourcing, and transforming data in order to drive value for the customer
- Formulate the automation of data engineering pipelines through the removal of manual stages using DevOps tools
- Evaluate the knowledge of the bank’s data structures and metrics, implement changes if needed in order to allow the development of the solution
- Deliver data engineering strategies to build a scalable data architecture and customer feature-rich dataset for data scientists
- Drive DevOps and Agile practices in the delivery of data engineering
- Develop solutions for streaming data ingestion and transformations in line with the streaming strategy

Must have
- Advanced level in software engineering (Python)
- Good knowledge in Data/Big Data theory
- Intermediate level in Data Platforms (SQL, RDBMS, NoSQL)
- Advanced level in Big Data Platforms (Hadoop)
- Intermediate level in Data Integration (ETL/ELT, data pipelines)
- Spoken English

Would be a plus
- Experience in AWS
- Experience in Snowflake
- Experience with Java\Scala
- Experience with Apache Spark

Learn more about our policy of equal opportunities in employment