Position: Data Engineering Lead
Company: Intellias
Experience required: 5y
Category: Scala
English level: upper
Published: 2020-08-01T00:00:00+03:00

The Application & Infrastructure Team is a L2/L3 unit, that is responsible for task-force activities, in response to most deep and complex issues, that cannot be resolved on L1 level, their analysis, resolution and continuous applications, facilities and services improvement and hardening, in proactive, long-term-envisioned and efficient way. The key is business continuity enforcement, historical and potential issue analysis and classification, countermeasure planning, implementation and deployment.

**Technical Skills**
- More than 5 years of IT Experience;
- Experience with Cloud Platforms (Azure or AWS or GoogleCloud) (experience with Azure Data Factory and Data Catalogue will be a big plus)
Must have experience with one of RDBMS (MSSQL, Oracle, Postgres, MySQL)
- Solid experience with one of the ETL tools (SSIS, Informatica, Talend or other)
- Experience with data modelling.
- Familiar with BigData stack (Hadoop, Spark, Kafka, etc)
- Familiar with NoSQL (CosmosDB, Cassandra, etc)
- Experience with any report/visualization tool will be a plus
- Experience coding in Java, Python, Scala, UNIX Shell
- Working experience with Hive, Spark and Oozie  jobs
- At least 2 years’ leadership experience
 

**Responsibilities**
- Documenting data governance processes and procedures
- Cataloguing and publishing coverage of data functionality
- Building ETL pipeline on the existing data lake
- Creating and support of a reporting system with integration with data visualization tools (Power BI)
- Optimization of data queries
- Perform cutover data migrations
- Propose, implement systems and support enhancements and process improvements;