Position: Data Engineer, Investment Management Solution
Company: DataArt
Category: Data Engineer
Experience required: 3y
English level: intermediate

The project is a Single Source of Truth for investment management data and investment analysis solution that will aggregate and process data from multiple data feeds and systems like stock exchanges, news feeds, and others. The development is just started.

Requirements
Experience working with Hadoop (HDFS, MapReduce, HBase)
Hands-on experience with Shell scripting
Hands-on experience with Spark 2.0 or greater (+ Scala)
Strong experience with SQL
Spoken English

Nice to have
Experience working with Hive And Impala
Experience working with Apache NiFi
Experience working in an agile environment and understanding of various phases of the software development life cycle
Experience with Data modelling
Skills working with Airflow (preferred) or Oozie
Experience with CDP (Cloudera Data Platform)
Knowledge of Hadoop architecture components