Big Data Engineer Skills: Knowledge of Hadoop ecosystem and different frameworks inside it – HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and Kafka. Real-time processing Framework (Apache Spark) Database architectures. SQL-based technologies (e.g. MySQL/ Oracle DB)