Question: what is the difference between hadoop 2 and 3?
Answer: Hadoop 2 supports single active NameNode and single standby NameNode for the entire Namespace while Hadoop 3 works with multiple standby NameNodes. Spark runs Driver Program on the master node which manages SparkContext.