Question: what is the difference between a wide and a narrow dependency in an rdd?
Answer: The distinction between narrow and wide is more subtle: With wide dependency each child partition depends on each partition of its parents. ... With narrow dependency each child partition depends on at most one partition from each parent. It can be either one-to-one or many-to-one relationship.