Bug Fix: In yarn-cluster mode, ApplicationMaster does not clean up correctly at the end of the job if users call sc.stop manually