[Scheduler] Remove temporary directories used to build app