Add auto clean up of temp dirs, per config/scope