Delete non-source directories