Remove unused temporary directory