Remove unnecessary working directory changes