Remove the unnecessary directory