Clean up directory with a working base