Remove directory that doesn't even exist