Remove directory that was added by mistake.