Remove configuration directories when clearing