Delete configurations that we aren't using