Clean up solution configurations