Remove old solution file and folder