If you want, you can save scum at the very beginning to get the caravaners to max disposition, but that's overkill, in my opinion. You will reach a point where you have so much gold that the travel costs no longer matter.