Yes, you can. At the same time, it is very important to inform your tour manager about your plans and the changes you wish to make to the itinerary, right at the beginning. Also, you would be solely responsible for your safety and for bearing the expenses arising out of these arrangements.