There is no problem but please let your guide know so he/she doesn’t wait for you at the next stop.