When you travel with kids, planning makes the difference between having fun, having no fun, and mopping up a big mess. There is nothing wrong in going out to have fun, but don't over-schedule the time so that no one has fun. Picking up rocks is fun. They are the bones of our Mother Earth. Let's talk physiology and human nature.
Infants have to be carried.
Infants generally require different feeding arrangements. Easier said than done in the wilds. If you are not bottle feeding, remember that means that Momma has to have extra fluids, too. Infants are just as curious as any other age group, and what makes them dangerous is that they have to be watched at all times. This should be standard operating procedure at home, but in the hills it is imperative.