No. Since colicky babies already have stomach troubles and premature babies have underdeveloped digestive systems, it is best not to give them goat milk. They should not be fed with anything other than breast milk.