If you want to keep a bottle cold in a diaper bag, you can place it on a small, sealed bag of ice or use a specialist ice pack. Make sure you pick a diaper bag designed to offer insulation, even if it is just in one section.