When making infant formula milk, the right water can make all of your jobs easier. According to the NHS, you should use boiled water that has been cooled down until it is lukewarm before adding it to your formula milk powder. This is because unfiltered or untreated water can contain harmful bacteria that can cause food poisoning in babies.