Most kids will start trick-or-treating around age 3 or 4. Since babies and toddlers may be scared by some masks or decorations on Halloween night, it might be a better idea to hand out candy with them or take them to a fall festival where they can show off their costumes. Most candy given out on Halloween is a choking hazard for babies and toddlers.