Infants and young children are at greatest risk of colds, especially if they spend time in child care settings. Weakened immune system. Having a chronic illness or otherwise weakened immune system increases your risk.