Pregnant women, newborns, the elderly, and individuals with weakened immune systems (such as those with HIV/AIDS or undergoing cancer treatment) are at higher risk of developing severe forms of listeriosis.