Some hardy annual plants can withstand light frost and temperatures below freezing. Hard freezes, however, tend to be much harder for even tough annuals to withstand. Sturdy, cool weather plants like sweet peas may be able to tolerate temperatures as chilly as 25F, but most annuals die back when temperatures drop below freezing.