Visible deterioration, such as cracks, holes, or decay, as well as water damage or leaks, indicates that it is time to replace soffits and fascia. Furthermore, if your soffits and fascia are outdated or deteriorating, it may be time to replace them. Additional signs include increasing insect activity or poor ventilation.