It's recommended to remove all old roofing material before installing a new roof. This ensures a clean and stable surface for the new roof and allows for proper inspection of the roof deck for any underlying issues.