Leaving them on may cause the roof to fail prematurely. It also violates building codes. ARS bids include tearing off and properly disposing of all layers of the old roof.