I do not cover them while I cook them.  Each oven bakes differently based on size, brand, climate, elevation, etc.  If you find the zucchini boats getting too browned then you can pop a piece of foil over them loosely to protect them from further browning for the remainder of the cook time.