Yes please remove this piece of plastic when installing your lights.  (Not all solar lights will have this plastic cover)