If the cover is made of a light material and the ice and snow are heavy enough, this is possible, but not likely. Windshield covers are designed to be lightweight yet durable.  If you have a particularly hard layer of ice or a thick layer of snow, gently roll the cover away from the windshield until it is completely removed.