Yes, you should knock icicles off your gutters. Icicles are a sign that an ice dam is forming, and the weight of the icicles can damage your gutters. But be sure to do it safely. Use a broom or brush, and never stand on a ladder while knocking icicles off your gutters.