Panels need to be replaced when structural damage has occurred. Large dents, gashes, holes in the door and bends in the panels are all reasons to replace a garage door's panels. Garage door replacement is a major repair and is generally not utilized to fix minor defects, like scratches.