Yes, frost buildup is bad for a freezer. With a dense layer of ice, the device ceases to fulfil its main purpose and may even break.