Generally it is a good idea to do this. You don't want a situation where the queen gets stuck on the wrong side of an exluder and the cluster goes up above the exluder to eat honey and the queen freezes. I generally however overwinter in brood boxes. Supers are for honey - brood boxes are for bee survival.