ScrollWidget: Don't add more than 1 callback for scroll_up

This should hopefully finally solve the wrong scrolling.