Don't update the coordinates if scrolling in its direction is disabled

This fixes an issue in which padding to the ScrollView is removed on scroll.