Only adjust pad/margin when scrollbar size is > 0