Manually update scroll position of line number groups to save overhead
Update line groups when insertions/removals occurred above