Keep track of scroll position.
Keep scrolling to the end of the buffer if starting there.