Properly offset the buffer limit from the position.