Before revision:  To verify this, we propose a segment-aware BERT , by replacing the token position embedding of Transformer with a combination of paragraphindex, sentenceindex ,  and token index embeddings.
After revision:  To verify this, we propose a segment-aware BERT , by replacing the original token position encoding with a combined position encoding of paragraph , and token index embeddings.