txn_btree: add another test case for rsearch