Move up rma_buf access functions

before we use them.