Reference count the buffer memory.