Only allow selected formats for shared memory buffers