do not allocate buffers if stream unused (rgb or ir)