Allocate buffers when the data empty so that downstream operators do not fail in VV transfer