Remove modify message by reference when enqueueing