Only fetch replies for messages that need ACK