Actually put docs into the replica_queue