Original: L EARNING TO CROSS EXCHANGE TO SOLVE MINMAX VEHICLE ROUTING PROBLEMS
Revised: L EARNING TO CROSS EXCHANGE TO SOLVE MINMAX VEHICLE ROUTING PROBLEMS

Original: Anonymous authors
Revised: Anonymous authors

Original: Paper under double-blind review
Revised: Paper under double-blind review

Original: A BSTRACT
Revised: A BSTRACT

Original: CROSS exchange (CE), a meta-heuristic that solves various vehicle routing problems (VRPs), improves the solutions of VRPs by swapping the sub-tours of the vehicles.
Revised: CROSS exchange (CE), a meta-heuristic that solves various vehicle routing problems (VRPs), improves the solutions of VRPs by swapping the sub-tours of the vehicles.

Original: Inspired by CE, we propose Neuro CE (NCE), a fundamental operator of learned meta-heuristic, to solve various min-max VRPs while overcoming the limitations of CE, i.e., the expensive O ( n 4 ) search cost.
Revised: Inspired by CE, we propose Neuro CE (NCE), a fundamental operator of learned meta-heuristic, to solve various min-max VRPs while overcoming the limitations of CE, i.e., the expensive O ( n 4 ) search cost.

Original: NCE employs graph neural network to predict the cost-decrements (i.e., results of CE searches) and utilizes the predicted cost-decrements to guide the selection of sub-tours for swapping, while reducing the search cost to O ( n 2 ) .
Revised: NCE employs graph neural network to predict the cost-decrements (i.e., results of CE searches) and utilizes the predicted cost-decrements to guide the selection of sub-tours for swapping, while reducing the search cost to O ( n 2 ) .

Original: As the learning objective of NCE is to predict the cost-decrement, the training can be simply done in a supervised fashion, whose training samples can be easily collected.
Revised: As the learning objective of NCE is to predict the cost-decrement, the training can be simply done in a supervised fashion, whose training samples can be easily collected.

Original: Despite the simplicity of
Revised: Despite the simplicity of

Original: NCE, numerical results show that the NCE trained with min-max flexible multidepot VRP (min-max FMDVRP) outperforms the meta-heuristic baselines.
Revised: NCE, numerical results show that the NCE trained with min-max flexible multidepot VRP (min-max FMDVRP) outperforms the meta-heuristic baselines.

Original: More importantly, it significantly outperforms the neural baselines when solving distinctive special cases of min-max FMDVRP (e.g., min-max MDVRP, min-max mTSP, min-max CVRP) without additional training.
Revised: More importantly, it significantly outperforms the neural baselines when solving distinctive special cases of min-max FMDVRP (e.g., min-max MDVRP, min-max mTSP, min-max CVRP) without additional training.

Original:  I NTRODUCTION
Revised:  I NTRODUCTION

Original: The field of neural combinatorial optimization (NCO), an emerging research area intersecting operation research and artificial intelligence, aims to train an effective solver for various combinatorial optimization (CO) problems, such as the traveling salesman problem (TSP)
Revised: The field of neural combinatorial optimization (NCO), an emerging research area intersecting operation research and artificial intelligence, aims to train an effective solver for various combinatorial optimization (CO) problems, such as the traveling salesman problem (TSP)

Original: (Bello et al., 2016;
Revised: (Bello et al., 2016;

Original: Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020), vehicle routing problems (VRPs) (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020; Hottung & Tierney, 2019;
Revised: Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020), vehicle routing problems (VRPs) (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020; Hottung & Tierney, 2019;

Original: Lu et al., 2019; da Costa et al., 2021), and vertex covering problems (Khalil et al., 2017; Li et al., 2018;
Revised: Lu et al., 2019; da Costa et al., 2021), and vertex covering problems (Khalil et al., 2017; Li et al., 2018;

Original: Guo et al., 2019).
Revised: Guo et al., 2019).

Original: As NCO tackles NP-hard problems using various state-of-the-art (SOTA) deep learning techniques, it is considered an important research area in artificial intelligence.
Revised: As NCO tackles NP-hard problems using various state-of-the-art (SOTA) deep learning techniques, it is considered an important research area in artificial intelligence.

Original: At the same time, NCO is an important field from a practical point of view because it can solve complex real-world problems.
Revised: At the same time, NCO is an important field from a practical point of view because it can solve complex real-world problems.

Original: The current study mainly focuses on VRPs, a type of CO problems.
Revised: The current study mainly focuses on VRPs, a type of CO problems.

Original: Majority of learning-based VRP solvers learns to improve the current solution to obtain a better solution (i.e., improvement heuristics) (Hottung & Tierney, 2019;
Revised: Majority of learning-based VRP solvers learns to improve the current solution to obtain a better solution (i.e., improvement heuristics) (Hottung & Tierney, 2019;

Original: Lu et al., 2019; da Costa et al., 2021) or construct a solution sequentially (i.e., construction heuristics) (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020; Park et al., 2021;
Revised: Lu et al., 2019; da Costa et al., 2021) or construct a solution sequentially (i.e., construction heuristics) (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020; Park et al., 2021;

Original: Cao et al., 2021).
Revised: Cao et al., 2021).

Original: To learn such solvers, learning-based methods either employ supervised learning (SL), which imitates the solutions of the verified solvers, or reinforcement learning (RL), which learn a solver from the generated routes.
Revised: To learn such solvers, learning-based methods either employ supervised learning (SL), which imitates the solutions of the verified solvers, or reinforcement learning (RL), which learn a solver from the generated routes.

Original: Most NCO studies focus on the well-established “min-sum VRP” that aims to minimize the total traveling distance of vehicles, possibly because the benchmark problems and baseline algorithms are set up for the “min-sum VRP.”
Revised: Most NCO studies focus on the well-established “min-sum VRP” that aims to minimize the total traveling distance of vehicles, possibly because the benchmark problems and baseline algorithms are set up for the “min-sum VRP.”

Original: On the other hand, VRP with different objectives have not received much attention from the NCO community, even though they can model various practical scenarios.
Revised: On the other hand, VRP with different objectives have not received much attention from the NCO community, even though they can model various practical scenarios.

Original: For example, “min-max VRP” that aims to minimize the total completion time (i.e., makespan) of various time-critical distributed tasks (e.g., vaccine delivery, grocery delivery) has not been widely considered.
Revised: For example, “min-max VRP” that aims to minimize the total completion time (i.e., makespan) of various time-critical distributed tasks (e.g., vaccine delivery, grocery delivery) has not been widely considered.

Original: This study aims to learn a fundamental and universal operator that can effectively solve various practical “min-max VRP” that have flexible depot constraints.
Revised: This study aims to learn a fundamental and universal operator that can effectively solve various practical “min-max VRP” that have flexible depot constraints.

Original: To design an universal and simple, yet powerful operator, we utilize CROSS-exchange (CE) (Taillard et al., 1997), a local search designed
Revised: To design an universal and simple, yet powerful operator, we utilize CROSS-exchange (CE) (Taillard et al., 1997), a local search designed

Original: [Figure]
Revised: [Figure]

Original: to conduct the inter-operation of two routes (i.e., swapping the sub-tours of two selected routes) to reduce the traveling cost.
Revised: to conduct the inter-operation of two routes (i.e., swapping the sub-tours of two selected routes) to reduce the traveling cost.

Original: We noticed that the inter-operation of CE is especially effective in improving the quality of “min-max VRP” because it can consider the interaction among multiple vehicles, and effectively reduce the differences between the traveling distances of all vehicles.
Revised: We noticed that the inter-operation of CE is especially effective in improving the quality of “min-max VRP” because it can consider the interaction among multiple vehicles, and effectively reduce the differences between the traveling distances of all vehicles.

Original: However, the search cost for selecting the sub-tours from two trajectory is O ( n 4 ) where n is the tour length.
Revised: However, the search cost for selecting the sub-tours from two trajectory is O ( n 4 ) where n is the tour length.

Original: This make CE unapplicable to large scale VRPs.
Revised: This make CE unapplicable to large scale VRPs.

Original: In this paper, we propose Neuro CE (NCE) that effectively conducts the CE operation with significantly less computational complexity.
Revised: In this paper, we propose Neuro CE (NCE) that effectively conducts the CE operation with significantly less computational complexity.

Original: NCE amortizes the search for ending nodes of the sub-tours by employing a graph neural network (GNN), which predicts the best cost decrement, given two starting nodes from two given trajectories.
Revised: NCE amortizes the search for ending nodes of the sub-tours by employing a graph neural network (GNN), which predicts the best cost decrement, given two starting nodes from two given trajectories.

Original: NCE searches over only promising starting nodes using the prediction.
Revised: NCE searches over only promising starting nodes using the prediction.

Original: Hence, the proposed NCE has O ( n 2 ) search complexity.
Revised: Hence, the proposed NCE has O ( n 2 ) search complexity.

Original: Furthermore, unlike other
Revised: Furthermore, unlike other

Original: SL or RL approaches, the prediction target labels of NCE is not the entire solution of the VRPs, but the cost decrements of the CE operations (true target operator), which makes the collection of training data simple and easy.
Revised: SL or RL approaches, the prediction target labels of NCE is not the entire solution of the VRPs, but the cost decrements of the CE operations (true target operator), which makes the collection of training data simple and easy.

Original: The contributions of this study are summarized as follows:
Revised: The contributions of this study are summarized as follows:

Original: • Generalizability/Transferability: As NCE learns a fundamental and universal operator to solve various complex min-max VRPs without retraining for each type of VRPs.
Revised: • Generalizability/Transferability: As NCE learns a fundamental and universal operator to solve various complex min-max VRPs without retraining for each type of VRPs.

Original: • Trainability: The NCE operator is trained in a supervised manner with the dataset comprised of the tour pairs and cost decrements, which make the collection of training data easy and simple.
Revised: • Trainability: The NCE operator is trained in a supervised manner with the dataset comprised of the tour pairs and cost decrements, which make the collection of training data easy and simple.

Original: • Practicality/Performance: We evaluate NCE with various types of min-max VRPs, including flexible multi-depot VRP (min-max FMDVRP), multi-depot VRP (min-max MDVRP),
Revised: • Practicality/Performance: We evaluate NCE with various types of min-max VRPs, including flexible multi-depot VRP (min-max FMDVRP), multi-depot VRP (min-max MDVRP),

Original: multiple TSP (min-max mTSP), and capacitated VRP (min-max CVRP).
Revised: multiple TSP (min-max mTSP), and capacitated VRP (min-max CVRP).

Original: Extensive numerical experiments validate that NCE outperforms SOTA meta-heuristics and NCO baselines in solving various min-max VRPs, even though NCE is only trained with the data from min-max FMDVRP.
Revised: Extensive numerical experiments validate that NCE outperforms SOTA meta-heuristics and NCO baselines in solving various min-max VRPs, even though NCE is only trained with the data from min-max FMDVRP.

Original:  P RELIMINARIES
Revised:  P RELIMINARIES

Original: This section introduces the target problem, min-max flexible multi-depot VRP (min-max FMDVRP), and the CE operator, a powerful local-search heuristics that solves min-max FMDVRP.
Revised: This section introduces the target problem, min-max flexible multi-depot VRP (min-max FMDVRP), and the CE operator, a powerful local-search heuristics that solves min-max FMDVRP.

Original: 2. M IN - MAX FLEXIBLE MULTI - DEPOT VRP
Revised: 2. M IN - MAX FLEXIBLE MULTI - DEPOT VRP

Original: Min-max FMDVRP is a generalization of VRP that aims to find the coordinated routes of multiple vehicles with multiple depots.
Revised: Min-max FMDVRP is a generalization of VRP that aims to find the coordinated routes of multiple vehicles with multiple depots.

Original: The flexibility allows vehicles to go back to any depots regardless of their starting depots.
Revised: The flexibility allows vehicles to go back to any depots regardless of their starting depots.

Original: The min-max FMDVRP is formulated as follows:
Revised: The min-max FMDVRP is formulated as follows:

Original: [Equation]
Revised: [Equation]

Original: where P is the description of the min-max FMDVRP instance that is composed of a set of vehicles V , S ( P ) is the set of solutions that satisfy the constraints of the min-max FMDVRP (i.e., feasible solutions), and π = { τ i } i ∈ V is a solution of the min-max FMDVRP.
Revised: where P is the description of the min-max FMDVRP instance that is composed of a set of vehicles V , S ( P ) is the set of solutions that satisfy the constraints of the min-max FMDVRP (i.e., feasible solutions), and π = { τ i } i ∈ V is a solution of the min-max FMDVRP.

Original: The tour τ i =
Revised: The tour τ i =

Original: [ N 1 , N 2 , ..., N l ( i ) ] of vehicle i is the ordered collection of the visited tasks by the vehicle v i , and C ( τ i ) is the cost of τ i .
Revised: [ N 1 , N 2 , ..., N l ( i ) ] of vehicle i is the ordered collection of the visited tasks by the vehicle v i , and C ( τ i ) is the cost of τ i .

Original: Min-max FMDVRP can be used to formulate the operation of shared vehicles that can be picked
Revised: Min-max FMDVRP can be used to formulate the operation of shared vehicles that can be picked

Original: Input: VRP instance P , cost-decrement prediction model f θ , Perturbation parameter p
Revised: Input: VRP instance P , cost-decrement prediction model f θ , Perturbation parameter p

Original: Output: Optimized tours { τ ∗ i } i ∈| V | 1 { τ i } i
Revised: Output: Optimized tours { τ ∗ i } i ∈| V | 1 { τ i } i

Original: ∈| V | ← GetInitialSolution ( P ) 2 C per ←3 while True do while improvement do ( τ 1 , τ 2 ) ← SelectTours ( { τ i } i ∈| V | ) ( τ ′ 1 , τ ′ 2 ) ← NeuroCROSS ( τ 1 , τ 2 , f θ ) //
Revised: ∈| V | ← GetInitialSolution ( P ) 2 C per ←3 while True do while improvement do ( τ 1 , τ 2 ) ← SelectTours ( { τ i } i ∈| V | ) ( τ ′ 1 , τ ′ 2 ) ← NeuroCROSS ( τ 1 , τ 2 , f θ ) //

Original: Inter operation τ ′
Revised: Inter operation τ ′

Original: i ← IntraOperation ( τ i ) , i = 1 , τ 1 ← τ ′ 1 , τ 2 ← τ ′ if update then { τ ∗ i } i
Revised: i ← IntraOperation ( τ i ) , i = 1 , τ 1 ← τ ′ 1 , τ 2 ← τ ′ if update then { τ ∗ i } i

Original: ∈| V | ← i } i ∈| V | then break
Revised: ∈| V | ← i } i ∈| V | then break

Original: C per ← C
Revised: C per ← C

Original: + τ 2 ) ← ChooseRandomTours
Revised: + τ 2 ) ← ChooseRandomTours

Original: 2 ) ← RandomExchange
Revised: 2 ) ← RandomExchange

Original: 2 ) // escape from local minima up from or delivered to any depots.
Revised: 2 ) // escape from local minima up from or delivered to any depots.

Original: The mixed integer linear programming (MILP) formulation of min-max FMDVRP is provided in Appendix A.3.
Revised: The mixed integer linear programming (MILP) formulation of min-max FMDVRP is provided in Appendix A.3.

Original: Classical VRPs are special cases of FMDVRP:
Revised: Classical VRPs are special cases of FMDVRP:

Original: TSP is a VRP with a single vehicle and depot, mTSP is a VRP with multiple vehicles and a single depot, and MDVRP is a VRP with multiple vehicles and depots.
Revised: TSP is a VRP with a single vehicle and depot, mTSP is a VRP with multiple vehicles and a single depot, and MDVRP is a VRP with multiple vehicles and depots.

Original: Since FMVDRP is a general problem class, we learn a solver for FMVDRP and employ it to solve other specific problems (i.e., min-max MDVRP, min-max mTSP, and min-max CVRP), without retraining or fine-tuning.
Revised: Since FMVDRP is a general problem class, we learn a solver for FMVDRP and employ it to solve other specific problems (i.e., min-max MDVRP, min-max mTSP, and min-max CVRP), without retraining or fine-tuning.

Original: We demonstrate that the proposed method can solve these special cases almost optimally without retraining in Section 4.
Revised: We demonstrate that the proposed method can solve these special cases almost optimally without retraining in Section 4.

Original: 2. CROSS EXCHANGE
Revised: 2. CROSS EXCHANGE

Original: CE is a solution updating operator that iteratively improves the solution until it reaches a satisfactory result (Taillard et al
Revised: CE is a solution updating operator that iteratively improves the solution until it reaches a satisfactory result (Taillard et al

Original: [Equation]
Revised: [Equation]

Original: CE reduces the overall cost by exchanging the sub-tours in two tours.
Revised: CE reduces the overall cost by exchanging the sub-tours in two tours.

Original: The CE operator is defined as:
Revised: The CE operator is defined as:

Original: [Equation]
Revised: [Equation]

Original: where τ i and τ ′ i are the input and updated tours of the vehicle i , respectively.
Revised: where τ i and τ ′ i are the input and updated tours of the vehicle i , respectively.

Original: τ i [ a : b ] represents the sub-tour of τ i , ranging from node a to b .
Revised: τ i [ a : b ] represents the sub-tour of τ i , ranging from node a to b .

Original: τ ⊕ τ ′ represents the concatenation of tours τ and τ ′ .
Revised: τ ⊕ τ ′ represents the concatenation of tours τ and τ ′ .

Original: For brevity, we assume that node a 1 , a 2 comes early than node b 1 , b 2 in τ 1 , τ 2 , respectively.
Revised: For brevity, we assume that node a 1 , a 2 comes early than node b 1 , b 2 in τ 1 , τ 2 , respectively.

Original: CE selects the sub-tours (i.e., τ 1 [ a 1 : b 1 ] , τ 2 [ a 2 : b 2 ] ) from τ 1 , τ 2 and swaps the sub-tours to generate new tours τ ′ 1 , τ ′ 2 .
Revised: CE selects the sub-tours (i.e., τ 1 [ a 1 : b 1 ] , τ 2 [ a 2 : b 2 ] ) from τ 1 , τ 2 and swaps the sub-tours to generate new tours τ ′ 1 , τ ′ 2 .

Original: CE seeks to find the four points ( a 1 , b 1 , a 2 , b 2 ) to reduce the cost of the tours.
Revised: CE seeks to find the four points ( a 1 , b 1 , a 2 , b 2 ) to reduce the cost of the tours.

Original: For min-max VRPs, we define the cost of the two selected tours as C ( τ 1 , τ 2 ) =
Revised: For min-max VRPs, we define the cost of the two selected tours as C ( τ 1 , τ 2 ) =

Original: max( l ( τ 1 ) , l ( τ 2 )) , where l ( τ i ) is the traveling distance of tour τ i , and apply the CE operator to reduce this cost, i.e.,
Revised: max( l ( τ 1 ) , l ( τ 2 )) , where l ( τ i ) is the traveling distance of tour τ i , and apply the CE operator to reduce this cost, i.e.,

Original: C ( τ ′ 1 , τ ′ 2 ) ≤ C ( τ 1 , τ 2 ) in an attempt to minimize the traveling distance of the longest route.
Revised: C ( τ ′ 1 , τ ′ 2 ) ≤ C ( τ 1 , τ 2 ) in an attempt to minimize the traveling distance of the longest route.

Original: When the full search method is naively employed, the search cost is O ( n 4 ) , where n is the number of nodes in a tour.
Revised: When the full search method is naively employed, the search cost is O ( n 4 ) , where n is the number of nodes in a tour.

Original: Fig.
Revised: Fig.

Original: 1 illustrates how the improvement heuristics utilize CE to solve min-max FMDVRP.
Revised: 1 illustrates how the improvement heuristics utilize CE to solve min-max FMDVRP.

Original: The improvement heuristics start by generating the initial feasible tours using simple heuristics.
Revised: The improvement heuristics start by generating the initial feasible tours using simple heuristics.

Original: Then, they repeatedly (1) select two tours, (2) apply inter-operation to generate improved tours by CE, and (3) apply intra-operation to improve the tours independently.
Revised: Then, they repeatedly (1) select two tours, (2) apply inter-operation to generate improved tours by CE, and (3) apply intra-operation to improve the tours independently.

Original: The improvement heuristics terminate when no more (local) improvement is possible.
Revised: The improvement heuristics terminate when no more (local) improvement is possible.

Original: Input: tours τ 1 , τ 2 , cost-decrement prediction model f θ ( · ) Output: updated tours τ ′ 1 , τ ′/* Predict cost decrement */ 16 S ← {∅} 17 for ( a 1 , a 2 ) ∈ τ 1 ×
Revised: Input: tours τ 1 , τ 2 , cost-decrement prediction model f θ ( · ) Output: updated tours τ ′ 1 , τ ′/* Predict cost decrement */ 16 S ← {∅} 17 for ( a 1 , a 2 ) ∈ τ 1 ×

Original: τ 2 do ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ← f θ ( a 1 , a 2 ; τ 1 , τ 2 ) //
Revised: τ 2 do ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ← f θ ( a 1 , a 2 ; τ 1 , τ 2 ) //

Original: Cost-decrement prediction
Revised: Cost-decrement prediction

Original: S ← S ∪ { (( a 1 , a 2 ) , ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 )) } /
Revised: S ← S ∪ { (( a 1 , a 2 ) , ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 )) } /

Original: * Candidate set construction */ 20 Sort S by y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) in the descending order 21 S K ← Take first K elements of S / * Perform search */ 22 a ∗ 1 ← ∅ , a ∗ 2 ← ∅ , b ∗ 1 ← ∅ , b ∗ 2 ← ∅ , y ∗ ←23 for (( a 1 , a 2 ) , ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ))
Revised: * Candidate set construction */ 20 Sort S by y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) in the descending order 21 S K ← Take first K elements of S / * Perform search */ 22 a ∗ 1 ← ∅ , a ∗ 2 ← ∅ , b ∗ 1 ← ∅ , b ∗ 2 ← ∅ , y ∗ ←23 for (( a 1 , a 2 ) , ˆ y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ))

Original: ∈
Revised: ∈

Original: S K do (¯ b 1 , ¯ b 2 ) ← arg max b 1 ,b 2 ( C ( CROSS (( a 1 , b 1 , a 2 , b 2 ; τ 1 , τ 2 )))
Revised: S K do (¯ b 1 , ¯ b 2 ) ← arg max b 1 ,b 2 ( C ( CROSS (( a 1 , b 1 , a 2 , b 2 ; τ 1 , τ 2 )))

Original: − C ( τ 1 , τ 2 ))
Revised: − C ( τ 1 , τ 2 ))

Original: y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ← C ( CROSS (( a 1 , ¯ b 1 , a 2 , ¯ b 2 ; τ 1 , τ 2 ))
Revised: y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ← C ( CROSS (( a 1 , ¯ b 1 , a 2 , ¯ b 2 ; τ 1 , τ 2 ))

Original: − C ( τ 1 , τ 2 ) if y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ≥ y ∗ then a ∗ 1 ← a 1 , a ∗ 2 ← a 2 , b ∗ 1 ← ¯ b 1 , b ∗ 2 ← ¯ b y ∗ ← y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) 29 ( τ ′ 1 , τ ′ 2 ) ← CROSS ( a ∗ 1 , b ∗ 1 , a ∗ 2 , b ∗ 2 ; τ 1 , τ 2 )
Revised: − C ( τ 1 , τ 2 ) if y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) ≥ y ∗ then a ∗ 1 ← a 1 , a ∗ 2 ← a 2 , b ∗ 1 ← ¯ b 1 , b ∗ 2 ← ¯ b y ∗ ← y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) 29 ( τ ′ 1 , τ ′ 2 ) ← CROSS ( a ∗ 1 , b ∗ 1 , a ∗ 2 , b ∗ 2 ; τ 1 , τ 2 )

Original:  N EURO CROSS E XCHANGE
Revised:  N EURO CROSS E XCHANGE

Original: In this section, we introduce Neuro CROSS exchange (NCE) to solve min-max FMDVRP and its special cases.
Revised: In this section, we introduce Neuro CROSS exchange (NCE) to solve min-max FMDVRP and its special cases.

Original: The overall procedure of NCE is summarized in Algorithm 1.
Revised: The overall procedure of NCE is summarized in Algorithm 1.

Original: We briefly explain
Revised: We briefly explain

Original: GetInitialSolution , SelectTours , NeuroCROSS , and IntraOperation , and then provide the details of the proposed NeuroCROSS operation in the following subsections.
Revised: GetInitialSolution , SelectTours , NeuroCROSS , and IntraOperation , and then provide the details of the proposed NeuroCROSS operation in the following subsections.

Original: NCE is particularly designed to improve the solution quality and problem solving speed of CE when solving min-max
Revised: NCE is particularly designed to improve the solution quality and problem solving speed of CE when solving min-max

Original: VRPs.
Revised: VRPs.

Original: Each component of NCE is as follows:
Revised: Each component of NCE is as follows:

Original: • GetInitialSolution.
Revised: • GetInitialSolution.

Original: We use a multi-agent extended version of the greedy assignment heuristic (Dell’Amico et al., 1993) to obtain the initial feasible solutions.
Revised: We use a multi-agent extended version of the greedy assignment heuristic (Dell’Amico et al., 1993) to obtain the initial feasible solutions.

Original: The heuristic first clusters the cities into | V | clusters and then applies the greedy assignment to each cluster to get the initial solution.
Revised: The heuristic first clusters the cities into | V | clusters and then applies the greedy assignment to each cluster to get the initial solution.

Original: • SelectTours.
Revised: • SelectTours.

Original: Following the common practice, we select τ 1 , τ 2 as the tours with the largest and smallest traveling distance (i.e., τ 1 = arg max τ ( l ( τ i ) i ∈ V ) , τ 2 = arg min τ ( l ( τ i ) i ∈ V ) ).
Revised: Following the common practice, we select τ 1 , τ 2 as the tours with the largest and smallest traveling distance (i.e., τ 1 = arg max τ ( l ( τ i ) i ∈ V ) , τ 2 = arg min τ ( l ( τ i ) i ∈ V ) ).

Original: • NeruoCROSS.
Revised: • NeruoCROSS.

Original: We utilize the cost-decrement prediction model f θ ( · ) and two-stage search method to find the cost-improving tour pair ( τ ′ 1 , τ ′ 2 ) with O ( n 2 ) budget.
Revised: We utilize the cost-decrement prediction model f θ ( · ) and two-stage search method to find the cost-improving tour pair ( τ ′ 1 , τ ′ 2 ) with O ( n 2 ) budget.

Original: The details of the NCE operation will be given in Sections 3.1 and 3.2.
Revised: The details of the NCE operation will be given in Sections 3.1 and 3.2.

Original: • IntraOperation.
Revised: • IntraOperation.

Original: For our target VRPs, the intra-operation is equivalent to solving TSP.
Revised: For our target VRPs, the intra-operation is equivalent to solving TSP.

Original: We utilize elkai (Dimitrovski) to solve TSP.
Revised: We utilize elkai (Dimitrovski) to solve TSP.

Original: 3. N EURO CROSS EXCHANGE OPERATION
Revised: 3. N EURO CROSS EXCHANGE OPERATION

Original: The CE operation can be shown as selecting two pairs of nodes (i.e., the pairs of a 1 /b 1 and a 2 /b 2 ) from the selected tours (i.e., τ 1 , τ 2 ).
Revised: The CE operation can be shown as selecting two pairs of nodes (i.e., the pairs of a 1 /b 1 and a 2 /b 2 ) from the selected tours (i.e., τ 1 , τ 2 ).

Original: This typically involves O ( n 4 ) searches.
Revised: This typically involves O ( n 4 ) searches.

Original: To reduce the high search complexity, NCE utilizes the cost-decrement model f
Revised: To reduce the high search complexity, NCE utilizes the cost-decrement model f

Original: θ ( a 1 , a 2 ; τ 1 , τ 2 ) that predicts the maximum cost decrements from the given τ 1 and τ 2 , and the starting nodes a 1 and a 2 of their sub-tours.
Revised: θ ( a 1 , a 2 ; τ 1 , τ 2 ) that predicts the maximum cost decrements from the given τ 1 and τ 2 , and the starting nodes a 1 and a 2 of their sub-tours.

Original: That is, f θ ( a 1 , a 2 ; τ 1 , τ 2 ) amortizes the search for the ending nodes b 1 , b 2 given ( τ 1 , τ 2 , a 1 , a 2 ) , and helps to identify the promising ( a 1 , a 2 ) pairs that are likely to improve the tours.
Revised: That is, f θ ( a 1 , a 2 ; τ 1 , τ 2 ) amortizes the search for the ending nodes b 1 , b 2 given ( τ 1 , τ 2 , a 1 , a 2 ) , and helps to identify the promising ( a 1 , a 2 ) pairs that are likely to improve the tours.

Original: After selecting the top K promising pairs of ( a 1 , a 2 ) using f θ ( a 1 , a 2 ; τ 1 , τ 2 ) , whose search cost is O ( n 2 ) , NCE then finds ( b 1 , b 2 ) to identify the promising ( a 1 , a 2 ) pairs.
Revised: After selecting the top K promising pairs of ( a 1 , a 2 ) using f θ ( a 1 , a 2 ; τ 1 , τ 2 ) , whose search cost is O ( n 2 ) , NCE then finds ( b 1 , b 2 ) to identify the promising ( a 1 , a 2 ) pairs.

Original: Overall, the entire search can be done in
Revised: Overall, the entire search can be done in

Original: O ( n 2 ) .
Revised: O ( n 2 ) .

Original: The following paragraphs detail the procedures of NCE.
Revised: The following paragraphs detail the procedures of NCE.

Original: Predicting cost decrement.
Revised: Predicting cost decrement.

Original: We employ f θ ( a 1 , a 2 ; τ 1 , τ 2 ) (which will be explained in Section 3.2) to predict the optimal cost decrement y ∗ defined as:
Revised: We employ f θ ( a 1 , a 2 ; τ 1 , τ 2 ) (which will be explained in Section 3.2) to predict the optimal cost decrement y ∗ defined as:

Original: [Equation]
Revised: [Equation]

Original: where C ( τ 1 , τ 2 ) = max ( l ( τ 1 ) , l ( τ 2 )) .
Revised: where C ( τ 1 , τ 2 ) = max ( l ( τ 1 ) , l ( τ 2 )) .

Original: In other words, f θ ( · ) predicts the best cost decrement of τand τ 2 , given a 1 and a 2 .
Revised: In other words, f θ ( · ) predicts the best cost decrement of τand τ 2 , given a 1 and a 2 .

Original: The real cost decrement labels are obtained from the real search operation.
Revised: The real cost decrement labels are obtained from the real search operation.

Original: Constructing search candidate set.
Revised: Constructing search candidate set.

Original: By training f θ ( · ) , we can amortize the search for b 1 and b 2 .
Revised: By training f θ ( · ) , we can amortize the search for b 1 and b 2 .

Original: However, this amortization bears the prediction errors, which can misguide entire improvement process.
Revised: However, this amortization bears the prediction errors, which can misguide entire improvement process.

Original: To alleviate this problem, we selects the top K pairs of ( a 1 , a 2 ) that have the top K -largest y ∗ out of all ( a 1 , a 2 ) choices.
Revised: To alleviate this problem, we selects the top K pairs of ( a 1 , a 2 ) that have the top K -largest y ∗ out of all ( a 1 , a 2 ) choices.

Original: Intuitively speaking, NCE exclude the less promising ( a 1 , a 2 ) pairs while utilizing the prediction model f θ ( · ) which can have some errors.
Revised: Intuitively speaking, NCE exclude the less promising ( a 1 , a 2 ) pairs while utilizing the prediction model f θ ( · ) which can have some errors.

Original: Performing reduced search.
Revised: Performing reduced search.

Original: NCE finds the best ( b 1 , b 2 ) for each ( a 1 , a 2 ) in the search candidate sets and selects the best sub-tours ( a 1 , a 2 , b 1 , b 2 ) that maximizes the actual cost decrement (not prediction).
Revised: NCE finds the best ( b 1 , b 2 ) for each ( a 1 , a 2 ) in the search candidate sets and selects the best sub-tours ( a 1 , a 2 , b 1 , b 2 ) that maximizes the actual cost decrement (not prediction).

Original: Unlike the full search of CE, the proposed NCE only performs the search for ( b 1 , b 2 ) , which reduces the search cost from O ( n 4 ) to O ( n 2 ) .
Revised: Unlike the full search of CE, the proposed NCE only performs the search for ( b 1 , b 2 ) , which reduces the search cost from O ( n 4 ) to O ( n 2 ) .

Original: The detailed procedures of NCE are summarized in
Revised: The detailed procedures of NCE are summarized in

Original: Algorithm 2.
Revised: Algorithm 2.

Original: 3. C OST - DECREMENT PREDICTION MODEL
Revised: 3. C OST - DECREMENT PREDICTION MODEL

Original: NCE saves computations by employing f θ ( a 1 , a 2 ; τ 1 , τ 2 ) to predict y ∗ ( · ) from a 1 , a 2 , τ 1 and τ 2 .
Revised: NCE saves computations by employing f θ ( a 1 , a 2 ; τ 1 , τ 2 ) to predict y ∗ ( · ) from a 1 , a 2 , τ 1 and τ 2 .

Original: The overall procedure is illustrated in Fig.
Revised: The overall procedure is illustrated in Fig.

Original: Graph representation of ( τ 1 , τ 2 ) .
Revised: Graph representation of ( τ 1 , τ 2 ) .

Original: We represent a pair of tours ( τ 1 , τ 2 ) as a directed complete graph G =
Revised: We represent a pair of tours ( τ 1 , τ 2 ) as a directed complete graph G =

Original: ( N , E ) , where N = τ 1 ∪ τ 2 (i.e., the i th node n i of G is either the city or depot of the tours, and e ij is the edge from n i to n j ).
Revised: ( N , E ) , where N = τ 1 ∪ τ 2 (i.e., the i th node n i of G is either the city or depot of the tours, and e ij is the edge from n i to n j ).

Original: G has the following node and edge features:
Revised: G has the following node and edge features:

Original: • x i =
Revised: • x i =

Original: [ coord ( n i ) , 1 depot ( n i )] , where coord ( n i ) is the 2D Euclidean coordinate of v i , anddepot ( n i ) is the indicator of whether n i is a depot.
Revised: [ coord ( n i ) , 1 depot ( n i )] , where coord ( n i ) is the 2D Euclidean coordinate of v i , anddepot ( n i ) is the indicator of whether n i is a depot.

Original: • x ij = [ dist ( n i , n j )] , where dist ( n i , n j ) is the 2D Euclidean distance between n i and n j .
Revised: • x ij = [ dist ( n i , n j )] , where dist ( n i , n j ) is the 2D Euclidean distance between n i and n j .

Original: Graph embedding with attentive graph neural network.
Revised: Graph embedding with attentive graph neural network.

Original: We employ an attentive variant of graph-network (GN) block (Battaglia et al., 2018) to embed G .
Revised: We employ an attentive variant of graph-network (GN) block (Battaglia et al., 2018) to embed G .

Original: The attentive embedding layer is defined as follows:
Revised: The attentive embedding layer is defined as follows:

Original: [Equation]
Revised: [Equation]

Original: where h i and h ij are node and edge embeddings respectively, ϕ e , ϕ w , and ϕ n are the Multilayer
Revised: where h i and h ij are node and edge embeddings respectively, ϕ e , ϕ w , and ϕ n are the Multilayer

Original: Perceptron (MLP)-parameterized edge, attention and node operators respectively, and N ( i ) is the neighbor set of n i .
Revised: Perceptron (MLP)-parameterized edge, attention and node operators respectively, and N ( i ) is the neighbor set of n i .

Original: We utilize H embedding layers to compute the final node { h ( H ) i | n i ∈ V } and edge { h ( H ) ij | e ij ∈ E } embeddings.
Revised: We utilize H embedding layers to compute the final node { h ( H ) i | n i ∈ V } and edge { h ( H ) ij | e ij ∈ E } embeddings.

Original: Cost-decrement prediction.
Revised: Cost-decrement prediction.

Original: Based on the computed embedding, the cost prediction module ϕ c predicts y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) .
Revised: Based on the computed embedding, the cost prediction module ϕ c predicts y ∗ ( a 1 , a 2 ; τ 1 , τ 2 ) .

Original: The selection of the two starting nodes in τ 1 and τ 2 indicates (1) the addition of the two edges, ( a 1 , a 2 + 1) and ( a 2 , a 1 + 1) , and (2) the removal of the original two edges, ( a 1 , a 1 + 1) and ( a 2 , a 2 + 1) , as shown in the third block in Fig.
Revised: The selection of the two starting nodes in τ 1 and τ 2 indicates (1) the addition of the two edges, ( a 1 , a 2 + 1) and ( a 2 , a 1 + 1) , and (2) the removal of the original two edges, ( a 1 , a 1 + 1) and ( a 2 , a 2 + 1) , as shown in the third block in Fig.

Original: 2 (we overload the notations a 1 + 1 , a 2 + 1 so that they denote the next nodes of a 1 , a 2 in τ 1 , τ 2 , respectively).
Revised: 2 (we overload the notations a 1 + 1 , a 2 + 1 so that they denote the next nodes of a 1 , a 2 in τ 1 , τ 2 , respectively).

Original: To consider such edge addition and removal procedure in cost prediction, we design ϕ c as follows:
Revised: To consider such edge addition and removal procedure in cost prediction, we design ϕ c as follows:

Original: [Equation]
Revised: [Equation]

Original: 𝜏𝜏
Revised: 𝜏𝜏

Original: [Figure]
Revised: [Figure]

Original: where h ( H ) i and h
Revised: where h ( H ) i and h

Original: ( H ) i,j denotes the embedding of n i and e ij , respectively.
Revised: ( H ) i,j denotes the embedding of n i and e ij , respectively.

Original: The quality of the NCE operator highly depends on the accuracy of f θ .
Revised: The quality of the NCE operator highly depends on the accuracy of f θ .

Original: When K ≥ 10 , we experimentally confirmed that the NCE operator finds the argmax ( a 1 , a 2 , b 1 , b 2 ) pair with high probability.
Revised: When K ≥ 10 , we experimentally confirmed that the NCE operator finds the argmax ( a 1 , a 2 , b 1 , b 2 ) pair with high probability.

Original: We provide the experimental details and results about the predictions of f θ in Appendix H.
Revised: We provide the experimental details and results about the predictions of f θ in Appendix H.

Original:  E XPERIMENTS
Revised:  E XPERIMENTS

Original: This section provides the experiment results that validate the effectiveness of the proposed NCE in solving min-max FMDVRP and various min-max VRPs.
Revised: This section provides the experiment results that validate the effectiveness of the proposed NCE in solving min-max FMDVRP and various min-max VRPs.

Original: To train f θ ( · ) , we use the input ( τ 1 , τ 2 , a 1 , a 2 ) and output y ∗ pairs obtained from 50,000 random min-max FMDVRP instances.
Revised: To train f θ ( · ) , we use the input ( τ 1 , τ 2 , a 1 , a 2 ) and output y ∗ pairs obtained from 50,000 random min-max FMDVRP instances.

Original: The details of the train data generation are described in Appendix G.
Revised: The details of the train data generation are described in Appendix G.

Original: The cost decrement model f θ ( · ) is parametrized by the GNN that contains the five attentive embedding layers.
Revised: The cost decrement model f θ ( · ) is parametrized by the GNN that contains the five attentive embedding layers.

Original: The details of the f θ ( · ) architecture and the computing infrastructure used to train f θ ( · ) are discussed in Appendix G.
Revised: The details of the f θ ( · ) architecture and the computing infrastructure used to train f θ ( · ) are discussed in Appendix G.

Original: We emphasize that we use a single f θ ( · ) that is trained using data obtained from random min-max
Revised: We emphasize that we use a single f θ ( · ) that is trained using data obtained from random min-max

Original: FMDVRP instances for all experiments.
Revised: FMDVRP instances for all experiments.

Original: We found that f θ ( · ) effectively solves the three special cases (i.e., min-max MDVRP, min-max mTSP, and min-max CVRP) without retraining or finetuning, proving the effectiveness of NCE as a universal operator for VRPs.
Revised: We found that f θ ( · ) effectively solves the three special cases (i.e., min-max MDVRP, min-max mTSP, and min-max CVRP) without retraining or finetuning, proving the effectiveness of NCE as a universal operator for VRPs.

Original: 4. MIN - MAX FMDVRP EXPERIMENTS
Revised: 4. MIN - MAX FMDVRP EXPERIMENTS

Original: We evaluate the performance of NCE in solving various sizes of min-max FMDVRP.
Revised: We evaluate the performance of NCE in solving various sizes of min-max FMDVRP.

Original: We consider 100 random min-max FMDVRP instances for each problem size ( N c , N d , N v ) , where N c , N d , N v are the number of cities, depots
Revised: We consider 100 random min-max FMDVRP instances for each problem size ( N c , N d , N v ) , where N c , N d , N v are the number of cities, depots

Original: [Table]
Revised: [Table]

Original: and vehicles, respectively.
Revised: and vehicles, respectively.

Original: We provide the average makespan and computation time for the 100 instances.
Revised: We provide the average makespan and computation time for the 100 instances.

Original: For small-sized problems ( N c ≤ 10 ), we employ CPLEX (Cplex, 2009) (an exact method), OR-tools (Perron & Furnon), CE (full search), ScheduleNet (Park et al., 2021), greedy heuristic (Dell’Amico et al., 1993), and greedy + TSP heuristic as baselines.
Revised: For small-sized problems ( N c ≤ 10 ), we employ CPLEX (Cplex, 2009) (an exact method), OR-tools (Perron & Furnon), CE (full search), ScheduleNet (Park et al., 2021), greedy heuristic (Dell’Amico et al., 1993), and greedy + TSP heuristic as baselines.

Original: For the larger-sized problems, we exclude CPLEX from the baselines due to its limited scalability.
Revised: For the larger-sized problems, we exclude CPLEX from the baselines due to its limited scalability.

Original: To our knowledge, our method is the first neural approach to solve min-max FMDVRP.
Revised: To our knowledge, our method is the first neural approach to solve min-max FMDVRP.

Original: Please note that we extend the ScheduleNet algorithm
Revised: Please note that we extend the ScheduleNet algorithm

Original: (Park et al., 2021), the most performing neural baseline for mTSP
Revised: (Park et al., 2021), the most performing neural baseline for mTSP

Original: [Table]
Revised: [Table]

Original: and utilize it as a neural baseline for the min-max FMVDRP experiments
Revised: and utilize it as a neural baseline for the min-max FMVDRP experiments

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: Table 1 shows the performances of NCE on the small-sized problems.
Revised: Table 1 shows the performances of NCE on the small-sized problems.

Original: NCE achieve similar makespans with CPLEX (optimal solution) within significantly lower computation times.
Revised: NCE achieve similar makespans with CPLEX (optimal solution) within significantly lower computation times.

Original: NCE outperforms OR-tools in terms of makespan but has longer computation time; however, the computation time for NCE will be much lower than that of OR-tools when the problem size becomes bigger.
Revised: NCE outperforms OR-tools in terms of makespan but has longer computation time; however, the computation time for NCE will be much lower than that of OR-tools when the problem size becomes bigger.

Original: It is noteworthy that NCE exhibits larger computation time than CE as the forward-propagation cost of
Revised: It is noteworthy that NCE exhibits larger computation time than CE as the forward-propagation cost of

Original: GNN is larger than exhaustive search for small problems.
Revised: GNN is larger than exhaustive search for small problems.

Original: Table 2 and Table 3 shows the performances of NCE on the medium and large-sized problems, respectively.
Revised: Table 2 and Table 3 shows the performances of NCE on the medium and large-sized problems, respectively.

Original: Applying CPLEX for large min-max FMDVRPs is infeasible, so we exclude it from the baselines.
Revised: Applying CPLEX for large min-max FMDVRPs is infeasible, so we exclude it from the baselines.

Original: Instead, the CE serves as an oracle to compute the makespans.
Revised: Instead, the CE serves as an oracle to compute the makespans.

Original: For all cases, NCE provides a solution with almost zero gap from CE , but is computationally much faster.
Revised: For all cases, NCE provides a solution with almost zero gap from CE , but is computationally much faster.

Original: This validates that NCE successfully amortizes the search operations of CE with significantly lower computation times.
Revised: This validates that NCE successfully amortizes the search operations of CE with significantly lower computation times.

Original: In addition, NCE consistently outperforms OR-tools for both the makespan and computational time.
Revised: In addition, NCE consistently outperforms OR-tools for both the makespan and computational time.

Original: The performance gap between NCE and OR-tools becomes more significant as N c /N v becomes large (i.e., each tour length becomes longer).
Revised: The performance gap between NCE and OR-tools becomes more significant as N c /N v becomes large (i.e., each tour length becomes longer).

Original: min-max MDVRP results.
Revised: min-max MDVRP results.

Original: We also apply NCE with f θ that is trained on FMDVRP to solve minmax MDVRP.
Revised: We also apply NCE with f θ that is trained on FMDVRP to solve minmax MDVRP.

Original: As shown Tables A.1 to A.3 in Appendix B, NCE shows leading performance and is faster than the baselines, similar to the FMDVRP experiments.
Revised: As shown Tables A.1 to A.3 in Appendix B, NCE shows leading performance and is faster than the baselines, similar to the FMDVRP experiments.

Original: 4. MIN - MAX M TSP EXPERIMENTS
Revised: 4. MIN - MAX M TSP EXPERIMENTS

Original: We evaluate the generalization capability of NCE for solving min-max mTSPs.
Revised: We evaluate the generalization capability of NCE for solving min-max mTSPs.

Original: We provide the average performance of 100 instances for each ( N c , N v ) pair.
Revised: We provide the average performance of 100 instances for each ( N c , N v ) pair.

Original: For the baselines, we consider two meta-heuristics; LKH-

Revised: For the baselines, we consider two meta-heuristics; LKH-

Original: (Helsgaun, 2017), which is known as the one of the best mTSP heuristics, and OR-tools, and two neural baselines; ScheduleNet (Park et al., 2021) and DAN (Cao et al., 2021).
Revised: (Helsgaun, 2017), which is known as the one of the best mTSP heuristics, and OR-tools, and two neural baselines; ScheduleNet (Park et al., 2021) and DAN (Cao et al., 2021).

Original: As shown in Table 4, NCE achieves similar performance with LKH-3 with significantly shorter computational time.
Revised: As shown in Table 4, NCE achieves similar performance with LKH-3 with significantly shorter computational time.

Original: It is noteworthy that LKH-3 employs mTSP-specific heuristics on top of LKH heuristics, while NCE does not employ any mTSP-specific structures.
Revised: It is noteworthy that LKH-3 employs mTSP-specific heuristics on top of LKH heuristics, while NCE does not employ any mTSP-specific structures.

Original: To validate the effect of taskspecific information on NCE, we train NCE with mTSP data (NCE-mTSP) and solve mTSP.
Revised: To validate the effect of taskspecific information on NCE, we train NCE with mTSP data (NCE-mTSP) and solve mTSP.

Original: The performances of NCE and NCE-mTSP are almost identical, which indicates that NCE is highly generalizable.
Revised: The performances of NCE and NCE-mTSP are almost identical, which indicates that NCE is highly generalizable.

Original: In addition, NCE consistently outperforms the neural baselines.
Revised: In addition, NCE consistently outperforms the neural baselines.

Original: We further apply
Revised: We further apply

Original: [Table]
Revised: [Table]

Original: NCE to solve mTSPLib mTSPLib, which comprises of mTSP instances from real cities
Revised: NCE to solve mTSPLib mTSPLib, which comprises of mTSP instances from real cities

Original: [Table]
Revised: [Table]

Original: and large size min-max mTSPs.
Revised: and large size min-max mTSPs.

Original: The experiment results are in Appendix C
Revised: The experiment results are in Appendix C

Original: [Table]
Revised: [Table]

Original: 4. MIN - MAX CVRP EXPERIMENTS
Revised: 4. MIN - MAX CVRP EXPERIMENTS

Original: [Table]
Revised: [Table]

Original: We evaluate the generalization capability of NCE in solving min-max capacitated VRP.
Revised: We evaluate the generalization capability of NCE in solving min-max capacitated VRP.

Original: As f θ ( · ) is trained on min-max FMDVRPs, it does not consider the capacity constraints.
Revised: As f θ ( · ) is trained on min-max FMDVRPs, it does not consider the capacity constraints.

Original: However, we can easily enforce such constraints without retraining f θ ( · )
Revised: However, we can easily enforce such constraints without retraining f θ ( · )

Original: [Table]
Revised: [Table]

Original: but by adjusting the searching range as follows:
Revised: but by adjusting the searching range as follows:

Original: [Equation]
Revised: [Equation]

Original: where the searching range S c is a set of nodes that satisfies the capacity constraints.
Revised: where the searching range S c is a set of nodes that satisfies the capacity constraints.

Original: As shown in
Revised: As shown in

Revised: Table

Original: Table 5, NCE outperforms other neural baselines (i.e., AM and HM) with shorter computation times, which again proves the effectiveness of NCE as a universal operator.
Revised: [Table] NCE outperforms other neural baselines (i [Table] e., AM and HM) with shorter computation times, which again proves the effectiveness of NCE as a universal operator.

Original: Min-max CVRP with CVRPlib results are provided in Appendix D, Table A.6.
Revised: Min-max CVRP with CVRPlib results are provided in Appendix D, Table A.6.

Original: As most NCO studies use min-sum CVRP as the canonical benchmark tasks, we also employed NCE to solve min-sum CVRP problems.
Revised: As most NCO studies use min-sum CVRP as the canonical benchmark tasks, we also employed NCE to solve min-sum CVRP problems.

Original: For min-sum CVRP, we trained the NCE cost decrement predic- tion model using different cost definition C ( τ 1 , τ 2 ) =
Revised: For min-sum CVRP, we trained the NCE cost decrement prediction model using different cost definition C ( τ 1 , τ 2 ) =

Original: l ( τ 1 ) + l ( τ 2 ) in an attempt to minimize the sum of the traveling distance.
Revised: l ( τ 1 ) + l ( τ 2 ) in an attempt to minimize the sum of the traveling distance.

Original: The min-sum CVRP benchmark results are provided in Appendix E,
Revised: The min-sum CVRP benchmark results are provided in Appendix E,

Original: Table A.7.
Revised: Table A.7.

Original: 4. A BLATION STUDIES
Revised: 4. A BLATION STUDIES

Original: We evaluate the effects of the hyperparameters on NCE.
Revised: We evaluate the effects of the hyperparameters on NCE.

Original: The results are as follows:
Revised: The results are as follows:

Original: • Appendix F.1: the performance of NCE converges when the number of candidate K ≥ 10 .
Revised: • Appendix F.1: the performance of NCE converges when the number of candidate K ≥ 10 .

Original: • Appendix F.2: the performance of NCE is less sensitive to the selection of intra solvers.
Revised: • Appendix F.2: the performance of NCE is less sensitive to the selection of intra solvers.

Original: • Appendix F.3: the performance of NCE is less sensitive to the selection of swapping tours.
Revised: • Appendix F.3: the performance of NCE is less sensitive to the selection of swapping tours.

Original: • Appendix F.4: the performance of NCE converges when the perturbation parameter p ≥ 5 .
Revised: • Appendix F.4: the performance of NCE converges when the perturbation parameter p ≥ 5 .

Original:  R ELATED WORKS
Revised:  R ELATED WORKS

Original: Supervised learning (SL) approach to solve VRPs SL approaches (Joshi et al., 2019; Vinyals et al., 2015; Xin et al., 2021b;
Revised: Supervised learning (SL) approach to solve VRPs SL approaches (Joshi et al., 2019; Vinyals et al., 2015; Xin et al., 2021b;

Original: Li et al., 2021; 2018) utilize the supervision from the VRP solvers as the training labels.
Revised: Li et al., 2021; 2018) utilize the supervision from the VRP solvers as the training labels.

Original: (Vinyals et al., 2015; Joshi et al., 2019) imitates TSP solvers using PointerNet and graph convolution network (GCN), respectively.
Revised: (Vinyals et al., 2015; Joshi et al., 2019) imitates TSP solvers using PointerNet and graph convolution network (GCN), respectively.

Original: (Joshi et al., 2019) trains a GCN to predict the edge occurrence probabilities in TSP solutions.
Revised: (Joshi et al., 2019) trains a GCN to predict the edge occurrence probabilities in TSP solutions.

Original: Even though SL often offer a faster solving speed than existing solvers, their use is limited to the problems where the solvers are available.
Revised: Even though SL often offer a faster solving speed than existing solvers, their use is limited to the problems where the solvers are available.

Original: Such property limits the use of SL from general and realistic VRPs.
Revised: Such property limits the use of SL from general and realistic VRPs.

Original: Reinforcement learning (RL) approach to solve VRPs RL approaches (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020;
Revised: Reinforcement learning (RL) approach to solve VRPs RL approaches (Bello et al., 2016; Khalil et al., 2017; Nazari et al., 2018; Kool et al., 2018; Kwon et al., 2020;

Original: Park et al., 2021; Cao et al., 2021;
Revised: Park et al., 2021; Cao et al., 2021;

Original: Guo et al., 2019; Wu et al., 2019; 2021; Falkner & Schmidt-Thieme, 2020; Chen & Tian, 2019) exhibit promising performances that are comparable to existing solvers as they learn solvers from the problem-solving simulations.
Revised: Guo et al., 2019; Wu et al., 2019; 2021; Falkner & Schmidt-Thieme, 2020; Chen & Tian, 2019) exhibit promising performances that are comparable to existing solvers as they learn solvers from the problem-solving simulations.

Original: (Bello et al., 2016; Nazari et al., 2018; Kool et al., 2018;
Revised: (Bello et al., 2016; Nazari et al., 2018; Kool et al., 2018;

Original: Guo et al., 2019) utilize an encoder-decoder structure to generate routing schedules sequentially, while (Park et al., 2021; Khalil et al., 2017) use graph-based embedding to determine the next assignment action.
Revised: Guo et al., 2019) utilize an encoder-decoder structure to generate routing schedules sequentially, while (Park et al., 2021; Khalil et al., 2017) use graph-based embedding to determine the next assignment action.

Original: However, RL approaches often require the problem-specific Markov decision process and network design.
Revised: However, RL approaches often require the problem-specific Markov decision process and network design.

Original: NCE does not require the simulation of the entire problem-solving.
Revised: NCE does not require the simulation of the entire problem-solving.

Original: Instead, it only requires the computation of the swapping operation (i.e., the results of CE).
Revised: Instead, it only requires the computation of the swapping operation (i.e., the results of CE).

Original: This property allows
Revised: This property allows

Original: NCE to be trained easily to solve various routing problems with one scheme.
Revised: NCE to be trained easily to solve various routing problems with one scheme.

Original: Neural network-based (meta) heuristic approach Combining machine learning (ML) components with existing (meta) heuristics shows strong empirical performances when solving VRPs (Hottung & Tierney, 2019;
Revised: Neural network-based (meta) heuristic approach Combining machine learning (ML) components with existing (meta) heuristics shows strong empirical performances when solving VRPs (Hottung & Tierney, 2019;

Original: Xin et al., 2021b;
Revised: Xin et al., 2021b;

Original: Li et al., 2021;
Revised: Li et al., 2021;

Original: Lu et al., 2019; da Costa et al., 2021; Kool et al., 2021).
Revised: Lu et al., 2019; da Costa et al., 2021; Kool et al., 2021).

Original: They often employ ML to learn to solve NP-hard sub-problems of VRPs, which are difficult.
Revised: They often employ ML to learn to solve NP-hard sub-problems of VRPs, which are difficult.

Original: For example, L2D (Li et al., 2021) learns to predict the objective value of CVRP, NLNS (Hottung & Tierney, 2019) learns a TSP solver when solving VRPs and DPDP (Kool et al., 2021) learns to boost the dynamic programming algorithms.
Revised: For example, L2D (Li et al., 2021) learns to predict the objective value of CVRP, NLNS (Hottung & Tierney, 2019) learns a TSP solver when solving VRPs and DPDP (Kool et al., 2021) learns to boost the dynamic programming algorithms.

Original: To learn such solvers, these methods apply
Revised: To learn such solvers, these methods apply

Original: SL or RL.
Revised: SL or RL.

Original: Instead, NCE learns the fundamental operator of meta-heuristics rather than predict or generate a solution.
Revised: Instead, NCE learns the fundamental operator of meta-heuristics rather than predict or generate a solution.

Original: Hence, NCE that is trained on FMDVRP generalizes well to the special cases of FMDVRP.
Revised: Hence, NCE that is trained on FMDVRP generalizes well to the special cases of FMDVRP.

Original: Furthermore, the training data for NCE can be prepared effortlessly.
Revised: Furthermore, the training data for NCE can be prepared effortlessly.

Original:  C ONCLUSION
Revised:  C ONCLUSION

Original: We propose Neuro CROSS exchange (NCE), a neural network-enhanced CE operator, to learn a fundamental and universal operator that can be used to solve the various types of min-max VRPs.
Revised: We propose Neuro CROSS exchange (NCE), a neural network-enhanced CE operator, to learn a fundamental and universal operator that can be used to solve the various types of min-max VRPs.

Original: We validated that NCE can solve various min-max VRPs without retraining for each specific problem, exhibiting strong empirical performances.
Revised: We validated that NCE can solve various min-max VRPs without retraining for each specific problem, exhibiting strong empirical performances.

Original: Although NCE addresses more realistic VRPs (i.e., minmax FMDVRP) than existing NCO solvers, NCE does not yet consider complex constraints such as pickup and delivery, and time windows.
Revised: Although NCE addresses more realistic VRPs (i.e., minmax FMDVRP) than existing NCO solvers, NCE does not yet consider complex constraints such as pickup and delivery, and time windows.

Original: Our future research will focus on solving more complex
Revised: Our future research will focus on solving more complex

Original: VRPs by considering such various constraints during the NCE operation.
Revised: VRPs by considering such various constraints during the NCE operation.

Original: A MILP FORMULATIONS FOR MIN - MAX R OUTING P ROBLEMS
Revised: A MILP FORMULATIONS FOR MIN - MAX R OUTING P ROBLEMS

Original: This section provides the mixed integer linear programming (MILP) formulations of mTSP, MDVRP, and FMDVRP.
Revised: This section provides the mixed integer linear programming (MILP) formulations of mTSP, MDVRP, and FMDVRP.

Original: A. M TSP
Revised: A. M TSP

Original: mTSP is a multi-vehicle extension of the traveling salesman problem (TSP).
Revised: mTSP is a multi-vehicle extension of the traveling salesman problem (TSP).

Original: mTSP comprises of a set of the nodes (i.e., cities) and depot V , a set of vehicles K , and a set of depot S .
Revised: mTSP comprises of a set of the nodes (i.e., cities) and depot V , a set of vehicles K , and a set of depot S .

Original: We define d ij as the cost (or travel time) between node i and j , and the decision variable x ijk denotes whether the edge between node i and j are taken by vehicle k .
Revised: We define d ij as the cost (or travel time) between node i and j , and the decision variable x ijk denotes whether the edge between node i and j are taken by vehicle k .

Original: Following the convention, we consider mTSP with | S | = 1 .
Revised: Following the convention, we consider mTSP with | S | = 1 .

Original: The MILP formulation of mTSP is given as follows: minimize
Revised: The MILP formulation of mTSP is given as follows: minimize

Original: Q (A.1) subject to.
Revised: Q (A.1) subject to.

Original: (cid:88) i ∈ V (cid:88)
Revised: (cid:88) i ∈ V (cid:88)

Original: j ∈ V d ij x ijk ≤ Q, ∀ k ∈ K : i ̸
Revised: j ∈ V d ij x ijk ≤ Q, ∀ k ∈ K : i ̸

Original: = j, (A.2) (cid:88) j ∈ V i ̸ =
Revised: = j, (A.2) (cid:88) j ∈ V i ̸ =

Original: j x ijk = 1 , ∀ k ∈ K, ∀ i ∈ S, (A.3) (cid:88) i ∈
Revised: j x ijk = 1 , ∀ k ∈ K, ∀ i ∈ S, (A.3) (cid:88) i ∈

Original: V j ̸ = i (cid:88)
Revised: V j ̸ = i (cid:88)

Original: k ∈ T x ijk = 1 , ∀ j ∈ V \ S (A.4) (cid:88)
Revised: k ∈ T x ijk = 1 , ∀ j ∈ V \ S (A.4) (cid:88)

Original: i ∈ V
Revised: i ∈ V

Original: i ̸
Revised: i ̸

Original: = j x ijk − (cid:88)
Revised: = j x ijk − (cid:88)

Original: h ∈
Revised: h ∈

Original: V
Revised: V

Original: h ̸
Revised: h ̸

Original: = j x jhk = 0 , ∀ j ∈ V \ S (A.5) u
Revised: = j x jhk = 0 , ∀ j ∈ V \ S (A.5) u

Original: ik − u jk + | V | x ijk ≤ | V | − 1 , ∀ k ∈ K, j ∈ V \ S : i ̸
Revised: ik − u jk + | V | x ijk ≤ | V | − 1 , ∀ k ∈ K, j ∈ V \ S : i ̸

Original: = j, (A.6) 0 ≤ u ik ≤ | V | − 1 , ∀ k ∈ K, i ∈ V \ S (A.7) x ijk ∈ { 0 , 1 } , ∀ k ∈ K, ∀ i, j ∈ V, (A.8)
Revised: = j, (A.6) 0 ≤ u ik ≤ | V | − 1 , ∀ k ∈ K, i ∈ V \ S (A.7) x ijk ∈ { 0 , 1 } , ∀ k ∈ K, ∀ i, j ∈ V, (A.8)

Original: u ik ∈ Z , ∀ k ∈
Revised: u ik ∈ Z , ∀ k ∈

Original: [Equation]
Revised: [Equation]

Original: (A.9) where Q denotes the longest traveling distance among multiple vehicles.
Revised: (A.9) where Q denotes the longest traveling distance among multiple vehicles.

Original: (i.e., makespan), Eq.
Revised: (i.e., makespan), Eq.

Original: (A.3) indicates the vehicles start at the depot, Eq.
Revised: (A.3) indicates the vehicles start at the depot, Eq.

Original: (A.4) indicates that all cities are visited, Eq.
Revised: (A.4) indicates that all cities are visited, Eq.

Original: (A.5) indicates the balance equation for all cities, Eq.
Revised: (A.5) indicates the balance equation for all cities, Eq.

Original: (A.6) and Eq.
Revised: (A.6) and Eq.

Original: (A.7) indicate the sub-tour eliminations.
Revised: (A.7) indicate the sub-tour eliminations.

Original: A. MDVRP
Revised: A. MDVRP

Original: Multi-depot VRP is a multi-depot extension of mTSP (Appendix A.1), where each vehicle starts from its own designated depot and returns to the depot.
Revised: Multi-depot VRP is a multi-depot extension of mTSP (Appendix A.1), where each vehicle starts from its own designated depot and returns to the depot.

Original: We extend the MILP formulation of mTSP to define the MILP formulation of MDVRP.
Revised: We extend the MILP formulation of mTSP to define the MILP formulation of MDVRP.

Original: On top of the mTSP formulation, we define K i , which indicates the set of vehicles assigned to the depot i .
Revised: On top of the mTSP formulation, we define K i , which indicates the set of vehicles assigned to the depot i .

Original: minimize
Revised: minimize

Original: Q (A.10) subject to.
Revised: Q (A.10) subject to.

Original: (cid:88)
Revised: (cid:88)

Original: [Equation]
Revised: [Equation]

Original: V (cid:88)
Revised: V (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (A.11) (cid:88)
Revised: (A.11) (cid:88)

Original: [Equation]
Revised: [Equation]

Original: ̸
Revised: ̸

Original: [Equation]
Revised: [Equation]

Original: (cid:88)
Revised: (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (A.12) (cid:88)
Revised: (A.12) (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (cid:88)
Revised: (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (A.13) (cid:88)
Revised: (A.13) (cid:88)

Original: [Equation]
Revised: [Equation]

Original: h
Revised: h

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: K (A.14)
Revised: K (A.14)

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: K
Revised: K

Original: [Equation]
Revised: [Equation]

Original: =
Revised: =

Original: j
Revised: j

Original: [Equation]
Revised: [Equation]

Original: (A.15)
Revised: (A.15)

Original: [Equation]
Revised: [Equation]

Original: K
Revised: K

Original: [Equation]
Revised: [Equation]

Original: S (A.16)
Revised: S (A.16)

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: (A.17)
Revised: (A.17)

Original: [Equation]
Revised: [Equation]

Original: (A.18) (cid:88)
Revised: (A.18) (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (A.19) (cid:88)
Revised: (A.19) (cid:88)

Original: [Equation]
Revised: [Equation]

Original: (A.20)
Revised: (A.20)

Original: where Eq.
Revised: where Eq.

Original: (A.19) and
Revised: (A.19) and

Original: vehicle
Revised: vehicle

Original: returns
Revised: returns

Original: depot
Revised: depot

Original: A. FMDVRP
Revised: A. FMDVRP

Original: Flexible MDVRP (FMDVRP) is an extension of MDVRP, allowing the vehicle to return to any depot.
Revised: Flexible MDVRP (FMDVRP) is an extension of MDVRP, allowing the vehicle to return to any depot.

Original: We extend the MDVRP formulation (Appendix A.2) to define the FMDVRP formulation.
Revised: We extend the MDVRP formulation (Appendix A.2) to define the FMDVRP formulation.

Original: To account for the flexibility of the returning depot, we introduce a dummy node for all depots; a depot is modeled with a start and return depot.
Revised: To account for the flexibility of the returning depot, we introduce a dummy node for all depots; a depot is modeled with a start and return depot.

Original: We define S 1 and S 2 as the set of start and return depots and s k as the start node of the vehicle k .
Revised: We define S 1 and S 2 as the set of start and return depots and s k as the start node of the vehicle k .

Original: minimize
Revised: minimize

Original: Q (A.21) subject to.
Revised: Q (A.21) subject to.

Original: (cid:88) i ∈ V (cid:88)
Revised: (cid:88) i ∈ V (cid:88)

Original: j ∈ V d ij x ijk ≤ Q, ∀ k ∈ K : i ̸
Revised: j ∈ V d ij x ijk ≤ Q, ∀ k ∈ K : i ̸

Original: = j, (A.22) (cid:88) j ∈ V j ̸ = i (cid:88)
Revised: = j, (A.22) (cid:88) j ∈ V j ̸ = i (cid:88)

Original: k ∈ T x ijk = 1 , ∀ i ∈ V \ S (A.23) (cid:88) i ∈
Revised: k ∈ T x ijk = 1 , ∀ i ∈ V \ S (A.23) (cid:88) i ∈

Original: V j ̸ = i (cid:88)
Revised: V j ̸ = i (cid:88)

Original: k ∈ T x ijk = 1 , ∀ j ∈ V \ S (A.24) (cid:88)
Revised: k ∈ T x ijk = 1 , ∀ j ∈ V \ S (A.24) (cid:88)

Original: i ∈ V x ijk − (cid:88) h ∈ V x jhk = 0 , ∀ j ∈ V \ S, ∀ k ∈ K (A.25) u
Revised: i ∈ V x ijk − (cid:88) h ∈ V x jhk = 0 , ∀ j ∈ V \ S, ∀ k ∈ K (A.25) u

Original: ik − u jk + | V | x ijk ≤ | V | − 1 , ∀ k ∈ K, j ∈ V \ S : i ̸
Revised: ik − u jk + | V | x ijk ≤ | V | − 1 , ∀ k ∈ K, j ∈ V \ S : i ̸

Original: = j, (A.26) 

Revised: = j, (A.26)

Original: ≤ u ik ≤ | V | − 1 , ∀ k ∈ K, i ∈ V \ S (A.27) x ijk ∈ { 0 , 1 } , ∀ k ∈ K, ∀ i, j ∈ V, (A.28)
Revised: ≤ u ik ≤ | V | − 1 , ∀ k ∈ K, i ∈ V \ S (A.27) x ijk ∈ { 0 , 1 } , ∀ k ∈ K, ∀ i, j ∈ V, (A.28)

Original: u ik ∈ Z , ∀ k ∈ K, i ∈ V (A.29) (cid:88)
Revised: u ik ∈ Z , ∀ k ∈ K, i ∈ V (A.29) (cid:88)

Original: j ∈ V \ S x s k jk
Revised: j ∈ V \ S x s k jk

Original: = 1 , ∀ k ∈ K (A.30) (cid:88)
Revised: = 1 , ∀ k ∈ K (A.30) (cid:88)

Original: j ∈ V \ S x ijk = 0 , ∀ k ∈ K, ∀ i ∈ S \ s k (A.31) (cid:88)
Revised: j ∈ V \ S x ijk = 0 , ∀ k ∈ K, ∀ i ∈ S \ s k (A.31) (cid:88)

Original: j ∈ V \ S x ijk ≤ 1 , ∀
Revised: j ∈ V \ S x ijk ≤ 1 , ∀

Original: [Equation]
Revised: [Equation]

Original: K
Revised: K

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: (A.32) (cid:88)
Revised: (A.32) (cid:88)

Original: i ∈
Revised: i ∈

Original: V \ S x
Revised: V \ S x

Original: [Equation]
Revised: [Equation]

Original: 1 , ∀ k ∈
Revised: 1 , ∀ k ∈

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: (A.33) (cid:88)
Revised: (A.33) (cid:88)

Original: j
Revised: j

Original: [Equation]
Revised: [Equation]

Original: V \ S
Revised: V \ S

Original: [Equation]
Revised: [Equation]

Original: (A.34) (cid:88)
Revised: (A.34) (cid:88)

Original: j
Revised: j

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: (A.35) (cid:88) i ∈
Revised: (A.35) (cid:88) i ∈

Original: [Equation]
Revised: [Equation]

Original: (cid:88)
Revised: (cid:88)

Original: j
Revised: j

Original: [Equation]
Revised: [Equation]

Original: (cid:88)
Revised: (cid:88)

Original: [Equation]
Revised: [Equation]

Original: x
Revised: x

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: (A.36)
Revised: (A.36)

Original: where Eqs.
Revised: where Eqs.

Original: (A.30) and (A.31) indicate that each vehicle starts at its own depot.
Revised: (A.30) and (A.31) indicate that each vehicle starts at its own depot.

Original: Eqs.
Revised: Eqs.

Original: (A.32) to (A.35) indicate the start and return depots constraints.
Revised: (A.32) to (A.35) indicate the start and return depots constraints.

Original: Eq.
Revised: Eq.

Original: (A.36) indicates the balance equation of the start and return depots.
Revised: (A.36) indicates the balance equation of the start and return depots.

Original: B MIN - MAX MDVRP RESULTS
Revised: B MIN - MAX MDVRP RESULTS

Original: In this section
Revised: In this section

Original: [Table]
Revised: [Table]

Original: we provide the experiment results of MDVRP.
Revised: we provide the experiment results of MDVRP.

Original: We apply NCE with the f θ trained on FMDVRP instances to solve MDVRP.
Revised: We apply NCE with the f θ trained on FMDVRP instances to solve MDVRP.

Original: For each ( N c , N d , N v ) pair, we measure the average makespan of 100 instances.
Revised: For each ( N c , N d , N v ) pair, we measure the average makespan of 100 instances.

Original: We provide the MDVRP results in Tables A.1 to A.3.
Revised: We provide the MDVRP results in Tables A.1 to A.3.

Original: Similar to the
Revised: Similar to the

Original: FMDVRP experiments, NCE shows leading performance while being faster than the baselines.
Revised: FMDVRP experiments, NCE shows leading performance while being faster than the baselines.

Original: From the results, we can conclude that the learned f θ is transferable to the different problem sets.
Revised: From the results, we can conclude that the learned f θ is transferable to the different problem sets.

Original: This phenomenon is rare in many ML-based approaches.
Revised: This phenomenon is rare in many ML-based approaches.

Original: It again highlights the effectiveness of learning fundamental operators (i.e., learn what should be cross exchanged) when solving the VRP families
Revised: It again highlights the effectiveness of learning fundamental operators (i.e., learn what should be cross exchanged) when solving the VRP families

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: 22411 Greedy 2.
Revised: 22411 Greedy 2.

Original: 2.69 Greedy + TSP 2.
Revised: 2.69 Greedy + TSP 2.

Original: NCE 1.
Revised: NCE 1.

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: C MIN - MAX M TSP RESULTS
Revised: C MIN - MAX M TSP RESULTS

Original: In this section
Revised: In this section

Original: [Table]
Revised: [Table]

Original: we provide the additional experiment results of mTSP.
Revised: we provide the additional experiment results of mTSP.

Original: We further apply NCE to solve mTSPLib (mTSPLib), which comprises of mTSP instances from real cities, and large scale problem.
Revised: We further apply NCE to solve mTSPLib (mTSPLib), which comprises of mTSP instances from real cities, and large scale problem.

Original: As reported in Table A.4 and Table A.5 NCE achieves the best results as compared to the baselines.
Revised: As reported in Table A.4 and Table A.5 NCE achieves the best results as compared to the baselines.

Original: [Table] [Table]
Revised: [Table] [Table]

Original: D MIN - MAX CVRP RESULTS
Revised: D MIN - MAX CVRP RESULTS

Original: We also provide min-max CVRP results for CVRPlib.
Revised: We also provide min-max CVRP results for CVRPlib.

Original: We include two local search heuristic baselines N2 (Pham et al., 2017) and NMCF (Van Nguyen et al., 2017).
Revised: We include two local search heuristic baselines N2 (Pham et al., 2017) and NMCF (Van Nguyen et al., 2017).

Original: We evaluate each instancetimes and average it.
Revised: We evaluate each instancetimes and average it.

Original: As shown in Table A.6, NCE outperforms other Operation Research baselines in terms of computation speed and cost.
Revised: As shown in Table A.6, NCE outperforms other Operation Research baselines in terms of computation speed and cost.

Original: [Table]
Revised: [Table]

Original: E MIN - SUM CVRP RESULTS
Revised: E MIN - SUM CVRP RESULTS

Original: In this section
Revised: In this section

Original: [Table]
Revised: [Table]

Original: we provide the results for min-sum CVRP benchmark instances.
Revised: we provide the results for min-sum CVRP benchmark instances.

Original: To solve min-sum
Revised: To solve min-sum

Original: CVRP, we trained NCE to predict min-sum cost decrement with C ( τ 1 , τ 2 ) defined as l ( τ 1 )
Revised: CVRP, we trained NCE to predict min-sum cost decrement with C ( τ 1 , τ 2 ) defined as l ( τ 1 )

Original: + l ( τ 2 ) .
Revised: + l ( τ 2 ) .

Original: As shown in Table A.
Revised: As shown in Table A.

Original: [Table]
Revised: [Table]

Original: NCE is on par with or outperforms other neural baselines.
Revised: NCE is on par with or outperforms other neural baselines.

Original: However, NCE is not efficient in terms of computation speed.
Revised: However, NCE is not efficient in terms of computation speed.

Original: This is because we initially design the CE operation to solve the min-max VRPs not min-sum VRPs.
Revised: This is because we initially design the CE operation to solve the min-max VRPs not min-sum VRPs.

Original: According to the experimental results, when CE operation is conducted to reduce the min-sum cost of two tours, it typically requires larger iterations to improve the solution to near optimum.
Revised: According to the experimental results, when CE operation is conducted to reduce the min-sum cost of two tours, it typically requires larger iterations to improve the solution to near optimum.

Original: This results indicates that other (local) search operator is required to efficiently solve the min-sum problems
Revised: This results indicates that other (local) search operator is required to efficiently solve the min-sum problems

Original: [Table] [Table]
Revised: [Table] [Table]

Original: F A BLATION STUDY
Revised: F A BLATION STUDY

Original: In this section
Revised: In this section

Original: [Table]
Revised: [Table]

Original: we provide the results of the ablation studies.
Revised: we provide the results of the ablation studies.

Original: F. C ANDIDATE SET
Revised: F. C ANDIDATE SET

Original: NCE constructed a search candidate set.
Revised: NCE constructed a search candidate set.

Original: To mitigate the prediction error of f θ ( · ) in finding the argmax of ( a 1 , a 2 , b 1 , b 2 ) , NCE search the top K pairs of ( a 1 , a 2 ) that have the largest y ∗ out of all ( a 1 , a 2 ) choices.
Revised: To mitigate the prediction error of f θ ( · ) in finding the argmax of ( a 1 , a 2 , b 1 , b 2 ) , NCE search the top K pairs of ( a 1 , a 2 ) that have the largest y ∗ out of all ( a 1 , a 2 ) choices.

Original: We measure how the performance changes whenever the size of the candidate set
Revised: We measure how the performance changes whenever the size of the candidate set

Original: K changes.
Revised: K changes.

Original: As shown in Table A.8, as the size of K increases, the performance tends to increase slightly.
Revised: As shown in Table A.8, as the size of K increases, the performance tends to increase slightly.

Original: When K ≥ 10 , the performance of NCE almost converges.
Revised: When K ≥ 10 , the performance of NCE almost converges.

Original: Thus, we choose K = 10 as the default hyperparameter of NCE.
Revised: Thus, we choose K = 10 as the default hyperparameter of NCE.

Original: [Table]
Revised: [Table]

Original: F. I NTRA - SOLVER
Revised: F. I NTRA - SOLVER

Original: NCE repeatedly applies the inter- and intra-operation.
Revised: NCE repeatedly applies the inter- and intra-operation.

Original: In this view, the choice of the intra-operation may affect the performance of NCE.
Revised: In this view, the choice of the intra-operation may affect the performance of NCE.

Original: In this subsection, we measured the performance of NCE according to intra-operation.
Revised: In this subsection, we measured the performance of NCE according to intra-operation.

Original: We compare the results of NCE that uses Elkai, OR-tools
Revised: We compare the results of NCE that uses Elkai, OR-tools

Original: [Table]
Revised: [Table]

Original: and 2-opt as the intra-operator.
Revised: and 2-opt as the intra-operator.

Original: To solve TSP – the task intra-operator has to solve –, Elkai, OR-tools, and 2-opt show the best, second best, and third best performances.
Revised: To solve TSP – the task intra-operator has to solve –, Elkai, OR-tools [Table] and 2-opt show the best, second best, and third best performances.

Original: As shown in Table A.9, the performances of NCE are almost identical to the selection of an intra-operator.
Revised: As shown in Table A.9, the performances of NCE are almost identical to the selection of an intra-operator.

Original: We validate that the effect of the intra-operation choice is negligible to the performance.
Revised: We validate that the effect of the intra-operation choice is negligible to the performance.

Original: [Table]
Revised: [Table]

Original: . S ELECTING TWO VEHICLES
Revised: . S ELECTING TWO VEHICLES

Original: NCE chooses two tours for improvement during the iterative process.
Revised: NCE chooses two tours for improvement during the iterative process.

Original: To understand the effect of the tour selection strategy, we measure the performance of NCE according to tour selection.
Revised: To understand the effect of the tour selection strategy, we measure the performance of NCE according to tour selection.

Original: We compare NCE results in a max-min selection case and a random selection case (i.e., pick two tours randomly).
Revised: We compare NCE results in a max-min selection case and a random selection case (i.e., pick two tours randomly).

Original: As shown in Table A.10, the performances of NCE are almost identical to the tour selection strategy.
Revised: As shown in Table A.10, the performances of NCE are almost identical to the tour selection strategy.

Original: Therefore, we validate that the effect of the tour selection strategy is negligible.
Revised: Therefore, we validate that the effect of the tour selection strategy is negligible.

Original: [Table]
Revised: [Table]

Original: F. P ERTURBATION
Revised: F. P ERTURBATION

Original: NCE employs perturbation to increase performance.
Revised: NCE employs perturbation to increase performance.

Original: Perturbation is a commonly used strategy for enhancing the performance of meta-heuristics (Polat et al., 2015).
Revised: Perturbation is a commonly used strategy for enhancing the performance of meta-heuristics (Polat et al., 2015).

Original: It is done by randomly perturbing the solution and solving the problem with the perturbed solutions.
Revised: It is done by randomly perturbing the solution and solving the problem with the perturbed solutions.

Original: This technique is beneficial to escape from the local optima.
Revised: This technique is beneficial to escape from the local optima.

Original: As described in Algorithm 1, when falling into the local optima,
Revised: As described in Algorithm 1, when falling into the local optima,

Original: NCE randomly selects two tours and performs a random exchange.
Revised: NCE randomly selects two tours and performs a random exchange.

Original: We compare the performance of NCE with different perturbations.
Revised: We compare the performance of NCE with different perturbations.

Original: As shown in Table A.
Revised: As shown in Table A.

Original: [Table]
Revised: [Table]

Original: the performance of NCE increases and converges as the number of perturbations p increases.
Revised: the performance of NCE increases and converges as the number of perturbations p increases.

Original: When p = 5 , the performance of NCE converges.
Revised: When p = 5 , the performance of NCE converges.

Original: Thus, we choose p = 5 as the default hyperparameter of NCE.
Revised: Thus, we choose p = 5 as the default hyperparameter of NCE.

Original: [Table]
Revised: [Table]

Original: G T RAINING D ETAIL
Revised: G T RAINING D ETAIL

Original: Dataset preparation.
Revised: Dataset preparation.

Original: To train the cost-decrement prediction model f θ ( · ) , we generate 50, random FMDVRP instances.
Revised: To train the cost-decrement prediction model f θ ( · ) , we generate 50, random FMDVRP instances.

Original: The random instance is generated by first sampling the number of customer N c and depots N d from U (10 , 100) and U (2 , 9) and N v = 2 respectively, and then sampling the 2D coordinates of the cities from U (0 , 1) .
Revised: The random instance is generated by first sampling the number of customer N c and depots N d from U (10 , 100) and U (2 , 9) and N v = 2 respectively, and then sampling the 2D coordinates of the cities from U (0 , 1) .

Original: As we set N v = 2 , we generate two tours by applying the initial solution construction heuristics explained in Section 3.1.
Revised: As we set N v = 2 , we generate two tours by applying the initial solution construction heuristics explained in Section 3.1.

Original: From τ 1 , τ 2 , we compute the best true cost-decrements of all feasible ( a 1 , a 2 ) to prepare the training dataset.
Revised: From τ 1 , τ 2 , we compute the best true cost-decrements of all feasible ( a 1 , a 2 ) to prepare the training dataset.

Original: We generated 47,856,986 training samples from the 50,000 instances.
Revised: We generated 47,856,986 training samples from the 50,000 instances.

Original: Hyperparameters.
Revised: Hyperparameters.

Original: f θ ( · ) is parametrized via the GNN which employs five layers of the attentive embedding layer.
Revised: f θ ( · ) is parametrized via the GNN which employs five layers of the attentive embedding layer.

Original: We employ 4 layered MLPs to parameterize ϕ e , ϕ w , ϕ n and ϕ c , whose hidden dimensions and activation units are 64 and Mish (Misra, 2019).
Revised: We employ 4 layered MLPs to parameterize ϕ e , ϕ w , ϕ n and ϕ c , whose hidden dimensions and activation units are 64 and Mish (Misra, 2019).

Original: f θ ( · ) is trained to minimize the
Revised: f θ ( · ) is trained to minimize the

Original: Huber loss for three epochs via AdamW (Loshchilov & Hutter, 2017) whose learning rate is fixed as 5 × 10 − 4 .
Revised: Huber loss for three epochs via AdamW (Loshchilov & Hutter, 2017) whose learning rate is fixed as 5 × 10 − 4 .

Original: Computing resources.
Revised: Computing resources.

Original: We run all experiments on the server equipped with AMD Threadripper 2990WX CPU and Nvidia RTX 3090 GPU.
Revised: We run all experiments on the server equipped with AMD Threadripper 2990WX CPU and Nvidia RTX 3090 GPU.

Original: We use a single CPU core to evaluate all algorithms.
Revised: We use a single CPU core to evaluate all algorithms.

Original: H E VALUATION OF THE COST DECREMENT MODEL
Revised: H E VALUATION OF THE COST DECREMENT MODEL

Original: In this section
Revised: In this section

Original: [Figure]
Revised: [Figure]

Original: we evaluate the prediction accuracy of f θ ( · ) .
Revised: we evaluate the prediction accuracy of f θ ( · ) .

Original: To evaluate f θ ( · ) , we randomly generate 1,000 FMDVRP instances by sampling N C ∼ U (10 , 100) and N D ∼ U (2 , 9) , and ( x, y ) ∼ U (0 , 1) 2 .
Revised: To evaluate f θ ( · ) , we randomly generate 1,000 FMDVRP instances by sampling N C ∼ U (10 , 100) and N D ∼ U (2 , 9) , and ( x, y ) ∼ U (0 , 1) 2 .

Original: From the instances, we measure the ratio of existence of the argmax ( a 1 , a 2 ) pair in the search candidate set whose size is K .
Revised: From the instances, we measure the ratio of existence of the argmax ( a 1 , a 2 ) pair in the search candidate set whose size is K .

Original: As shown in Table A.12, when K ≥ 10 , NCE can find the argmax pair with at least 0 .
Revised: As shown in Table A.12, when K ≥ 10 , NCE can find the argmax pair with at least 0 .

Original: 9 probability.
Revised: 9 probability.

Original: We also provide the results of the cost-decrement predictions and its corresponding cost.
Revised: We also provide the results of the cost-decrement predictions and its corresponding cost.

Original: As shown in Fig.
Revised: As shown in Fig.

Original: A.1, f θ ( · ) predicts the general tendency well.
Revised: A.1, f θ ( · ) predicts the general tendency well.

Original: [Table]
Revised: [Table]

Original: [Figure]
Revised: [Figure]

Original: P r e d i c t e d c o s t - d e c r e m e n t
Revised: P r e d i c t e d c o s t - d e c r e m e n t

Original: I C OMPARISON WITH FULL SEARCH
Revised: I C OMPARISON WITH FULL SEARCH

Original: To verify whether NCE successfully amotrizes CE, we evaluate CE and NCE( K =10, p =0) on FMDVRP.
Revised: To verify whether NCE successfully amotrizes CE, we evaluate CE and NCE( K =10, p =0) on FMDVRP.

Original: For the testing instances, we randomly generate 100 instances for each N c ∈ { 20 , 30 , 40 , 50 , 60 , 70 , 80 , 90 , 100 } with the fixed N d = 3 and N v = 3 .
Revised: For the testing instances, we randomly generate 100 instances for each N c ∈ { 20 , 30 , 40 , 50 , 60 , 70 , 80 , 90 , 100 } with the fixed N d = 3 and N v = 3 .

Original: As shown in Table A.13,
Revised: As shown in Table A.13,

Original: NCE shows nearly identical performances with CE, but with significantly faster computation speed than CE as shown in Fig.
Revised: NCE shows nearly identical performances with CE, but with significantly faster computation speed than CE as shown in Fig.

Original: A.2.
Revised: A.2.

Original: We also test the mTSP and CVRP cases as shown in Table A.14.
Revised: We also test the mTSP and CVRP cases as shown in Table A.14.

Original: [Table]
Revised: [Table]

Original: 100 Number of c stomer 10 − 

Revised: 100 Number of c stomer 10 −

Original: C o m p t a t i o n t i m e : l o g s c a l e
Revised: C o m p t a t i o n t i m e : l o g s c a l e

Original: [Figure]
Revised: [Figure]

Original: comparison f ll search NCE
Revised: comparison f ll search NCE

Original: [Table]
Revised: [Table]

Original: cost time cost time cost time
Revised: cost time cost time cost time

Original: [Table]
Revised: [Table]

Original: cost time cost time
Revised: cost time cost time

Original: [Table]
Revised: [Table]

Original: J E XAMPLE SOLUTIONS
Revised: J E XAMPLE SOLUTIONS

Original: This section provides the routing examples.
Revised: This section provides the routing examples.

Original: Fig.
Revised: Fig.

Original: A.3 shows the solution of Rat99-2 computed by
Revised: A.3 shows the solution of Rat99-2 computed by

Original: LKH-3 and NCE.
Revised: LKH-3 and NCE.

Original: Figs.
Revised: Figs.

Original: A.4 and A.5 shows the solution of a FMDVRP and MDVRP instance computed by OR-Tools and NCE.
Revised: A.4 and A.5 shows the solution of a FMDVRP and MDVRP instance computed by OR-Tools and NCE.

Original: D
Revised: D

Original: NCE
Revised: NCE

Original: D
Revised: D

Original: LKH-
Revised: LKH-

Original: [Figure]
Revised: [Figure]

Original: D D
Revised: D D

Original: D D
Revised: D D

Original: D
Revised: D

Original: NCE FMDVRP 0.
Revised: NCE FMDVRP 0.

Original: D
Revised: D

Original: D D
Revised: D D

Original: D D
Revised: D D

Original: OR-tools FMDVRP
Revised: OR-tools FMDVRP

Original: D D
Revised: D D

Original: D D
Revised: D D

Original: D
Revised: D

Original: NCE MDVRP 0.
Revised: NCE MDVRP 0.

Original: D
Revised: D

Original: D D
Revised: D D

Original: D D
Revised: D D

Original: OR-tools MDVRP
Revised: OR-tools MDVRP

Original: K C ASE STUDY : PLANNING PATH FOR STERILIZING ROBOTS
Revised: K C ASE STUDY : PLANNING PATH FOR STERILIZING ROBOTS

Original: We applied the trained NCE to solve a real-world application, the task of deriving the cooperative path for multiple sterilizing robots to sterilize the open space of a building in the minimum time.
Revised: We applied the trained NCE to solve a real-world application, the task of deriving the cooperative path for multiple sterilizing robots to sterilize the open space of a building in the minimum time.

Original: Here, the task nodes correspond to the spatial grids composing the entire building floor area, as shown in Fig.
Revised: Here, the task nodes correspond to the spatial grids composing the entire building floor area, as shown in Fig.

Original: A.6.
Revised: A.6.

Original: It consists of a total of 500 grids, of which 25 are obstacle areas (gray grids) that a robot cannot move into, and 99 are contaminated areas (orange grids) a robots need to sterilize.
Revised: It consists of a total of 500 grids, of which 25 are obstacle areas (gray grids) that a robot cannot move into, and 99 are contaminated areas (orange grids) a robots need to sterilize.

Original: We assume the traveling time between the two adjacent grids is 1, the service time for the general area (green grids) is 1, and 2 for the contaminated areas.
Revised: We assume the traveling time between the two adjacent grids is 1, the service time for the general area (green grids) is 1, and 2 for the contaminated areas.

Original: The upper left corner is the starting point.
Revised: The upper left corner is the starting point.

Original: We formulate finding the cooperative paths for multiple robots to minimize the operation time as the min-max mTSP problem.
Revised: We formulate finding the cooperative paths for multiple robots to minimize the operation time as the min-max mTSP problem.

Original: Fig.
Revised: Fig.

Original: A.7 shows the path derived from NCE when there are 1 to 5 robots, and Table A.15 shows the time and objective value of solving the problem for each algorithm.
Revised: A.7 shows the path derived from NCE when there are 1 to 5 robots, and Table A.15 shows the time and objective value of solving the problem for each algorithm.

Original: The results show that the NCE algorithm trained using a synthetic dataset can produce an efficient cooperative path for multiple robots without retraining or fine-tuning.
Revised: The results show that the NCE algorithm trained using a synthetic dataset can produce an efficient cooperative path for multiple robots without retraining or fine-tuning.

Original: NCE reduces more than 10% of the makespan compared to
Revised: NCE reduces more than 10% of the makespan compared to

Original: Google OR-tool and 20% to Greedy+TSP when the number of robots is 5.
Revised: Google OR-tool and 20% to Greedy+TSP when the number of robots is 5.

Original: Note that the distribution of tasks is far from uniform distribution; each grid is clustered, and each cluster is separated due to the unique floor plan of a building.
Revised: Note that the distribution of tasks is far from uniform distribution; each grid is clustered, and each cluster is separated due to the unique floor plan of a building.

Original: Thus, the experiment results verify the generalization capability of NCE to problem instances generated from a different distribution.
Revised: Thus, the experiment results verify the generalization capability of NCE to problem instances generated from a different distribution.

Original: [Figure]
Revised: [Figure]

Original: [Table]
Revised: [Table]

Original: L B ALANCE BETWEEN PERFORMANCE AND COMPUTATION TIME
Revised: L B ALANCE BETWEEN PERFORMANCE AND COMPUTATION TIME

Original: Because NCE is an improvement heuristic, the more computation time is used, the better outcome will be produced.
Revised: Because NCE is an improvement heuristic, the more computation time is used, the better outcome will be produced.

Original: Thus, we investigate how the performance varies with the allowed computation time.
Revised: Thus, we investigate how the performance varies with the allowed computation time.

Original: We sampled 100 instances of FMDVRP ( N c , N d , N v ) =(60, 5, 5) and computed the average cost and computation time of NCE and baselines on these problem instances.
Revised: We sampled 100 instances of FMDVRP ( N c , N d , N v ) =(60, 5, 5) and computed the average cost and computation time of NCE and baselines on these problem instances.

Original: Fig.
Revised: Fig.

Original: A.8 depicts the relationships between “Run time (computational cost) vs. Cost curve” in the form of a Pareto curve for the case of FMDVRP ( N c , N d , N v ) =(60, 5, 5).
Revised: A.8 depicts the relationships between “Run time (computational cost) vs. Cost curve” in the form of a Pareto curve for the case of FMDVRP ( N c , N d , N v ) =(60, 5, 5).

Original: The result shows how the performance of NCE improves with more computation time, and this trend is always superior to another baseline.
Revised: The result shows how the performance of NCE improves with more computation time, and this trend is always superior to another baseline.

Original: [Figure]
Revised: [Figure]

Original: M G ENERALIZATION TO DIFFERENT DISTRIBUTION
Revised: M G ENERALIZATION TO DIFFERENT DISTRIBUTION

Original: We investigate the generalization capability of NCE to the problem instances generated from different distributions.
Revised: We investigate the generalization capability of NCE to the problem instances generated from different distributions.

Original: We have employed the NCE trained by FMDVRP random instances to the problems generated by the different distributions introduced in (Bi et al., 2022).
Revised: We have employed the NCE trained by FMDVRP random instances to the problems generated by the different distributions introduced in (Bi et al., 2022).

Original: We used cluster, expansion, explosion, grid, implosion
Revised: We used cluster, expansion, explosion, grid, implosion

Original: [Table]
Revised: [Table]

Original: and mixed distribution as unseen distributions for testing.
Revised: and mixed distribution as unseen distributions for testing.

Original: We followed the definition in the (Bossek et al., 2019; Jiang et al., 2022;
Revised: We followed the definition in the (Bossek et al., 2019; Jiang et al., 2022;

Original: Bi et al., 2022)
Revised: Bi et al., 2022)

Original: [Table]
Revised: [Table]

Original: and the data were taken from the (Bi et al., 2022).
Revised: and the data were taken from the (Bi et al., 2022).

Original: Table A.16 summarizes the experiment result.
Revised: Table A.16 summarizes the experiment result.

Original: As in the case of uniform distribution, NCE shows leading performance while being faster than OR-Tools and CE.
Revised: As in the case of uniform distribution, NCE shows leading performance while being faster than OR-Tools and CE.

Original: Note that we did not retrain our NCE algorithm but just employed the already trained existing NCE algorithm to new distribution tasks.
Revised: Note that we did not retrain our NCE algorithm but just employed the already trained existing NCE algorithm to new distribution tasks.

Original: From the results
Revised: From the results

Original: [Table]
Revised: [Table]

Original: we can conclude that the learned f θ is generalizable to the different distributions other than the uniform.
Revised: we can conclude that the learned f θ is generalizable to the different distributions other than the uniform.

Original: It again highlights the effectiveness of learning fundamental operators when solving the VRP families.
Revised: It again highlights the effectiveness of learning fundamental operators when solving the VRP families.

Original: [Table]
Revised: [Table]