Original: Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network
Revised: Learning Heterogeneous Interaction Strengths by Trajectory Prediction with Graph Neural Network

Original: Anonymous Author(s)

Original: AfﬁliationAddress

Original: Abstract
Revised: Abstract

Original: Dynamical systems with interacting agents are universal in nature, commonlymodeled by a graph of relationships between their constituents.
Revised: Dynamical systems with interacting agents are universal in nature, commonly modeled by a graph of relationships between their constituents.

Original: Recently, variousworks have been presented to tackle the problem of inferring those relationshipsfrom the system trajectories via deep neural networks, but most of the studiesassume binary or discrete types of interactions for simplicity.
Revised: Recently, various works have been presented to tackle the problem of inferring those relationships from the system trajectories via deep neural networks, but most of the studies assume binary or discrete types of interactions for simplicity.

Original: In the real world, theinteraction kernels often involve continuous interaction strengths, which cannotbe accurately approximated by discrete relations.
Revised: In the real world, the interaction kernels often involve continuous interaction strengths, which cannot be accurately approximated by discrete relations.

Original: In this work, we propose therelational attentive inference network (RAIN) to infer continuously weighted interaction graphs without any ground-truth interaction strengths.
Revised: In this work, we propose the relational attentive inference network (RAIN) to infer continuously weighted interaction graphs without any ground-truth interaction strengths.

Original: Our model employs anovel pairwise attention (PA) mechanism to reﬁne the trajectory representationsand a graph transformer to extract heterogeneous interaction weights for each pairof agents.
Revised: Our model employs a novel pairwise attention (PA) mechanism to reﬁne the trajectory representations and a graph transformer to extract heterogeneous interaction weights for each pair of agents.

Original: We show that our RAIN model with the PA mechanism accurately inferscontinuous interaction strengths for simulated physical systems in an unsupervisedmanner.
Revised: We show that our RAIN model with the PA mechanism accurately infers continuous interaction strengths for simulated physical systems in an unsupervised manner.

Original: Further, RAIN with PA successfully predicts trajectories from motioncapture data with an interpretable interaction graph, demonstrating the virtue ofmodeling unknown dynamics with continuous weights.
Revised: Further, RAIN with PA successfully predicts trajectories from motion capture data with an interpretable interaction graph, demonstrating the virtue of modeling unknown dynamics with continuous weights.

Original:  Introduction
Revised:  Introduction

Original: Dynamical systems with interactions provide a fundamental model for a myriad of academic ﬁelds,yet ﬁnding out the form and strength of interactions remains an open problem due to its inherentdegeneracy and complexity.
Revised: Dynamical systems with interactions provide a fundamental model for a myriad of academic ﬁelds, yet ﬁnding out the form and strength of interactions remains an open problem due to its inherent degeneracy and complexity.

Original: Although it is crucial to identify the interaction graph of a complexsystem for understanding its dynamics, disentangling individual interactions from trajectory datawithout any ground-truth labels is a notoriously hard inverse problem.
Revised: Although it is crucial to identify the interaction graph of a complex system for understanding its dynamics, disentangling individual interactions from trajectory data without any ground-truth labels is a notoriously hard inverse problem.

Original: There has been a long history and substantial amount of work on both inferring the network topologyand the nonlinear correlation between interacting constituents from data [2, 4, 3, 19, 9, 7], alongwith the development of various measures to capture the relation between constituents (e g., Pearsoncorrelations, mutual information, transfer entropy, Granger causality and variants thereof [18]).
Revised: There has been a long history and substantial amount of work on both inferring the network topology and the nonlinear interactions between interacting constituents from data [3, 5, 4, 22, 10, 8], along with the development of various measures to capture the relation between constituents (e g., Pearson correlations, mutual information, transfer entropy, Granger causality and variants thereof [21]).

Original: Manyof these inferences focus on speciﬁc systems with the necessity for a model prior, such as domainknowledge of the agent characteristics, proper basis construction, and detailed assumptions on thesystem dynamics.
Revised: Many of these inferences focus on speciﬁc systems with the necessity for a model prior, such as domain knowledge of the agent characteristics, proper basis construction, and detailed assumptions on the system dynamics.

Original: Recently, by phenomenal advances in machine learning, adopting a neural network as a key componentof the interaction inference has gained attention from researchers [21, 11, 23].
Revised: Recently, by phenomenal advances in machine learning, adopting a neural network as a key component of the interaction inference has gained attention from researchers [24, 14, 26].

Original: The key strength ofthese approaches comes from the fact that a neural network enables relatively free-form modeling ofthe system.
Revised: The key strength of these approaches comes from the fact that a neural network enables relatively free-form modeling of the system.

Original: One inﬂuential work in this direction, neural relational inference (NRI) [11], explicitlyinfers edges by predicting the future trajectories of the given system.
Revised: One inﬂuential work in this direction, neural relational inference (NRI) [14], explicitly infers edges by predicting the future trajectories of the given system.

Original: But previous studies forextracting interaction graphs with neural networks [11, 22, 8] mainly focused on inferring edges withdiscrete edge types, which means that they are incapable of distinguishing the edges of different[Figure] RAIN
Revised: But previous studies for extracting interaction graphs with neural networks [14, 25, 9] mainly focused on inferring edges with discrete edge types, which means that they are incapable of distinguishing the edges of different

Original: [Figure]
Revised: [Figure]

Original: weights the learning process interaction strengths with the same type.
Revised: interaction strengths with the same type.

Original: Considering the common occurrence of such heterogeneousinteraction strengths throughout diverse systems, the assumption of discrete edge types severelylimits the expressibility of the model.
Revised: Considering the common occurrence of such heterogeneous interaction strengths throughout diverse systems, the assumption of discrete edge types severely limits the expressibility of the model.

Original: A weighted interaction graph can be expressed in the form of a connectivity matrix, which is aconventional adjacency matrix with continuous-valued entries that indicate the interaction strengths.
Revised: A weighted interaction graph can be expressed in the form of a connectivity matrix, which is a conventional adjacency matrix with continuous-valued entries that indicate the interaction strengths.

Original: One recent study [16] tackles this problem of inferring the connectivity matrix by ﬁrst trainingthe neural network and then additionally applying a ‘graph translator’ to extract continuous graphproperties, which needs a ground-truth label to train.
Revised: One recent study [19] tackles this problem of inferring the connectivity matrix by ﬁrst training the neural network and then additionally applying a ‘graph translator’ to extract continuous graph properties, which needs a ground-truth label to train.

Revised: Also, various attempts for continuous strength inference from machine learning researchers [11, 12, 2] often lack veriﬁcations through the dataset with ground-truth interaction strength.

Original: Several studies from physicists [24, 14]employed perturbation analysis and response dynamics to infer continuous interaction strengths.
Revised: Several studies from physicists [27, 17] employed perturbation analysis and response dynamics to infer continuous interaction strengths, and reported a good agreement with the ground-truth strength.

Original: However, these correlation-based methods usually require more than 10 5 to 10 7 data points for theinference, which is a feasible size for an entire dataset but not for a single instance, and thus the directapplication to experimental data is difﬁcult.
Revised: However, these correlation-based methods usually require more than 10 5 to 10 7 data points for the inference, which is a feasible size for an entire dataset but not for a single instance, and thus the direct application to experimental data is difﬁcult.

Original: In the current work, we propose a neural network called Relational Attentive Inference Network(RAIN) to address the problem of inferring weighted interaction graphs from multivariate trajectorydata in an unsupervised manner.
Revised: In the current work, we propose a neural network called Relational Attentive Inference Network (RAIN) to address the problem of inferring weighted interaction graphs from multivariate trajectory data in an unsupervised manner.

Original: RAIN infers the interaction strength between two agents fromprevious trajectories by learning the attentive weight while simultaneously learning the unknowndynamics of the system and thus is able to precisely predict the future trajectories.
Revised: RAIN infers the interaction strength between two agents from previous trajectories by learning the attentive weight while simultaneously learning the unknown dynamics of the system and thus is able to precisely predict the future trajectories.

Original: Our model employsthe attention mechanism twice: once for the construction of pairwise trajectory embedding and oncefor the actual graph weight extraction.
Revised: Our model employs the attention mechanism twice: once for the construction of pairwise trajectory embedding and once for the actual graph weight extraction.

Original: Differing from previous approaches such as the graph attentionnetwork (GAT) [21], RAIN aims to infer the absolute interaction strength that governs the systemdynamics.
Revised: Differing from previous approaches such as the graph attention network (GAT) [24], RAIN aims to infer the absolute interaction strength that governs the system dynamics.

Original: By comparing the inferred interaction strengths of simulated physical systems with groundtruth values that are not provided at the training stage, we verify that RAIN is capable of inferringboth system dynamics and weighted interaction graphs solely from multivariate data.
Revised: By comparing the inferred interaction strengths of simulated physical systems with groundtruth values that are not provided at the training stage, we verify that RAIN is capable of inferring both system dynamics and weighted interaction graphs solely from multivariate data.

Original: We furthershow that RAIN outperforms discrete baselines on real-world motion capture data, representing asystem in which we cannot be certain whether a continuous form of interaction strengths even exists.
Revised: We further show that RAIN outperforms discrete baselines on real-world motion capture data, representing a system in which we cannot be certain whether a continuous form of interaction strengths even exists.

Original: In this way, we demonstrate that the rich ﬂexibility and expressibility of the continuous modeling ofinteraction strengths are crucial for the accurate prediction of the future dynamics of an unknownempirical system.
Revised: In this way, we demonstrate that the rich ﬂexibility and expressibility of the continuous modeling of interaction strengths are crucial for the accurate prediction of the future dynamics of an unknown empirical system.

Original:  Model description
Revised:  Model description

Original: Our RAIN model as shown in Fig.
Revised: Our RAIN model as shown in Fig.

Original: 1 comprises three parts trained jointly: an encoder that compressestime series data, a graph extraction module that infers the interaction weight between every pair ofagents, and a decoder that predicts the future trajectories of each agent.
Revised: 1 comprises three parts trained jointly: an encoder that compresses time series data, a graph extraction module that infers the interaction weight between every pair of agents, and a decoder that predicts the future trajectories of each agent.

Original: Note that RAIN does notrequire a ground-truth interaction graph for training; instead, it produces an interaction graph as a
Revised: Note that RAIN does not

Original: [Figure]
Revised: [Figure]

Original: ×
Revised: ×

Original: [Figure]
Revised: [Figure]

Original: 〈 , 〉 ××
Revised: 〈 , 〉 ××

Original: [Figure]

Original: [Figure]
Revised: [Figure]

Original: × × × 〈 , 〉 〈 , 〉 〈 , 〉 〈 , 〉 〈 , 〉 t= t= t= t= t= t=
Revised: × × × 〈 , 〉 〈 , 〉 〈 , 〉 〈 , 〉 〈 , 〉 t= t= t= t= t= t=

Original: [Figure]
Revised: [Figure]

Original:  byproduct of future trajectory prediction.
Revised: require a ground-truth interaction graph for training; instead, it produces an interaction graph as a byproduct of future trajectory prediction.

Original: In the following, we formalize our model and describe eachcomponent in detail.
Revised: In the following, we formalize our model and describe each component in detail.

Original: 2.1 Encoder and pairwise attention
Revised: 2.1 Encoder and pairwise attention

Original: The long short-term memory (LSTM) encoder is composed of a single layer of gated recurrent unit(GRU) [5] with hidden state dimension d lstm = 128 .
Revised: The long short-term memory (LSTM) encoder is composed of a single layer of gated recurrent unit (GRU) [6] with hidden state dimension d lstm = 128 .

Original: The encoder receives T enc steps of trajectoriesx 1 , x 2 , . . .
Revised: The encoder receives T enc steps of trajectories x 1 , x 2 , . . .

Original: , x T enc , each consisting of R state variables of N agents, and produces corresponding T enchidden states, h 1 , h 2 , . .
Revised: , x T enc , each consisting of R state variables of N agents, and produces corresponding T enc hidden states, h 1 , h 2 , . .

Original: , h T enc .
Revised: , h T enc .

Original: The last hidden state h T enc could preserve the information from theentire trajectory in theory.
Revised: The last hidden state h T enc could preserve the information from the entire trajectory in theory.

Original: But we found that a naive ﬁnal hidden state is insufﬁcient to fully capturethe interaction strength in large-scale systems.
Revised: But we found that a naive ﬁnal hidden state is insufﬁcient to fully capture the interaction strength in large-scale systems.

Original: In this study, we propose a pairwise attention (PA)mechanism to effectively infer the interaction strength between two trajectories.
Revised: In this study, we propose a pairwise attention (PA) mechanism to effectively infer the interaction strength between two trajectories.

Original: The intuition behind
Revised: The intuition behind

Original: PA is straightforward: a single hidden state cannot be a suitable choice for extracting the interactionstrengths from every possible pair.
Revised: PA is straightforward: a single hidden state cannot be a suitable choice for extracting the interaction strengths from every possible pair.

Original: Thus, we calculate the attention between same-time hidden statesto assign weights to their contribution, as depicted in Fig.
Revised: Thus, we calculate the attention between same-time hidden states to assign weights to their contribution, as depicted in Fig.

Original: We use a slightly modiﬁed transformer[20] with m = 4 heads and a head dimension of d h = d lstm /m
Revised: We use a slightly modiﬁed transformer [23] with m = 4 heads and a head dimension of d h = d lstm /m

Original: =
Revised: =

Original: 32 to emphasize strong interaction.
Revised: 32 to emphasize strong interaction.

Original: See [20] for a detailed description of the transformer architecture.
Revised: See [23] for a detailed description of the transformer architecture.

Original: Formally, the LSTM hidden statesare processed into Key ( K ) , Query ( Q ) , and Value ( V ) matrices as follows,
Revised: Formally, the LSTM hidden states are processed into Key ( K ) , Query ( Q ) , and Value ( V ) matrices as follows,

Original: [Equation]
Revised: [Equation]

Original: where the symbol ⊕ indicates the concatenation of the matrices at the last dimension, f LSTM is the
Revised: where the symbol ⊕ indicates the concatenation of the matrices at the last dimension, f LSTM is the

Original: GRU layer, x ti are the state variables of the i th agent at time t , and f pair ,X is a stack of multilayerperceptron (MLP) layers for K pair , Q pair , and V pair .
Revised: GRU layer, x ti are the state variables of the i th agent at time t , and f pair ,X is a stack of multilayer perceptron (MLP) layers for K pair , Q pair , and V pair .

Original: The superscripts t and m on X indicate the timeand head number, respectively.
Revised: The superscripts t and m on X indicate the time and head number, respectively.

Original: The attention-weighted hidden state ˜h is expressed as follows,
Revised: The attention-weighted hidden state ˜h is expressed as follows,

Original: [Equation]
Revised: [Equation]

Original: 6) where α t,m pair ,ij is an attentive weight between agents i and j , and ˜h mi is a weighted hidden state for them th attention head.
Revised: where α t,m pair ,ij is an attentive weight between agents i and j , and ˜h mi is a weighted hidden state for the m th attention head.

Original: RAIN passes ˜h to the graph extraction module.
Revised: RAIN passes ˜h to the graph extraction module.

Original: By employing the PA mechanism, we can reﬁne the LSTM hidden states by focusing on the speciﬁctime of interaction, which is unique to each agent pair.
Revised: By employing the PA mechanism, we can reﬁne the LSTM hidden states by focusing on the speciﬁc time of interactions, which is unique to each agent pair.

Original: We highlight that comparing the same-timehidden states only, rather than considering the full attention as in conventional settings, signiﬁcantlyreduces the time complexity of the inference while achieving the goal of the extraction of temporalinformation.
Revised: We highlight that comparing the same-time hidden states only, rather than considering the full attention as in conventional settings, signiﬁcantly reduces the time complexity of the inference while achieving the goal of the extraction of temporal information.

Original: Also, since the transformer can handle asymmetric relationships by differentiating keyand , PA can capture directional connections with ease.
Revised: Also, since the transformer can handle asymmetric relationships by differentiating key and query, PA can capture directional connections with ease.

Original: 2.2 Graph extraction module
Revised: 2.2 Graph extraction module

Original: The graph extraction module of RAIN is similar to the GAT [21].
Revised: The graph extraction module of RAIN is similar to the GAT [24].

Original: The difference between ours andthe original GAT is that RAIN has no prior knowledge of the underlying graph and thus the α graphattention value should infer the presence of the edge itself as well as its strength, while GAT aims toﬁnd the relative importance between ﬁxed graph edges.
Revised: The difference between ours and the original GAT is that RAIN has no prior knowledge of the underlying graph and thus the α graph attention value should infer the presence of the edge itself as well as its strength, while GAT aims to ﬁnd the relative importance between ﬁxed graph edges.

Original: Also, the conventional inner-product attentionof GAT is replaced with a transformer architecture in RAIN to achieve a more ﬂexible representation.
Revised: Also, the conventional inner-product attention of GAT is replaced with a transformer architecture in RAIN to achieve a more ﬂexible representation.

Original: We use attention-weighted hidden states from the PA mechanism to apply the transformer as follows,
Revised: We use attention-weighted hidden states from the PA mechanism to apply the transformer as follows,

Original: [Equation]
Revised: [Equation]

Original: ∈

Original: [Equation]

Original: [Equation]
Revised: [Equation]

Original: (8) where f graph ,X is a stack of MLP layers for K graph , Q graph , and V graph .
Revised: (8) where f graph ,X is a stack of MLP layers for K graph , Q graph , and V graph .

Original: Note that instead of softmaxwhich normalizes the attention weight, sigmoid activation σ is used for graph attention to obtain theabsolute interaction strength.
Revised: Note that instead of softmax which normalizes the attention weight, sigmoid activation σ is used for graph attention to obtain the absolute interaction strength.

Original: This is because our main goal is to infer the ground-truth interactionstrength, not the relative strength for a single instance.
Revised: This is because our main goal is to infer the ground-truth interaction strength, not the relative strength for a single instance.

Original: Extracted graph attention α graph ,ij becomes aweight for the decoder module.
Revised: Extracted graph attention α graph ,ij becomes a weight for the decoder module.

Original: 2.3 Decoder
Revised: 2.3 Decoder

Original: The decoder shares the same GRU layer with the encoder module and the employ new value function,
Revised: The decoder shares the same GRU layer with the encoder module and the employ new value function,

Original: V dec ,i , for the message aggregation.
Revised: V dec ,i , for the message aggregation.

Original: For agent i , RAIN concatenates attention-weighted value vectorsfrom other agents along with its own value vector as follows,
Revised: For agent i , RAIN concatenates attention-weighted value vectors from other agents along with its own value vector as follows,

Original: [Equation]
Revised: [Equation]

Original: RAIN ﬁnally produces a prediction of the state variables of the next step using a stack of MLP layersf dec , f µ , and f σ ,
Revised: RAIN ﬁnally produces a prediction of the state variables of the next step using a stack of MLP layers f dec , f µ , and f σ ,

Original: [Equation]
Revised: [Equation]

Original: [Equation]
Revised: [Equation]

Original: The outputs of f µ and f σ are r -dimensional vectors, each representing the means and variances ofthe difference of state variables.
Revised: The outputs of f µ and f σ are r -dimensional vectors, each representing the means and variances of the difference of state variables.

Original: RAIN samples the next state from a Gaussian distribution with f µand f σ and adds the values to the previous state.
Revised: RAIN samples the next state from a Gaussian distribution with f µ and f σ and adds the values to the previous state.

Original: The decoder iterates this for T dec steps to predict thefuture states.
Revised: The decoder iterates this for T dec steps to predict the future states.

Original: For training, we employ negative log-likelihood (NLL) loss for a Gaussian distribution, 
Revised: For training, we employ negative log-likelihood (NLL) loss for a Gaussian distribution, L NLL =

Revised: T dec (cid:88)

Original: [Equation]
Revised: [Equation]

Original: where ∆ y t,qi , µ t,qi , and σ t,qi are the true future state difference, predicted mean, and predicted varianceof the state variable q of agent i at time t , respectively.
Revised: where ∆ y t,qi , µ t,qi , and σ t,qi are the true future state difference, predicted mean, and predicted variance of the state variable q of agent i at time t , respectively.

Original:  Experiments
Revised:  Experiments

Original: We demonstrate the capability of RAIN by performing inference tasks with various model systemsranging from simulated physical systems to real motion capture data from a walking human.
Revised: We demonstrate the capability of RAIN by performing inference tasks with various model systems ranging from simulated physical systems to real motion capture data from a walking human.

Original: All of
Revised: All of

Original: [Table]
Revised: [Table]

Original: the models and baselines are implemented with PyTorch and optimized with Adam [10].
Revised: the models and baselines are implemented with PyTorch and optimized with Adam [13].

Original: Data andmodels are available at Github (anonymized, will be de-anonymized in the camera-ready version).
Revised: Data and models are available at github.com/nokpil/RAIN.

Original: See the Supplementary Materials for details on the data generation, model architectures [Table] and trainingdetails.
Revised: See the Supplementary Materials for details on the data generation, model architectures, and training details.

Original: 3.1 Physical simulations
Revised: 3.1 Physical simulations

Original: We simulated the trajectories of two physical systems: a spring-ball system and phase-coupled
Revised: We simulated the trajectories of two physical systems: a spring-ball system and phase-coupled

Original: Kuramoto oscillators [13].
Revised: Kuramoto oscillators [16].

Original: Unlike previous studies [11, 22] in which every interaction strengthw in the system is discrete and constant (commonly w = 1 ), we consider a more general settingwhere interaction strengths are drawn from a continuum and are thus heterogeneous.
Revised: Unlike previous studies [14, 25] in which every interaction strength w in the system is discrete and constant (commonly w = 1 ), we consider a more general setting where interaction strengths are drawn from a continuum and are thus heterogeneous.

Original: Assumingthat two agents i and j are interacting, the interaction strength for each system would be a springconstant k ij for a spring-ball system and a coupling weight w ij for a Kuramoto model.
Revised: Assuming that two agents i and j are interacting, the interaction strength for each system would be a spring constant k ij for a spring-ball system and a coupling weight w ij for a Kuramoto model.

Original: Althoughour model can handle asymmetric interaction strength—thanks to the asymmetric nature of thetransformer—we take the symmetric form of connectivity matrix k ij = k ji for the simulated systems.
Revised: Although our model can handle asymmetric interaction strength—thanks to the asymmetric nature of the transformer—we take the symmetric form of connectivity matrix k ij = k ji for the simulated systems.

Original: For the spring-ball and Kuramoto systems, we ﬁrst select the edges between n nodes with probabilityp (excluding self-connections) to construct an interaction graph, and then assign a randomly sampledinteraction strength to each edge from a uniform distribution U [0 , 1] while expressing non-assignededges with zero interaction strength.
Revised: For the spring-ball and Kuramoto systems, we ﬁrst select the edges between n nodes with probability p (excluding self-connections) to construct an interaction graph, and then assign a randomly sampled interaction strength to each edge from a uniform distribution U [0 , 1] while expressing non-assigned edges with zero interaction strength.

Original: We generate 10k training samples and 2k validation samplesfor all simulated tasks.
Revised: We generate 10k training samples and 2k validation samples for all simulated tasks.

Original: The state variables consisting of trajectories are x, y, v x , v y (positions andvelocities) for the spring-ball system.
Revised: The state variables consisting of trajectories are x, y, v x , v y (positions and velocities) for the spring-ball system.

Original: For the Kuramoto oscillators, a concatenated vector of dφdt ,sin φ , and intrinsic frequency ω are used to construct the trajectories, where φ is the phase of anoscillator.
Revised: For the Kuramoto oscillators, a concatenated vector of dφdt , sin φ , and intrinsic frequency ω are used to construct the trajectories, where φ is the phase of an oscillator.

Original: For evaluation, we measure how accurately the model predicts future trajectories by mean squarederror (MSE) and how well the model retrieves the original connectivity matrix by two forms of
Revised: For evaluation, we measure how accurately the model predicts future trajectories by mean squared error (MSE) and how well the model retrieves the original connectivity matrix by two forms of

Original: Pearson correlation.
Revised: Pearson correlation.

Original: We ﬁrst gather every retrieved interaction strength a and corresponding trueinteraction strength k from all 2k validation samples and calculate the correlation in total ( ρ tot ).
Revised: We ﬁrst gather every retrieved interaction strength a and corresponding true interaction strength k from all 2k validation samples and calculate the correlation in total ( ρ tot ).

Original: Secondly, we independently calculate the correlation for each validation sample and take the averageof the 2k samples ( ρ sample ).
Revised: Secondly, we independently calculate the correlation for each validation sample and take the average of the 2k samples ( ρ sample ).

Original: One may interpret ρ tot as the overall performance of the model, whileρ sample indicates the expected correlation for a single instance at a test time.
Revised: One may interpret ρ tot as the overall performance of the model, while ρ sample indicates the expected correlation for a single instance at a test time.

Original: We excluded diagonaltrivial zeroes (due to no self-loop interaction) while calculating correlation, so the reported value isstrictly lower compared to the case where every value in the connectivity matrix is used.
Revised: We excluded diagonal trivial zeroes (due to no self-loop interaction) while calculating correlation, so the reported value is strictly lower compared to the case where every value in the connectivity matrix is used.

Original: Correlationsfrom the baseline models with discrete edge types are obtained by assigning continuous weights toeach edge type according to every possible permutation and choosing the best one.
Revised: Correlations from the baseline models with discrete edge types are obtained by assigning continuous weights to each edge type according to every possible permutation and choosing the best one.

Original: More precisely,[Figure] we assign n weights of 0 , 1 n − 1 , 2 n − 1 , . .
Revised: More precisely, we assign n weights of 0 , 1 n − 1 , 2 n − 1 , . .

Original: , 1 to n edge types with n !
Revised: , 1 to n edge types with n !

Original: different assignments and reportthe highest correlation.
Revised: different assignments and report the highest correlation.

Revised: [Figure]

Original: 3.1.1 Results
Revised: 3.1.1 Results

Original: Table 1 shows the correlations between the true interaction graph and the predicted interactionstrengths from various models.
Revised: Table 1 shows the correlations between the true interaction graph and the predicted interaction strengths from various models.

Original: Following [11], we measure the correlation between trajectory featurevectors as Corr.
Revised: Following [14], we measure the correlation between trajectory feature vectors as Corr.

Original: (Path) and the correlation between trained LSTM feature vectors as Corr.
Revised: (Path) and the correlation between trained LSTM feature vectors as Corr.

Original: (LSTM).
Revised: (LSTM).

Original: NRI(2) and NRI(4) indicate the NRI from [11] with 2 and 4 edges types, respectively.
Revised: NRI(2) and NRI(4) indicate the NRI from [14] with 2 and 4 edges types, respectively.

Original: We checkthe effect of PA by testing the RAIN model both with and without the PA mechanism.
Revised: We check the effect of PA by testing the RAIN model both with and without the PA mechanism.

Original: In Table1, we can clearly see that RAIN with PA signiﬁcantly outperforms every other model at inferringinteraction strengths.
Revised: In Table 1, we can clearly see that RAIN with PA signiﬁcantly outperforms every other model at inferring interaction strengths.

Original: Note that the high correlations from the NRI models for the spring-ball systemcan only be achieved if and only if we know the ground-truth interaction strength and choose thebest permutation.
Revised: Note that the high correlations from the NRI models for the spring-ball system can only be achieved if and only if we know the ground-truth interaction strength and choose the best permutation.

Original: Considering the huge performance difference between RAIN without and with PA,our model and PA mechanism are both crucial for accurate interaction strength retrieval.
Revised: Considering the huge performance difference between RAIN without and with PA, our model and PA mechanism are both crucial for accurate interaction strength retrieval.

Original: We show
Revised: We show

Original: MSE results for predicting 50 future states in Table 2, Here, again following [11], SingleLSTM runsa single LSTM for each object separately, while JointLSTM concatenates all state vectors (thus mayhandle a ﬁxed number of agents only) and trains a single LSTM to jointly predict all future states.
Revised: MSE results for predicting 50 future states in Table 2, Here, again following [14], SingleLSTM runs a single LSTM for each object separately, while JointLSTM concatenates all state vectors (thus may handle a ﬁxed number of agents only) and trains a single LSTM to jointly predict all future states.

Original: See the Supplementary Materials for further analysis, including full histograms of the correlationdistributions.
Revised: See the Supplementary Materials for further analysis, including full histograms of the correlation distributions.

Original: Figures 3 and 4 show the results of future prediction and interaction strength inference for 10interacting agents, where 5 trajectories are drawn for visualization.
Revised: Figures 3 and 4 show the results of future prediction and interaction strength inference forinteracting agents, where 5 trajectories are drawn for visualization.

Original: In Fig.
Revised: In Fig.

Original: 3, we can observe that allmodels, including NRI(2), succeed in capturing the existence of interaction between agents.
Revised: 3, we can observe that all models, including NRI(2), succeed in capturing the existence of interaction between agents.

Original: But itis apparent that the NRI(2) model fails to capture the interactions with small weights, while RAINwithout PA yields in numerous false positives with spurious weights.
Revised: But it is apparent that the NRI(2) model fails to capture the interactions with small weights, while RAIN without PA yields in numerous false positives with spurious weights.

Original: Such weakness of each model isreﬂected in relatively large prediction errors compared to RAIN with PA, especially for ball 4 (green)and ball 5 (purple).
Revised: Such weakness of each model is reﬂected in relatively large prediction errors compared to RAIN with PA, especially for ball 4 (green) and ball 5 (purple).

Original: The power of the PA mechanism becomes more evident with the Kuramotooscillators (Fig. 4), where only RAIN with PA succeeds in retrieving meaningful interaction weights.
Revised: The power of the PA mechanism becomes more evident with the Kuramoto oscillators (Fig. 4), where only RAIN with PA succeeds in retrieving meaningful interaction weights.

Original: To sum up, we can conclude that the PA mechanism clearly helps the reﬁnement of hidden states andthus yields better results with a greater correlation with the ground-truth interaction weights.
Revised: To sum up, we can conclude that the PA mechanism clearly helps the reﬁnement of hidden states and thus yields better results with a greater correlation with the ground-truth interaction weights.

Original: 3.1.2 Impact of weak interaction
Revised: 3.1.2 Impact of weak interaction

Original: By inferring interaction with a continuous strength as RAIN does, we can capture an entire spectrumof interactions with a single model.
Revised: By inferring interaction with a continuous strength as RAIN does, we can capture an entire spectrum of interactions with a single model.

Original: Particularly, we ﬁnd that our model is able to detect weakinteractions that are often ignored by the discrete NRI models due to their limited capacity.
Revised: Particularly, we ﬁnd that our model is able to detect weak interactions that are often ignored by the discrete NRI models due to their limited capacity.

Original: In Figure5, we emphasize the signiﬁcance of the inference of weak interaction by constructing the connectivitymatrix in a form of a multilayer network [12] with 2 layers.
Revised: In Figure 5, we emphasize the signiﬁcance of the inference of weak interaction by constructing the connectivity matrix in a form of a multilayer network [15] with 2 layers.

Original: Here, we prepare two densely connectedlayers of springs where their spring constants are sampled from [0 . 5 , 1] , uniformly.
Revised: Here, we prepare two densely connected layers of springs where their spring constants are sampled from [0 . 5 , 1] , uniformly.

Original: Between thetwo layers, we set a single inter-layer link (connecting ball 3 and ball 8 ) with a spring constant of0 . 3 , which is much smaller than the intra-layer interaction weights.
Revised: Between the two layers, we set a single inter-layer link (connecting ball 3 and ball 8 ) with a spring constant of 0 . 3 , which is much smaller than the intra-layer interaction weights.

Original: Since the synchronization ofa multilayer network largely depends on the strength and structure of inter-layer coupling [15, 6],capturing this weak but signiﬁcant connection between the two layers is critical for trajectory[Figure] prediction.
Revised: Since the synchronization of a multilayer network largely depends on the strength and structure of inter-layer coupling [18, 7], capturing this weak but signiﬁcant connection between the two layers is critical for trajectory prediction.

Original: As Fig.
Revised: As Fig.

Original: 5 shows, RAIN with PA accurately captures this weak interaction, while NRI(2)misses it and thus its predicted trajectory considerably deviates from the true one. 
Revised: 5 shows, RAIN with PA accurately captures this weak interaction, while NRI(2) misses it and thus its predicted trajectory considerably deviates from the true one. [Figure]

Original: 3.2 Motion capture data
Revised: 3.2 Motion capture data

Original: Next, we test our model in inferring interactions between the joints of a walking human data from the
Revised: Next, we test our model in inferring interactions between the joints of a walking human data from the

Original: CMU motion database [1].
Revised: CMU motion database [1].

Original: Different from the physical simulations, this real-world system does notpossess any well-known dynamics with a continuous interaction strength.
Revised: Different from the physical simulations, this real-world system does not possess any well-known dynamics with a continuous interaction strength.

Original: Following [11] and [8], weuse the data from subject # 35 with 31 joints.
Revised: Following [14] and [9], we use the data from subject # 35 with 31 joints.

Original: We split the training and validation data sets into a 4 : 1ratio.
Revised: We split the training and validation data sets into a 4 :ratio.

Original: We use the same protocol as with the physical systems: provide 50 time steps of trajectoriesand let the model predict 50 unseen time steps afterward.
Revised: We use the same protocol as with the physical systems: provide 50 time steps of trajectories and let the model predict 50 unseen time steps afterward.

Original: For the motion data, we train the model topredict the raw value of the future state instead of the difference from the current state.
Revised: For the motion data, we train the model to predict the raw value of the future state instead of the difference from the current state.

Original: Figure 6A shows the errors from each model’s prediction, where RAIN with PA achieved the lowest
Revised: Figure 6A shows the errors from each model’s prediction, where RAIN with PA achieved the lowest

Original: MSE.
Revised: MSE.

Original: An example visualization of the prediction is shown in Fig.
Revised: An example visualization of the prediction is shown in Fig.

Original: 6B. Without dynamically reevaluating the interaction graph at every time step as reported in [11] and [8], our model preciselypredicts the future states from static but continuous interaction weights.
Revised: 6B. Without dynamically reevaluating the interaction graph at every time step as reported in [14] and [9], our model precisely predicts the future states from static but continuous interaction weights.

Original: Also, as shown in Fig.
Revised: Also, as shown in Fig.

Original: 6C,our model produces a smooth and block-wise connectivity matrix which is much easier to interpretcompared to that from the discrete NRI(2).
Revised: 6C, our model produces a smooth and block-wise connectivity matrix which is much easier to interpret compared to that from the discrete NRI(2).

Original: This is because there is no restriction or natural meaningfor each edge type in the discrete model, and thus the manual sparsity prior is needed to handlethe ‘no interaction’ edges if an abundance is expected.
Revised: This is because there is no restriction or natural meaning for each edge type in the discrete model, and thus the manual sparsity prior is needed to handle the ‘no interaction’ edges if an abundance is expected.

Original: On the other hand, the attention value of
Revised: On the other hand, the attention value of

Original: RAIN is expected to convey the strength of interaction directly.
Revised: RAIN is expected to convey the strength of interaction directly.

Original: For instance, it is clear from RAIN’sconnectivity matrix that the dynamics of the feet are less correlated with the rest of the joints and alsothat the spine moves along with the right leg, arm, and hand, both of which agree with the qualitativemovements of a human while walking.
Revised: For instance, it is clear from RAIN’s connectivity matrix that the dynamics of the feet are less correlated with the rest of the joints and also that the spine moves along with the right leg, arm, and hand, both of which agree with the qualitative movements of a human while walking.

Original:  Conclusion
Revised:  Conclusion

Original: In this work, we introduced RAIN, a model for inferring continuous weighted interaction graphsfrom trajectory data in an unsupervised manner.
Revised: In this work, we introduced RAIN, a model for inferring continuous weighted interaction graphs from trajectory data in an unsupervised manner.

Original: With the PA mechanism that computes the attentionbetween same-time LSTM hidden states between agents, we can sharply reﬁne the representation forthe interaction weight extraction.
Revised: With the PA mechanism that computes the attention between same-time LSTM hidden states between agents, we can sharply reﬁne the representation for the interaction weight extraction.

Original: Our model successfully inferred the absolute interaction weightsfrom simulated physical systems and further showed great prediction performance with an empiricalsystem, demonstrating the advantage of continuous weight modeling in relational learning.
Revised: Our model successfully inferred the absolute interaction weights from simulated physical systems and further showed great prediction performance with an empirical system, demonstrating the advantage of continuous weight modeling in relational learning.

Original: Notably,
Revised: Notably,

Original: RAIN needs only 50 time steps of data to infer the interaction weights, and thus requires less databy several orders of magnitude than correlation-based theoretical methods [24, 14].
Revised: RAIN needs only 50 time steps of data to infer the interaction weights, and thus requires less data by several orders of magnitude than correlation-based theoretical methods [27, 17].

Original: Also, we foundthat the reﬁnement of the LSTM hidden state with PA is critical for meaningful performance.
Revised: Also, we found that the reﬁnement of the LSTM hidden state with PA is critical for meaningful performance.

Original: Sincethe PA mechanism is generally applicable to a neural model where its trajectory is represented by

Original: [Table] PA [Table] a recurrent neural network, one may expect an increase in performance by employing PA in otherrelational models without increasing the inference time signiﬁcantly.
Revised: Since the PA mechanism is generally applicable to a neural model where its trajectory is represented by a recurrent neural network, one may expect an increase in performance by employing PA in other relational models without increasing the inference time signiﬁcantly.

Original: In the real world, interactionsbetween agents in complex systems possess a broad range of characteristics.
Revised: In the real world, interactions between agents in complex systems possess a broad range of characteristics.

Original: For instance, they canbe either positive (excitatory or encouraging) or negative (inhibitory or suppressing), time-delayedwith heterogeneous time scales, and noisy both inherently and externally.
Revised: For instance, they can [Table] be either positive (excitatory or encouraging) or negative (inhibitory or suppressing), time-delayed with heterogeneous time scales, and noisy both inherently and externally.

Original: Complex systems in naturegenerally contain every aspect of these characteristics, such as neural signals in a human brain.
Revised: Complex systems in nature generally contain every aspect of these characteristics, such as neural signals in a human brain.

Original: Reinforcing the current RAIN architecture to handle data of such complex nature with a single modelwould be a promising future direction to explore.
Revised: Reinforcing the current RAIN architecture to handle data of such complex nature with a single model would be a promising future direction to explore.

Original:  Data availability
Revised:  Data availability

Original: Simulation code and data ﬁles are available at https://github.com/—- (anonymized for double-blinereview).
Revised: Simulation code and data ﬁles are available at https://github.com/nokpil/RAIN.  Acknowledgement

Revised: This research was supported by the Basic Science Research Program through the National Research

Revised: Foundation of Korea NRF-2022R1A2B5B02001752 (HJ) and National Research Foundation of

Revised: Korea Grant funded by the Korean Government NRF-2018S1A3A2075175 (SH).

Original: Checklist
Revised: Checklist

Original: The checklist follows the references.
Revised: The checklist follows the references.

Original: Please read the checklist guidelines carefully for information onhow to answer these questions.
Revised: Please read the checklist guidelines carefully for information on how to answer these questions.

Original: For each question, change the default [TODO] to [Yes] , [No] , or[N/A] .
Revised: For each question, change the default [TODO] to [Yes] , [No] or [N/A] .

Original: You are strongly encouraged to include a justiﬁcation to your answer , either by referencingthe appropriate section of your paper or providing a brief inline description.
Revised: You are strongly encouraged to include a justiﬁcation to your answer , either by referencing the appropriate section of your paper or providing a brief inline description.

Original: For example:
Revised: For example:

Original: • Did you include the license to the code and datasets?
Revised: • Did you include the license to the code and datasets?

Original: [Yes] See Section ?? .
Revised: [Yes] See Section ?? .

Original: • Did you include the license to the code and datasets?
Revised: • Did you include the license to the code and datasets?

Original: [No] The code and the data areproprietary.
Revised: [No] The code and the data are proprietary.

Original: • Did you include the license to the code and datasets?
Revised: • Did you include the license to the code and datasets?

Original: [N/A]
Revised: [N/A]

Original: Please do not modify the questions and only use the provided macros for your answers.
Revised: Please do not modify the questions and only use the provided macros for your answers.

Original: Note that the
Revised: Note that the

Original: Checklist section does not count towards the page limit.
Revised: Checklist section does not count towards the page limit.

Original: In your paper, please delete this instructionsblock and only keep the Checklist section heading above along with the questions/answers below.
Revised: In your paper, please delete this instructions block and only keep the Checklist section heading above along with the questions/answers below.

Original: For all authors... (a) Do the main claims made in the abstract and introduction accurately reﬂect the paper’scontributions and scope?
Revised: For all authors... (a) Do the main claims made in the abstract and introduction accurately reﬂect the paper’s contributions and scope?

Original: [Yes] See Abstract and Introduction.
Revised: [Yes] See Abstract and Introduction.

Original: (b) Did you describe the limitations of your work?
Revised: (b) Did you describe the limitations of your work?

Original: [Yes] See Conclusion.
Revised: [Yes] See Conclusion.

Original: (c) Did you discuss any potential negative societal impacts of your work?
Revised: (c) Did you discuss any potential negative societal impacts of your work?

Original: [N/A] (d) Have you read the ethics review guidelines and ensured that your paper conforms to them?
Revised: [N/A] (d) Have you read the ethics review guidelines and ensured that your paper conforms to them?

Original: [Yes] 
Revised: [Yes] 2.

Original: If you are including theoretical results... (a) Did you state the full set of assumptions of all theoretical results?
Revised: If you are including theoretical results... (a) Did you state the full set of assumptions of all theoretical results?

Original: [N/A] (b) Did you include complete proofs of all theoretical results?
Revised: [N/A] (b) Did you include complete proofs of all theoretical results?

Original: [N/A] 
Revised: [N/A] 3.

Original: If you ran experiments... (a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?
Revised: If you ran experiments... (a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?

Original: [Yes] See Dataavailability.(b)
Revised: [Yes] See Data availability.

Original:  Did you specify all the training details (e.g., data splits, hyperparameters, how theywere chosen)?
Revised: (b) Did you specify all the training details (e.g., data splits, hyperparameters, how they were chosen)?

Original: [Yes] See Supplemental material.(c)
Revised: [Yes] See Supplemental material.

Original:  Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?
Revised: (c) Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?

Original: [N/A] (d) Did you include the total amount of compute and the type of resources used (e.g., typeof GPUs, internal cluster, or cloud provider)?
Revised: [N/A] (d) Did you include the total amount of compute and the type of resources used (e.g., type of GPUs, internal cluster, or cloud provider)?

Original: [Yes] See Supplemental material.
Revised: [Yes] See Supplemental material.

Original: If you are using existing assets (e g., code, data, models) or curating/releasing new assets... (a) If your work uses existing assets, did you cite the creators?
Revised: If you are using existing assets (e.g., code, data, models) or curating/releasing new assets... (a) If your work uses existing assets, did you cite the creators?

Original: [Yes] See the manuscript where we cite [1] for its dataset.
Revised: [Yes] See the manuscript where we cite [1] for its dataset.

Original: (b) Did you mention the license of the assets?
Revised: (b) Did you mention the license of the assets?

Original: [N/A] (c) Did you include any new assets either in the supplemental material or as a URL?
Revised: [N/A] (c) Did you include any new assets either in the supplemental material or as a URL?

Original: [Yes] See Data availability.
Revised: [Yes] See Data availability.

Original: (d) Did you discuss whether and how consent was obtained from people whose data you’re using/curating?
Revised: (d) Did you discuss whether and how consent was obtained from people whose data you’re using/curating?

Original: [N/A] (e) Did you discuss whether the data you are using/curating contains personally identiﬁable information or offensive content?
Revised: [N/A] (e) Did you discuss whether the data you are using/curating contains personally identiﬁable information or offensive content?

Original: [N/A] 
Revised: [N/A] 5.

Original: If you used crowdsourcing or conducted research with human subjects... (a) Did you include the full text of instructions given to participants and screenshots, ifapplicable?
Revised: If you used crowdsourcing or conducted research with human subjects... (a) Did you include the full text of instructions given to participants and screenshots, if applicable?

Original: [N/A] (b) Did you describe any potential participant risks, with links to Institutional Review Board (IRB) approvals, if applicable?
Revised: [N/A] (b) Did you describe any potential participant risks, with links to Institutional Review Board (IRB) approvals, if applicable?

Original: [N/A] (c) Did you include the estimated hourly wage paid to participants and the total amount spent on participant compensation?
Revised: [N/A] (c) Did you include the estimated hourly wage paid to participants and the total amount spent on participant compensation?

Original: [N/A]
Revised: [N/A]

Original: A AppendixA.1 RAIN implementation
Revised: A Appendix A.1 RAIN implementation

Original: For RAIN, we globally adopt Mish [17] as a non-linear activation function which has a functionalform as follows.
Revised: For RAIN, we globally adopt Mish [20] as a non-linear activation function which has a functional form as follows.

Original: [Equation]
Revised: [Equation]

Original: Hereafter, we denote the batch dimension as B , the number of input time step as T , the number ofagent as N , the number of state variables as S , the agent number as N .
Revised: Hereafter, we denote the batch dimension as B , the number of input time step as T , the number of agent as N , the number of state variables as S , the agent number as N .

Original: Typically, B = 128 , T = 50 ,
Revised: Typically, B = 128 , T = 50 ,

Original: S = 

Revised: S =

Original: (Kuramoto), 4 (Spring), 6 (motion), and N = 5 , 10 , 31 (motion).
Revised: (Kuramoto), 4 (Spring), 6 (motion), and N = 5 , 10 , 31 (motion).

Original: A.1.1 Encoder
Revised: A.1.1 Encoder

Original: Intially, the model recieves the input data with the size of B × T × N × S at every batch.
Revised: Intially, the model recieves the input data with the size of B × T × N × S at every batch.

Original: We ﬁrstencoding each state with MLP with a 2-layer MLP with hidden dimension of 64 and output dimensionof 128 .
Revised: We ﬁrst encoding each state with MLP with a 2-layer MLP with hidden dimension of 64 and output dimension of 128 .

Original: The encoded state is then feeded to a sigle GRU layer with hidden dimension of 256 , whichproduces the LSTM hidden states with the size of B × N × 256 for both future predictions and thegrpah extraction.
Revised: The encoded state is then feeded to a sigle GRU layer with hidden dimension of 256 , which produces the LSTM hidden states with the size of B × N × 256 for both future predictions and the grpah extraction.

Original: For the initial hidden state, we also train a single-layer MLP with output dimensionof 256 , which recieves the raw state variables (at time 0 ) and produces the initial hidden states for our
Revised: For the initial hidden state, we also train a single-layer MLP with output dimension of 256 , which recieves the raw state variables (at time 0 ) and produces the initial hidden states for our

Original: GRU layer.
Revised: GRU layer.

Original: A.1.2 Pairwise attention 
Revised: A.1.2 Pairwise attention For

Original: For pairwise attention (PA), we use transformer [20] with 4 heads with 32 dimensions each, total of128 dimension.
Revised: pairwise attention (PA), we use transformer [23] with 4 heads with 32 dimensions each, total of 128 dimension.

Original: Hence, the key (L), query (Q), and value (V) is calculated via a linear layer withinput dimension of 256 and output dimension of 128 (to match with the transformer dimension,32 × 4 = 128 ).
Revised: Hence, the key (L), query (Q), and value (V) is calculated via a linear layer with input dimension of 256 and output dimension of 128 (to match with the transformer dimension, 32 × 4 = 128 ).

Original: After we perform PA by calculating the same-time attention and weighted average,the reﬁned hidden states goes to the graph extraction module.
Revised: After we perform PA by calculating the same-time attention and weighted average, the reﬁned hidden states goes to the graph extraction module.

Original: Since PA produces a single hiddenstates for every pair of agents, we now have the output with the size of B × N × N × 128 , at thisstage.
Revised: Since PA produces a single hidden states for every pair of agents, we now have the output with the size of B × N × N × 128 , at this stage.

Original: A.1.3 Graph extraction module
Revised: A.1.3 Graph extraction module

Original: For graph extraction, we employ a 3-layer MLP with hidden dimension of 32 , 16 and output dimensionof 1 .
Revised: For graph extraction, we employ a 3-layer MLP with hidden dimension of 32 , 16 and output dimension of 1 .

Original: This module makes the reﬁned hidden states into the size of B × N × N × 1 , which indicates the
Revised: This module makes the reﬁned hidden states into the size of B × N × N × 1 , which indicates the

Original: N × N weighted interaction graphs that our module has inferred.
Revised: N × N weighted interaction graphs that our module has inferred.

Original: Note that the RAIN model without
Revised: Note that the RAIN model without

Original: PA uses two concatenated individual LSTM hidden states (from agent i and j ) for the graph extraction,and thus the input dimension of the graph extraction module becomes 2 × ( LSTM dimension ) = 256(and the same as RAIN with PA afterwards).
Revised: PA uses two concatenated individual LSTM hidden states (from agent i and j ) for the graph extraction, and thus the input dimension of the graph extraction module becomes 2 × ( LSTM dimension ) =(and the same as RAIN with PA afterwards).

Original: Finally, we add diagonal mask ﬁlled with − 10000to the result and apply a sigmoid function.
Revised: Finally, we add diagonal mask ﬁlled with −to the result and apply a sigmoid function.

Original: This effectively reduces every diagonal entries into 0( σ ( − 10000) ≈ 0 ) and normalize the scale of the interaction strength into [0 , 1] .
Revised: This effectively reduces every diagonal entries into( σ ( − 10000) ≈ 0 ) and normalize the scale of the interaction strength into [0 , 1] .

Original: A.1.4 Decoder
Revised: A.1.4 Decoder

Original: In decoding stage, we ﬁrst feed the current trajectory data to the LSTM encoder and gets the hiddenstates for current time step.
Revised: In decoding stage, we ﬁrst feed the current trajectory data to the LSTM encoder and gets the hidden states for current time step.

Original: We then calcualte the another value function with a linear layer, V dec ,with output dimension of 128 .
Revised: We then calcualte the another value function with a linear layer, V dec , with output dimension of 128 .

Original: For a prediction of single agent, we concatenate two vectors; its ownvalue and weighted average of all other value, according to the weights from the graph extractionmodule.
Revised: For a prediction of single agent, we concatenate two vectors; its own value and weighted average of all other value, according to the weights from the graph extraction module.

Original: Hence, the input dimension of the decoder module should be 2 × 128 = 

Revised: Hence, the input dimension of the decoder module should be 2 × 128 =

Original: (since twovalue functions are concatenated).
Revised: (since two value functions are concatenated).

Original: The decoder of RAIN is consists of three MLPs: one primary 2-layer MLP with hidden and outputdimension of 256 for hidden states encoding, and two secondary 2-layer MLPs with hidden dimensionof 256 and output dimension of S .
Revised: The decoder of RAIN is consists of three MLPs: one primary 2-layer MLP with hidden and output dimension of 256 for hidden states encoding, and two secondary 2-layer MLPs with hidden dimension of 256 and output dimension of S .

Original: After we passes the concatenated values to the primary MLP,we further feeds the results to two secondary MLPs for yielding means and variances of the desiredoutput.
Revised: After we passes the concatenated values to the primary MLP, we further feeds the results to two secondary MLPs for yielding means and variances of the desired output.

Original: A.1.5 Training details
Revised: A.1.5 Training details

Original: For training, we iterate the decoder 50 times while sampling the trajectory data from generated meansand variances, and compared it with state difference to calculate NLL loss.
Revised: For training, we iterate the decoder 50 times while sampling the trajectory data from generated means and variances, and compared it with state difference to calculate NLL loss.

Original: We perform gradientdescent at each iteration step, let gradient ﬂows through backward time and yield 50 losses in total.
Revised: We perform gradient descent at each iteration step, let gradient ﬂows through backward time and yield 50 losses in total.

Original: We average all the NLL losses and perform backward propagation.
Revised: We average all the NLL losses and perform backward propagation.

Original: A.2 Baseline implementation
Revised: A.2 Baseline implementation

Original: In the current work, we trained various baselines to compare the performance with our model.
Revised: In the current work, we trained various baselines to compare the performance with our model.

Original: Moreprecisely, we trained SingleLSTM, JointLSTM, NRI(2), NRI(4), and both RAIN with and without
Revised: More precisely, we trained SingleLSTM, JointLSTM, NRI(2), NRI(4), and both RAIN with and without

Original: PA.
Revised: PA.

Original: The SingleLSTM model consists of a single 2-lyaer LSTM with hidden dimension of 256 .
Revised: The SingleLSTM model consists of a single 2-lyaer LSTM with hidden dimension of 256 .

Original: Similarto RAIN, we train the model by feeding 50 previous states and aim to predict 50 future states, butindividually.
Revised: Similar to RAIN, we train the model by feeding 50 previous states and aim to predict 50 future states, but individually.

Original: Hence, there are no information communicated between agetns.
Revised: Hence, there are no information communicated between agetns.

Original: Furthermore, weused the hidden states of the second layer of LSTM in SingleLSTM for calcualting Corr (LSTM),by measuring the Pearson correlation between two agent’s hidden states and again maesure thosecorrelations to the ground-truth interaction strengths.
Revised: Furthermore, we used the hidden states of the second layer of LSTM in SingleLSTM for calcualting Corr (LSTM), by measuring the Pearson correlation between two agent’s hidden states and again maesure those correlations to the ground-truth interaction strengths.

Original: For the JointLSTM model, we ﬁrst concatenate all states from the agents, which yields the vectorwith dimension of N × S .
Revised: For the JointLSTM model, we ﬁrst concatenate all states from the agents, which yields the vector with dimension of N × S .

Original: A single LSTM is trained to recieve this concatenated vector, and producea single (again, concatenated) vector to predict the future states of all agents at once.
Revised: A single LSTM is trained to recieve this concatenated vector, and produce a single (again, concatenated) vector to predict the future states of all agents at once.

Original: This is the mostnaive form of neural network that (in theory) enables the information communication between agents.
Revised: This is the most naive form of neural network that (in theory) enables the information communication between agents.

Original: Other trainig protocols are same as RAIN.
Revised: Other trainig protocols are same as RAIN.

Original: For NRI(2) and NRI(4), we faithfully followed the original training protocol of [11], including 10steps of burning-in process.
Revised: For NRI(2) and NRI(4), we faithfully followed the original training protocol of [14], includingsteps of burning-in process.

Original: We set the hidden state dimension as 256 and also used learning ratescheduling as mentioned in the original paper.
Revised: We set the hidden state dimension as 256 and also used learning rate scheduling as mentioned in the original paper.

Original: We did not employ dynamical graph re-evaluation,since we wanted to compare the performance between static graphs.
Revised: We did not employ dynamical graph re-evaluation, since we wanted to compare the performance between static graphs.

Original: A.3 Dataset detailsA.3.1 Spring-ball systemSpring
Revised: A.3 Dataset details A.3.1 Spring-ball system

Original: -ball systems are consist of N balls and connecting springs between them.
Revised: Spring-ball systems are consist of N balls and connecting springs between them.

Original: The interactionbetween balls are Hookean force, F ij = − k ij x ij where k ij is a spring constant and x ij is a relativeposition vector between two balls.
Revised: The interaction between balls are Hookean force, F ij = − k ij x ij where k ij is a spring constant and x ij is a relative position vector between two balls.

Original: In this study, we aim to infer k ij without knowing any priorinformation about the dynamics.
Revised: In this study, we aim to infer k ij without knowing any prior information about the dynamics.

Original: All of the N balls are initially start with random 2D positions and velocities that is drawn fromthe normal distribution N (0 , 1) .
Revised: All of the N balls are initially start with random 2D positions and velocities that is drawn from the normal distribution N (0 , 1) .

Original: Here, velocities are further normalized to have a vector norm of1 .
Revised: Here, velocities are further normalized to have a vector norm of 1 .

Original: The balls are kinetically moving in a square box with sides of length 5 , centered at the origin.
Revised: The balls are kinetically moving in a square box with sides of length 5 , centered at the origin.

Original: The collision between every object is perfectly elastic (In practice, the size of the ball is ignoredand the collision between balls never happens).
Revised: The collision between every object is perfectly elastic (In practice, the size of the ball is ignored and the collision between balls never happens).

Original: We simulate each trajectory 1000 times steps withtime interval dt = 0 .
Revised: We simulate each trajectory 1000 times steps with time interval dt = 0 .

Original: 005 , and it is further subsampled every 10 steps to construct total 100 steps oftraining data; 50 steps for input and 50 steps for validation.
Revised: 005 , and it is further subsampled every 10 steps to construct total 100 steps of [Figure] training data; 50 steps for input and 50 steps for validation.

Original: In the simulation, the spring constant isdrawn uniformly from [0 , 1] multiplied by a constant factor 0 .
Revised: In the simulation, the spring constant is drawn uniformly from [0 , 1] multiplied by a constant factor 0 .

Original: 05 for stability.
Revised: 05 for stability.

Original: A.3.2 Phase-coupled oscillators
Revised: A.3.2 Phase-coupled oscillators

Original: For Kuramoto oscillators, each ball its intrinsic frequency w i and interacting with each other byfollowing differential equation:
Revised: For Kuramoto oscillators, each ball its intrinsic frequency w i and interacting with each other by following differential equation:

Original: [Equation]
Revised: [Equation]

Original: (17) with coupling constants k ij , drawn uniformly from [0 , 2] .
Revised: with coupling constants k ij , drawn uniformly from [0 , 2] .

Original: We simulate the system by solving (17)with fourth-order Runge-Kutta integrator with a step size dt = 0 .
Revised: We simulate the system by solving (17) with fourth-order Runge-Kutta integrator with a step size dt = 0 .

Original: Intrinsic frequency w i ∈ N andinitial phase φ t =

Revised: Intrinsic frequency w i ∈ N and initial phase φ t =

Original: i is drawn uniformly from [1 , 10] and [0 , 2 π ) , respectively.[Figure]
Revised: i is drawn uniformly from [1 , 10] and [0 , 2 π ) , respectively.

Original: A.3.3 Motion capture data
Revised: A.3.3 Motion capture data

Original: As mentioned in the main manuscript, we used the data of subject # 35 from CMU motion databse[1].
Revised: As mentioned in the main manuscript, we used the data of subject # 35 from CMU motion databse [1].

Original: The trial number spans from 1 to 16 , and 28 to 34 , following [8].
Revised: The trial number spans from 1 to 16 , and 28 to 34 , following [9].

Original: We used data processing codesfrom [8] to preprocess the amc ﬁles into the trainig and validation dataset.
Revised: We used data processing codes from [9] to preprocess the amc ﬁles into the trainig and validation dataset.

Original: By split the data by alength of 100 ( 50 input steps and 50 future steps), we got 63 sequences of train data and 23 sequencesof validation data.
Revised: By split the data by a length of 100 ( 50 input steps and 50 future steps), we got 63 sequences of train data and 23 sequences of validation data.

Original: A.4 Further analysis
Revised: A.4 Further analysis

Original: The effect of PA mechanism is further illustrated by plotting distributions of correlations in Figure 7.
Revised: The effect of PA mechanism is further illustrated by plotting distributions of correlations in Figure 7.

Original: Here,left 2D histograms on each panel shows the scatter plot of true weight k and inferred weighta among entire validation dataset and the right histogram shows the distribution of each validationsample’s correlation. Thus, calculating correlation on left 2D histogram would yield ρ tot , whileaveraging the right histogram would yield ρ sample .
Revised: Here,