Title: DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Model
Venue: NeurIPS 2023
Accepted: yes
Keywords: Trajectory Generation

Diffusion Model

Urban Computing

Spatial-temporal Data Mining
Abstract: Pervasive integration of GPS-enabled devices and data acquisition technologies has led to an exponential increase in GPS trajectory data, fostering advancements in spatial-temporal data mining research. Nonetheless, GPS trajectories contain personal geolocation information, rendering serious privacy concerns when working with raw data. A promising approach to address this issue is trajectory generation, which involves replacing original data with generated, privacy-free alternatives. Despite the potential of trajectory generation, the complex nature of human behavior and its inherent stochastic characteristics pose challenges in generating high-quality trajectories. 
In this work, we propose a spatial-temporal diffusion probabilistic model for trajectory generation (DiffTraj). This model effectively combines the generative abilities of diffusion models with the spatial-temporal features derived from real trajectories. The core idea is to reconstruct and synthesize geographic trajectories from white noise through a reverse trajectory denoising process. Furthermore, we propose a Trajectory UNet (Traj-UNet) deep neural network to embed conditional information and accurately estimate noise levels during the reverse process. Experiments on two real-world datasets show that DiffTraj can be intuitively applied to generate high-fidelity trajectories while retaining the original distributions. Moreover, the generated results can support downstream trajectory analysis tasks and significantly outperform other methods in terms of geo-distribution evaluations.

DiffTraj: Generating GPS Trajectory with Diffusion Probabilistic Model

Abstract

Pervasive integration of GPS-enabled devices and data acquisition technologies has led to an exponential increase in GPS trajectory data, fostering advancements in spatial-temporal data mining research. Nonetheless, GPS trajectories contain personal geolocation information, rendering serious privacy concerns when working with raw data. A promising approach to address this issue is trajectory generation, which involves replacing original data with generated, privacy-free alternatives. Despite the potential of trajectory generation, the complex nature of human behavior and its inherent stochastic characteristics pose challenges in generating high-quality trajectories. In this work, we propose a spatial-temporal diffusion probabilistic model for trajectory generation (DiffTraj). This model effectively combines the generative abilities of diffusion models with the spatial-temporal features derived from real trajectories. The core idea is to reconstruct and synthesize geographic trajectories from white noise through a reverse trajectory denoising process. Furthermore, we propose a Trajectory UNet (Traj-UNet) deep neural network to embed conditional information and accurately estimate noise levels during the reverse process. Experiments on two real-world datasets show that DiffTraj can be intuitively applied to generate high-fidelity trajectories while retaining the original distributions. Moreover, the generated results can support downstream trajectory analysis tasks and significantly outperform other methods in terms of geo-distribution evaluations.

1 Introduction

GPS trajectory data play a crucial role in numerous spatial-temporal data mining applications, including urban traffic planning, business location selection, and travel time estimation [43, 42]. Despite the substantial progress in urban applications through GPS trajectory analysis, few attention was paid to data accessibility and privacy concerns [41]. For example, real-world trajectory data, which contain sensitive personal geolocation information, raise significant privacy issues when using directly [38, 44]. Additionally, the time-consuming and labor-intensive nature of trajectory data collection leads to challenges in obtaining accessible, publicly available datasets that preserve privacy. Therefore, it is essential to develop methods that facilitate the efficient use of trajectory data in urban applications while safeguarding personal privacy. One promising approach involves generating synthetic trajectories by learning from real trajectory distributions and replacing privacy-sensitive

real trajectories with these synthetic counterparts. The generated trajectories allow for equivalent data analysis outcomes and support high-level decision-making without compromising privacy.

However, generating GPS trajectory that accurately reflect real-world distributions will encounter the following challenges in practice. First, most cities contain various regions with diverse functions and population densities, resulting in non-independent and identically distributed trajectories among these regions [44, 40]. This complex distribution makes it difficult to learn a global trajectory model that captures regional nuances. Second, the inherent stochastic nature of human activities makes each trajectory unique, posing challenges in modeling and predicting individual movement patterns [41, 16]. Third, external factors, such as traffic conditions, departure time, and local events, significantly influence personal travel schedules [36]. Accounting for these factors and understanding their impact on the correlations between individual GPS locations within a trajectory adds to the complexity of modeling trajectory generation accurately.

To address the above challenges, we propose a trajectory generation method based on the spatial-temporal diffusion probabilistic model, which can effectively capture the complex behaviors of real-world activities and generates high-quality trajectories. The core idea behind this method is to perturb the trajectory distribution with noise through a forward trajectory diffusion process and then recover the original distribution by learning the backward diffusion process (denoising), resulting in a highly flexible trajectory generation model [11, 28]. We propose this framework based on three primary motivations: (i) The diffusion model is a more reliable and robust method of generation than canonical methods [35]. (ii) Human activities in the real world exhibit stochastic and uncertain characteristics [18, 10], and the diffusion model reconstructs data step-by-step from random noise, making it suitable for generating more realistic GPS trajectory. (iii) Since the diffusion model generates trajectories from random noise, it eliminates the risk of privacy leakage.

While the diffusion model shows promise for generating high-quality trajectories, it is a non-trivial task when applied to GPS trajectory generation. Firstly, the spatial-temporal nature of trajectory data presents complexity to the diffusion process, requiring the model to consider the spatial distribution of GPS points and the temporal dependencies among them. Secondly, external factors such as traffic conditions, departure time, and regions can significantly impact human mobility patterns [44], posing challenges for modeling these factors within the diffusion framework. Finally, the inherently stochastic nature of human activities demands that the diffusion model be capable of capturing a wide range of plausible trajectory patterns, which can be difficult due to the need to balance diversity and realism in the generated trajectories. Addressing these challenges is crucial for successfully applying the diffusion model to GPS trajectory generation and ensuring privacy-preserving, accurate, and computationally efficient outcomes.

Building on the identified motivations and addressing the limitations of applying the diffusion model to trajectory generation, we propose a Diff usion probabilistic model Traj ectory generation (DiffTraj) framework. This framework can generate infinite trajectories while preserving the real-world trajectory distribution. DiffTraj incorporates spatial-temporal modeling of raw trajectories without the need for additional operations, allowing for direct application to trajectory generation tasks. Crucially, the synthetic trajectories generated by DiffTraj ensure high generation accuracy while maintaining their utility, offering a promising solution to privacy-preserving GPS trajectory generation. To summarize, the contributions of this work are concluded as follows:

We propose a DiffTraj framework for trajectory generation, leveraging the diffusion model to simulate real-world trajectories while preserving privacy. In addition, this framework can be applied to generate high-fidelity trajectory data with high efficiency and transferability. To the best of our knowledge, our work is the first exploration of trajectory generation by the diffusion model.

We design a novel denoising network structure called Traj-UNet, which integrates residual blocks for spatial-temporal modeling and multi-scale feature fusion to accurately predict the noise level during denoising. Meanwhile, Traj-UNet integrates Wide and Deep networks [6] to construct conditional information, enabling controlled trajectory generation.

We validate the effectiveness of DiffTraj on two real-world trajectory datasets, showing that the proposed methods can generate high-fidelity trajectories and preserve statistical properties. At the same time, the generated trajectories can support downstream trajectory analysis tasks with replaceable utility and privacy-preserving.

2 Related Work

Trajectory Data Synthesizing . Existing methods for trajectory data can be generally divided into two main categories: non-generative and generative [4]. Non-generative methods include perturbing real trajectories [1, 37] or combining different real trajectories [21]. Adding random or Gaussian perturbations protects privacy but compromises data utility by altering the spatial-temporal characteristics and data distribution. Striking a balance between trajectory utility and privacy protection is challenging [4]. Although Mehmet et al. generated forged trajectories by mixing different trajectories, this method relies on massive data and sophisticated mixing processes [21].

Besides, the principle of the generative method is to leverage deep neural networks that learn the spatial-temporal distribution underlying the real data. New trajectory data are therefore generated by sampling from the learned distribution. Liu et al. proposed a preliminary solution that employs generative adversarial networks (GAN) for trajectory generation, yet it failed to go further towards a detailed design[33]. Subsequently, some works divided the city map into grids and performed trajectory generation by learning the distribution of trajectories among the grids [38, 24]. However, there is a trade-off between generation accuracy and grid size. Meanwhile, researchers used the image generation capability of GAN to convert the trajectory data into images for time-series generation [4, 31], while the transformation between images and trajectories imposed an additional computational burden. Compared with previous methods, DiffTraj uses the diffusion model for trajectory generation, which can better explore the spatial and temporal distributions without additional data manipulation.

Diffusion Probabilistic Model . The diffusion model is a probabilistic generative model, which was first proposed by Sohl-Dickstein et al. [27] and then further improved by Ho et al. [11] and Song et al. [29]. A typical diffusion model generates synthetic data via two sequential processes, i.e., a forward process that gradually perturbs the data distribution by adding noise on multiple scales and a reverse process that learns how to recover the data distribution[35]. In addition, researchers have made extensive attempts to improve generative sample quality and sampling speed. For example, Song et al. proposed a non-Markovian diffusion process to reduce the sampling steps [28], Nichol et al. proposed to learn the variance of reverse processes allowing fewer sampling steps [22], and Dhariwal et al. searched for the optimal structure of the reverse denoising neural network to obtain better sampling quality. As a new type of advanced generative model, diffusion models have achieved superior performance over alternative generative models in various generative tasks, such as computer vision [25], natural language processing [15], multi-modal learning [2, 19], and traffic forecasting [32]. Nevertheless, the diffusion probabilistic model calls for efforts in spatial-temporal trajectory data generation. To the best of our knowledge, this work is a pioneering attempt that uses diffusion probabilistic model to generate GPS trajectory.

3 Preliminary

In this section, we first introduce the definitions and notations we use in this paper and then briefly present the fundamentals of the diffusion probabilistic model.

3.1 Problem Definition

Definition 1: ( GPS Trajectory ). A GPS trajectory is defined as a sequence of continuously sampled private GPS location points, denoted by x = { p 1 , p 2 , . . . , p n } . The i -th GPS point is represented as a tuple p i = [ lat i , lng i ] , where lng i and lat i denote longitude and latitude, respectively.

Problem Statement: ( Trajectory Generation ). Given a set of real-world GPS trajectories, X = { x 1 , x 2 , . . . , x m } , where each x i = { p i 1 , p i 2 , . . . , p i n } is a sequence of private GPS location points. The objective of the trajectory generation task is to learn a generative model, G , that can generate synthetic GPS trajectories, Y = { y 1 , y 2 , . . . , y k } , where each y i = { q i 1 , q i 2 , . . . , q i n } . such that:

Similarity : The generated trajectories y i preserve the spatial-temporal characteristics and distribution of the real trajectories x i . In practice, there are various physical meanings, such as the regional distribution of trajectory points, the distance between successive points, etc.

Utility : The generated trajectories y i maintain utility for downstream applications and analyses.

Privacy : Privacy is preserved, meaning that the generated trajectories y i do not reveal sensitive information about the individuals associated with the real trajectories x i .

3.2 Diffusion Probabilistic Model

The diffusion probabilistic model is a powerful and flexible generative model, which has gained increasing attention in recent years for its success in various data generation tasks [11, 28, 29]. In general, the diffusion probabilistic model consists of two main processes: a forward process that gradually perturbs the data distribution with noise, and a reverse (denoising) process that learns to recover the original data distribution.

Forward process . Given a set of real data samples x 0 ∼ q ( x 0 ) , the forward process adds T time-steps of Gaussian noise N ( · ) to it, where T is an adjustable parameter. Formally, the forward process can be defined as a Markov chain from data x 0 to the latent variable x T :

Here, { β t ∈ (0 , 1) } T t =1 ( β 1 < β 2 < . . . < β T ) is the corresponding variance schedule. Since it is impractical to back-propagate the gradient by sampling from a Gaussian distribution, we adopt a reparameterization trick to keep the gradient derivable [11] and the x t can be expressed as x t = √ ¯ α t x 0 + √ 1 -¯ α t ϵ , where ϵ ∼ N (0 , I ) and ¯ α t = ∏ t i =1 (1 -β i ) .

Reverse process . The reverse diffusion process, also known as the denoising process, aims to recover the original data distribution from the noisy data x T ∼ N (0 , I ) . Accordingly, this process can be formulated by the following Markov chain:

where µ θ ( x t , t ) and σ θ ( x t , t ) are the mean and variance parameterized by θ , respectively. Based on the literature [11], for any ˜ β t = 1 -¯ α t -1 1 -¯ α t β t ( t > 1 ) and ˜ β 1 = β 1 , the parameterizations of µ θ and σ θ are defined by:

4 DiffTraj Framework

In this section, we present the details of the DiffTraj framework shown in Fig. 1, which applies the diffusion model to trajectory generation. The primary goal of DiffTraj is to estimate the real-world trajectory distribution q ( x 0 | x co 0 ) using a parameterized model p θ ( x s 0 | x co 0 ) . Given a random noise x T ∼ N (0 , I ) , DiffTraj generates a synthetic trajectory x s 0 , conditioned on the observations x co 0 . The reverse (generation) process from the Eq. (2) can be reformulated for DiffTraj as:

In this context, µ θ serves as a conditional denoising function that takes the conditional observation x co 0 as input. We then extend the Eq. (3) to account for the conditional observation as follows:

Training . In practice, the reverse trajectory denoising process can be summarized as learning the Gaussian noise ϵ θ ( x s t , t | x co 0 ) through x s t , t and x co 0 (refer to Fig. 1). Then solving µ θ ( x s t , t | x co 0 ) according to Eq. (3). This process can be trained by following objective [11]:

The above equations show that the core of training the diffusion model is to minimize the mean squared error between the Gaussian noise ϵ and predicted noise level ϵ θ ( x s t , t | x co 0 ) .

Sampling . Given the reverse process presented in Sec. 3.2, the generative procedure can be summarized as sampling the x s T ∼ N (0 , I ) , and iterative sampling based on x t -1 ∼ p θ ( x s t -1 | x s t , x co 0 ) . The final sampled output is x s 0 .

!

!"#

!

$

!

!

!

%

" !

!

!

!"#

, !

$

&'

$

(

!

!"#

)

!

!

)

, !

$

&'

…

…

Traj-UNet

Sinusoidal

Wide & Deep

!

!"#

%

!

$

&'

!

!

&

(

4.1 Traj-UNet Architecture

While developing the DiffTraj framework, accurately predicting the noise level at each diffusion time step is non-trivial. A model must capture these complex spatial-temporal dependencies to accurately predict the noise level at each diffusion time step. Inaccurate noise predictions can lead to excessively noisy trajectories, resulting in unrealistic patterns. Thus, we employ Traj-UNet to predict the noise of each diffusion time step in DiffTraj, i.e., ϵ θ ( x s t , t | x co 0 ) . Specifically, we construct a network based on the UNet architecture [26], which has been extensively used in generative applications involving diffusion models [35, 20, 5]. The Traj-UNet is composed of two parts: down-sampling and up-sampling, each featuring multiple 1D-CNN-based stacked residual network blocks (Resnet block) with a kernel size of 3 in each layer. An attention mechanism-based transitional module is integrated between the two parts [30] (Detailed information about Traj-UNet can be found in Fig. 4 of the Appendix A). To enhance the learning of noise for each diffusion time step, Traj-UNet incorporates time step embedding and then fed to each block. Specifically, we employ Sinusoidal embedding [30] to represent each t as a 128 -dimensional vector. Subsequently, we apply two shared-parameter fully connected layers and add them to the input of the Resnet block.

Input trajectory . It is important to note that the input/output data for this model is a two-dimensional trajectory tensor ( [2 , length] ), with each dimension representing the longitude and latitude of the trajectory, respectively. Considering CNN-based models can only accept fixed-shape data, we initially up-sample or down-sample the training trajectories using linear interpolation methods [3]. The generated trajectories are then transformed to the desired length using the same approach.

Why use CNN based structure? In DiffTraj, we adopt a CNN-based UNet structure over other temporal processing modules such as recurrent neural networks (RNNs) and WaveNet for several reasons. First, CNN-based methods can alleviate the vanishing gradient problem often encountered in RNNs, enabling more efficient learning of long-term dependencies. Second, compared to models like RNNs, CNNs hold a smaller number of parameters and offer greater computational efficiency, which is crucial during the reverse process. Finally, the UNet architecture excels in various generative tasks, particularly when combined with diffusion models [28, 11, 7]. Its multi-level structure with skip connections enables multi-scale feature fusion, helping the model better capture local and global contextual information in GPS trajectory data. We found that RNN and WaveNet-based architectures led to worse trajectory quality, as will be presented in Sec. 5.

4.2 Conditional Generation

Various external factors, such as the region of the trip and departure time, influence real-world trajectories. This conditional information should provide meaningful guidance for the generation process, ensuring that synthetic trajectories exhibit similar patterns and behaviors. In the proposed DiffTraj framework, a Wide & Deep network [6] structure is employed to effectively embed conditional information, enhancing the capabilities of the Traj-UNet model. The wide component emphasizes memorization, capturing the significance of individual features and their interactions, while the deep component concentrates on generalization, learning high-level abstractions and feature combinations. This combination effectively captures both simple and complex patterns in the trajectory. For a given trajectory, several numerical motion properties (e.g., velocity and distance)

and discrete external properties (e.g., departure time and regions) are derived. A wide network is utilized for embedding the numerical motion attributes, whereas a deep network is employed for the discrete categorical attributes. The wide network consists of a fully connected layer with 128 outputs, capturing linear relationships among motion attributes. In regard to the discrete categorical attributes, the deep network initially embeds them into multiple 128 -dimensional vectors, concatenates these vectors, and subsequently employs two fully connected layers to learn intricate feature interactions. Finally, the outputs generated by the Wide & Deep networks are combined and integrated into each Resnet block.

4.3 Ensuring Generation Diversity

In practice, it should be avoided that conditional information results in a model with overly smooth or deterministic behavior patterns, which could undermine the intended privacy protections. To regulate the diversity of the generated trajectories and prevent the DiffTraj from following the conditional guidance too closely, we employ the classifier-free diffusion guidance method [12]. Specifically, we jointly train conditional and unconditional diffusion models with a trade-off between sample quality and diversity by using a guiding parameter ω . That is, the noise prediction model can be written as:

where ∅ denotes a vector in which all conditional information is 0 , essentially not encoding any information. When ω = 0 , the model is a general diffusion model with conditional information only. By increasing the ω , the model will focus more on unconditionally predicting noise (i.e., more diversity) when generating trajectories. Therefore, we can strike a balance between maintaining the quality of the generated trajectories and increasing their diversity, ensuring that the model does not generate overly deterministic behavior patterns.

4.4 Sampling Speed up

As described in Sec. 3.2, DiffTraj relies on a large Markov process to generate high-quality trajectories, rendering a slow reverse diffusion process. Therefore, it is a significant challenge for the proposed model to generate valid and usable trajectories in a reasonable time frame. To address this issue, we adopt a non-Markov diffusion process approach with the same optimization objective [28], thus allowing the computation of efficient inverse processes. Specifically, we can sample every ⌈ T/S ⌉ steps with the skip-step method presented in [23]. The corresponding set of noise trajectories changes to { τ 1 , . . . , τ S } , τ i ∈ [1 , T ] . Through this approach, the sampling steps during trajectory generation can be significantly reduced from T steps to S steps. Compared to the typical diffusion model [11], this method can generate higher quality samples in fewer steps [28].

4.5 Discussion on Privacy

The DiffTraj inherently protects privacy in GPS trajectory generation due to its generative nature and the manner in which it reconstructs synthetic data from random noise. It offers effective privacy protection through two key aspects. (1) Generative Approach: The DiffTraj generates trajectories by sampling from a learned distribution, rather than directly relying on or perturbing real-world data. By reconstructing trajectories from random noise during the reverse diffusion process, the model effectively decouples synthetic data from specific real data points. This ensures that the generated trajectories do not contain personally identifiable information or reveal sensitive location details, thus protecting their privacy. (2) Learning Distribution: The Traj-UNet learns the distribution of real trajectories and generates synthetic ones that exhibit similar patterns and behaviors, which avoids direct replicating individual real trajectories. The diverse and realistic synthetic trajectory generation ensures that sensitive information about specific individuals or their movement patterns is not inadvertently leaked. Moreover, it prevents the possibility of reverse engineering real trajectories from synthetic ones. By combining these aspects, the DiffTraj offers robust privacy protection for GPS trajectory generation, addressing concerns about data privacy while maintaining utility.

5 Experiments

We conduct extensive experiments on two real-world trajectory datasets to show the superior performance of the proposed DiffTraj in GPS trajectory generation. In this section, we only include

the basic setup, comparison of the main experimental results, and visualization analysis. Owing to space limitation, we leave other details (dataset, baselines, network structure, hyperparameters, etc.) and more results (conditional generation, case studies, etc.) in the Appendix . All experiments are implemented in PyTorch and conducted on a single NVIDIA A100 40GB GPU. The code for the implementation of DiffTraj is available for reproducibility 2 .

5.1 Experimental Setups

Dataset and Configuration . We evaluate the generative performance of DiffTraj and baselines on two real-world GPS trajectory datasets of Chinese cities, namely, Chengdu and Xi'an. A detailed description of the dataset and statistics is available in Appendix B.1, and experiment about Porto dataset is shown in Appendix C.1.

Evaluation Metrics . To fully evaluate the quality of the generated trajectories, we follow the design in [8] and use four utility metrics at different levels. Specifically, 1) Density error measures the geo-distribution between the entire generated trajectory and the real one, which measures the quality and fidelity of the generated trajectories at the global level. For trajectory level, 2) Trip error measures the distributed differences between trip origins and endpoints, and 3) Length error focuses on the differences in real and synthetic trajectory lengths. Moreover, we use 4) Pattern score to calculate the pattern similarity of the generated trajectories (see Appendix B.2 for details).

Baseline Methods . We compare DiffTraj with a series of baselines, including three typical generative models ( VAE [34], TrajGAN [9] and DP-TrajGAN [38]) and a range of variants based on the diffusion model approach. Specifically, Diffwave is a diffusion model based on the WaveNet structure [14], while Diff-LSTM replaces the 1D-CNN-based temporal feature extraction module with an LSTM. In addition, Diff-scatter and Diff-wo/UNet can be considered as ablation studies of the proposed method to evaluate the effectiveness of diffusion models and UNet structures, respectively. Furthermore, DiffTraj-wo/Con indicates no integration of the conditional information embedding module, which is used to evaluate the efficiency of the Wide & Deep module for trajectory generation. Finally, we also compare Random Perturbation (RP) and Gaussian Perturbation (GP) , two classes of non-generative approaches, to compare the superiority of generative methods in privacy preservation. The details of the implementation are presented in Appendix B.3.

5.2 Overall Generation Performance

Table 1 presents the performance comparison of DiffTraj and the selected baseline methods on two real-world datasets. Specifically, we randomly generate 3 , 000 trajectories from each generative method and then calculate all metrics. From the results, we observe several trends that highlight the advantages of the proposed DiffTraj method. Non-generative methods, RP and GP, exhibit poor performance due to their reliance on simple perturbation techniques, which fail to capture the complex spatial-temporal dependencies and motion properties of the real GPS trajectories. This leads to lower-quality synthetic trajectories compared to generative models. Generative models, VAE and TrajGAN, show better performance than RP and GP but are still inferior to DiffTraj (or DiffTraj-wo/Con). This is because VAE and TrajGAN primarily focus on spatial distribution and may not adequately capture the temporal dependencies within trajectories. Additionally, the DiffTraj is designed to reconstruct the data step-by-step from random noise, which makes it more suitable for generating real GPS trajectory that reflect the inherent stochastic nature of human activities.

Diff-LSTM achieves good results in some metrics compared to the model without UNet, but falls short of DiffTraj due to the differences in the backbone network. The LSTM-based approach in Diff-LSTM is inherently designed for sequence processing and may be less effective in capturing spatial dependencies in the data compared to the CNN-based approach used in DiffTraj. The CNN-based backbone in DiffTraj can better model local spatial patterns and multi-channel dependencies more effectively, leading to higher-quality generated trajectories. Nevertheless, such results advocate the employment of diffusion models in future studies related to spatial-temporal data generation.

Ablation Study . The other diffusion model variants, Diffwave, Diff-scatter, and Diff-wo/UNet, do not perform as well as DiffTraj due to differences in their network structures or the absence of the UNet architecture. The Traj-UNet structure in DiffTraj is specifically designed for spatial-temporal

2023/5/10 19:54

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_VAE.html

Chengdu_Gen_VAE.html

Bold indicates the statistically best performance (i.e., two-sided t-test with p < 0.05) over the best baseline. Chengdu_Gen_GAN.html 2023/5/10 19:54 Chengdu_Gen_Dif wave.html 2023/5/10 19:54 Chengdu_Gen_Difflstm.html 2023/5/10 19:53 Chengdu_Gen_Con.html 2023/5/10 19:53

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

2023/5/10 19:54

Chengdu_origin.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(a) VAE

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_GAN.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(b) TrajGAN

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_Dif wave.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(c) Diffwave

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_Difflstm.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(d) Diff-LSTM

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

tmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(e) DiffTraj

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_origin.html

Leaflet (ht ps:/ leafletjs.com) | © OpenStre

tMap (ht ps:/ w

w.openstre

(f) Real

modeling and multi-scale feature fusion, enabling the accurate prediction of noise levels during denoising and resulting in high-quality generated trajectory. It is also noteworthy that satisfactory results can still be accomplished when only generating scattered locations or discarding the Traj-UNet structure. Finally, the conditional version of DiffTraj outperforms the unconditional version (DiffTraj-wo/Con) because it incorporates conditional information into the trajectory generation process. This allows the model to better account for external factors such as traffic conditions, departure time, and regions, which significantly influence human mobility patterns. This result can also be verified by the performance on the pattern indicator, where this indicator significantly outperforms other models.

Geographic Visualization . We also visualized the generated results to better present the performance of different generative models. Fig. 2 shows the trajectory distributions generated by baseline methods for Chengdu (Please refer to Fig. 10 and Fig. 11 in Appendix D for Xi'an and larger view). From visualizations, we can see that all the generated trajectories show geographic profiles of the city. Notably, DiffTraj and Diff-LSTM generate trajectories almost identical to the original trajectories and significantly surpass the other methods. However, Diff-LSTM performs poorly compared to DiffTraj on sparse roads, suggesting that CNNs are skilled in capturing local and global spatial features, making them more suitable for handling sparse road scenes. In addition, developing a tailor-made UNet architecture is also essential. Comparing Fig. 2(c) and Fig. 2(e), we can observe that the latter is able to generate a visually more realistic trajectory distribution.

5.3 Utility of Generated Data

As the generated trajectory serves downstream tasks, its utility is critical to determine whether the data generation method is indeed practical. In this section, we evaluate the utility of generated trajectory through an inflow (outflow) prediction task, which is one of the important applications of trajectory data analysis [13, 39]. Specifically, we train multiple advance prediction models using the original and generated trajectory separately, and then compare the prediction performance (detail experimental setup refer to Appendix C.3). As concluded in Table 2, the performance of the models when trained on the generated data is comparable to their performance on the original data. This result shows that our generative model, DiffTraj, is able to generate trajectory that retain the key statistical properties of the original one, hence making them useful for downstream tasks such as inflow and outflow prediction. However, there is a slight increase in error metrics when using the generated data, implying there's still room for further improvements in trajectory generation. Nevertheless, this result encourages the use of generated, privacy-free alternatives to the original data in future studies related to trajectory data analysis.

5%

20%

50%

100%

0.00

0.02

0.04

0.06

0.08

Origin

Transfer

(a) Chengdu

5%

20%

50%

100%

0.00

0.01

0.02

0.03

0.04

0.05

0.06

0.07

Origin

Transfer

(b) Xi'an

10

50

100

500

0

10

20

30

40

50

60

70

Time (min)

0.00

0.02

0.04

0.06

0.08

0.10

0.12

0.14

0.16

Density

Time

Density

(c) Chengdu

10

50

100

500

0

10

20

30

40

50

60

70

Time (min)

0.025

0.050

0.075

0.100

0.125

0.150

0.175

0.200

0.225

Density

Time

Density

(d) Xi'an

5.4 Additional Experiment

Transfer Learning . Transfer learning is an essential aspect to investigate in the context of trajectory generation, as it can demonstrate the robustness and generalization capabilities of the proposed DiffTraj framework. In this paper, we pre-train the DiffTraj model in one city, and then continue the training in another city using a different percentage ( 5% ∼ 100% ) of data. We also compared these results with only training DiffTraj on different percentages of data. As shown in Fig. 3, 'origin' indicates that transfer learning is not applicable, while 'transfer' indicates applying transfer learning. Notably, even with just 5% of the data, the transfer learning model achieves a significantly lower error compared to the original one. As the percentage of data increases, the gap between the two models narrows. The results show that the DiffTraj model exhibits strong adaptability and generalization capabilities when applied to different urban scenarios. This allows the model to quickly adapt to new urban contexts and capture the inherent mobility patterns with less data, thereby reducing training time and improving applicability to diverse real-world scenarios.

Speed up Sampling . As discussed in Sec. 3.2, the diffusion model requires numerous sampling steps for gradual denoising, resulting in a slow trajectory generation process. By incorporating the sampling speed-up technique outlined in Sec. 4.4, we examine the efficiency of generating 50 × 256 trajectories using a well-trained DiffTraj on two datasets. The results are summarized in Fig. 3, where the X-axis represents the total sample steps after speed-up, and the two Y-axes indicate the time spent and Density error, respectively. All models trained with T = 500 diffusion steps consistently yield high-quality trajectories resembling the original distribution. Moreover, the model matches the outcomes of the no skipped steps method at T = 100 , saving 81% of the time cost. However, too few sampling steps ( S < 100 ) result in a significant divergence between the generated and real trajectory. This occurs because fewer sample steps lead to more skipped reverse operations, causing Diff-Traj to discard more noise information during denoising. Nonetheless, these results highlight the substantial efficiency improvements achieved by the speed-up methods presented in Sec. 4.4.

6 Conclusion

In this work, we propose a new GPS trajectory generation method based on diffusion model and spatial-temporal data mining techniques. This method, named DiffTraj, leverages the data generation ability of the diffusion model and learning from spatial-temporal features by Traj-UNet. Specifically, real trajectories are gradually transformed into random noise by a forward trajectory noising process. After that, DiffTraj adopts a reverse trajectory denoising process to recover forged trajectories from the noise. Throughout the DiffTraj framework, we develop a Traj-UNet structure and incorporate Wide & Deep conditional module to extract trajectory features and estimate noise levels for the reverse process. Extensive experiments validate the effectiveness of DiffTraj and its integrated Traj-UNet. Further experiments prove that the data generated by DiffTraj can conform to the statistical properties of the real trajectory while ensuring utility, and provides transferability and privacy-preserving.

7 Acknowledgments

This work is supported by the Stable Support Plan Program of Shenzhen Natural Science Fund under Grant No. 20220815111111002. This research was partially supported by Research Impact Fund (No. R1015-23), APRC - CityU New Research Initiatives (No.9610565, Start-up Grant for New Faculty of City University of Hong Kong), CityU - HKIDS Early Career Research Grant (No.9360163), Hong Kong ITC Innovation and Technology Fund Midstream Research Programme for Universities Project (No.ITS/034/22MS), Hong Kong Environmental and Conservation Fund (No. 88/2022), SIRG CityU Strategic Interdisciplinary Research Grant (No.7020046, No.7020074), Tencent (CCF-Tencent Open Fund, Tencent Rhino-Bird Focused Research Fund), Huawei (Huawei Innovation Research Program), Ant Group (CCF-Ant Research Fund, Ant Group Research Fund) and Kuaishou.

References

M. P. Armstrong, G. Rushton, and D. L. Zimmerman. Geographically masking health data to preserve confidentiality. Statistics in medicine , 18(5):497-525, 1999.

O. Avrahami, D. Lischinski, and O. Fried. Blended diffusion for text-driven editing of natural images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 18208-18218, 2022.

J. Bergh and J. Löfström. Interpolation Spaces: An Introduction . Springer Berlin Heidelberg, 2012.

C. Cao and M. Li. Generating mobility trajectories with retained data utility. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining , pages 2610-2620, 2021.

H. Cao, C. Tan, Z. Gao, G. Chen, P.-A. Heng, and S. Z. Li. A survey on generative diffusion model. arXiv preprint arXiv:2209.02646 , 2022.

H.-T. Cheng, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, G. Anderson, G. Corrado, W. Chai, M. Ispir, et al. Wide & deep learning for recommender systems. In Proceedings of the 1st workshop on deep learning for recommender systems , pages 7-10, 2016.

P. Dhariwal and A. Nichol. Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems , 34:8780-8794, 2021.

Y. Du, Y. Hu, Z. Zhang, Z. Fang, L. Chen, B. Zheng, and Y. Gao. Ldptrace: Locally differentially private trajectory synthesis. arXiv preprint arXiv:2302.06180 , 2023.

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems , volume 27, 2014.

X. Han, X. Zhao, L. Zhang, and W. Wang. Mitigating action hysteresis in traffic signal control with traffic predictive reinforcement learning. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , page 673-684, 2023.

J. Ho, A. Jain, and P. Abbeel. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems , 33:6840-6851, 2020.

J. Ho and T. Salimans. Classifier-free diffusion guidance. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications , 2021.

R. Jiang, D. Yin, Z. Wang, Y. Wang, J. Deng, H. Liu, Z. Cai, J. Deng, X. Song, and R. Shibasaki. DL-traff: Survey and benchmark of deep learning models for urban traffic prediction. In Proceedings of the 30th ACM international conference on information & knowledge management , pages 4515-4525, 2021.

Z. Kong, W. Ping, J. Huang, K. Zhao, and B. Catanzaro. Diffwave: A versatile diffusion model for audio synthesis. In International Conference on Learning Representations , 2020.

X. L. Li, J. Thickstun, I. Gulrajani, P. Liang, and T. B. Hashimoto. Diffusion-lm improves controllable text generation. arXiv preprint arXiv:2205.14217 , 2022.

Y. Liang, K. Ouyang, H. Yan, Y. Wang, Z. Tong, and R. Zimmermann. Modeling trajectories with neural ordinary differential equations. In IJCAI , pages 1498-1504, 2021.

C.-Y. Liou, W.-C. Cheng, J.-W. Liou, and D.-R. Liou. Autoencoder for words. Neurocomputing , 139:84-96, 2014.

F. Liu, D. Wang, and Z.-Q. Xu. Privacy-preserving travel time prediction with uncertainty using gps trace data. IEEE Transactions on Mobile Computing , pages 1-1, 2021.

Q. Liu, F. Yan, X. Zhao, Z. Du, H. Guo, R. Tang, and F. Tian. Diffusion augmentation for sequential recommendation, 2023.

M. Luca, G. Barlacchi, B. Lepri, and L. Pappalardo. A survey on deep learning for human mobility. ACM Computing Surveys (CSUR) , 55(1):1-44, 2021.

M. E. Nergiz, M. Atzori, and Y. Saygin. Towards trajectory anonymization: a generalization-based approach. In Proceedings of the SIGSPATIAL ACM GIS 2008 International Workshop on Security and Privacy in GIS and LBS , pages 52-61, 2008.

A. Nichol, P. Dhariwal, A. Ramesh, P. Shyam, P. Mishkin, B. McGrew, I. Sutskever, and M. Chen. Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741 , 2021.

A. Q. Nichol and P. Dhariwal. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning , pages 8162-8171. PMLR, 2021.

K. Ouyang, R. Shokri, D. S. Rosenblum, and W. Yang. A non-parametric generative model for human trajectories. In IJCAI , volume 18, pages 3812-3817, 2018.

R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 10684-10695, 2022.

O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention , pages 234-241. Springer, 2015.

J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. In International Conference on Machine Learning , pages 2256-2265. PMLR, 2015.

J. Song, C. Meng, and S. Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 , 2020.

Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 , 2020.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. Attention is all you need. Advances in neural information processing systems , 30, 2017.

X. Wang, X. Liu, Z. Lu, and H. Yang. Large scale gps trajectory generation using map based on two stage gan. Journal of Data Science , 19(1):126-141, 2021.

H. Wen, Y. Lin, Y. Xia, H. Wan, Q. Wen, R. Zimmermann, and Y. Liang. Diffstg: Probabilistic spatio-temporal graph forecasting with denoising diffusion models. arXiv preprint arXiv:2301.13629 , 2023.

L. Xi, C. Hanzhou, and A. Clio. trajgans: using generative adversarial networks for geo-privacy protection of trajectory data. Vision paper , 2018.

T. Xia, X. Song, Z. Fan, H. Kanasugi, Q. Chen, R. Jiang, and R. Shibasaki. Deeprailway: A deep learning system for forecasting railway traffic. In 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) , pages 51-56, 2018.

L. Yang, Z. Zhang, Y. Song, S. Hong, R. Xu, Y. Zhao, Y. Shao, W. Zhang, B. Cui, and M.-H. Yang. Diffusion models: A comprehensive survey of methods and applications. arXiv preprint arXiv:2209.00796 , 2022.

Y. Yuan, J. Ding, H. Wang, D. Jin, and Y. Li. Activity trajectory generation via modeling spatiotemporal dynamics. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , pages 4752-4762, 2022.

P. A. Zandbergen. Ensuring confidentiality of geocoded health data: assessing geographic masking strategies for individual-level data. Advances in medicine , 2014, 2014.

J. Zhang, Q. Huang, Y. Huang, Q. Ding, and P.-W. Tsai. Dp-trajgan: A privacy-aware trajectory generation model with differential privacy. Future Generation Computer Systems , 2022.

Z. Zhang, X. Zhao, H. Miao, C. Zhang, H. Zhao, and J. Zhang. Autostl: Automated spatio-temporal multi-task learning. arXiv preprint arXiv:2304.09174 , 2023.

X. Zhao, W. Fan, H. Liu, and J. Tang. Multi-type urban crime prediction. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 36, pages 4388-4396, 2022.

Y. Zheng. Trajectory data mining: an overview. ACM Transactions on Intelligent Systems and Technology (TIST) , 6(3):1-41, 2015.

Y. Zheng, L. Capra, O. Wolfson, and H. Yang. Urban computing: concepts, methodologies, and applications. ACM Transactions on Intelligent Systems and Technology (TIST) , 5(3):1-55, 2014.

Y. Zheng, L. Zhang, X. Xie, and W.-Y. Ma. Mining interesting locations and travel sequences from gps trajectories. In Proceedings of the 18th international conference on World wide web , pages 791-800, 2009.

Y. Zhu, Y. Ye, Y. Liu, and J. J. Q. Yu. Cross-area travel time uncertainty estimation from trajectory data: a federated learning approach. IEEE Transactions on Intelligent Transportation Systems , 23(12):24966-24978, 2022.

A DiffTraj Details & Hyperparameters

In this section, we cover the specific details of DiffTraj, including the DiffTraj framework, the Traj-UNet structure, and the implementation details.

A.1 Architecture

Down-Sampling

ResnetBlock

N

...

ResnetBlock

N

Up-Sampling

...

MidAttnBlock

Copy and Concatanate

Sinusoidal

Wide & Deep

Conditional

Traj-UNet

Traj-UNet

interpolation

Various length

As illustrated in Fig. 4, DiffTraj is divided into two modules, i.e., down-sampling and up-sampling, and conditional module. Each down-sampling and up-sampling module consists of multiple stacked Resnet blocks. Between the two of them, a transitional module based on the attention mechanism is integrated. To better learn the noise of each time step and guide the generation, DiffTraj integrates a conditional module to embed the time step and external traffic information, later fed to each block. Since the CNN structure can only accept data of fixed shape, we first sample each trajectory as a tensor of [2 , length] . Specifically, if the trajectory is below the set length, it is added using linear interpolation, and if it is greater than that, the redundant portion is removed using linear interpolation. Thus, the model will generate fixed-length trajectories, which will then be tailored to the desired length by the conditional information.

Group Normalization

Convolution 1D

Activation

Embedding Block

ResnetBlock

ResnetBlock

Attention layer

Linear Layer

Activation

Group Normalization

Convolution 1D

Activation

Linear

Project

Down/Up-Sample

MidAttnBlock

Down-Sample

Up-Sample

Down/Up-Sample

Time Step

Embedding

ResnetBlock

Sinusoidal

Linear Layer

Linear Layer

Linear Layer

Activation

Linear Layer

Numerical

Categorical

The main blocks of Traj-UNet are presented in Fig. 5, i.e., Resnet block, Embedding block, and middle attention block. Among them, each sampling block (down-sampling and up-sampling) consists of multiple Resnet blocks, each containing a series of group normalization, nonlinear activation, and 1D-CNN layers. Then, Traj-UNet applies up-sampling or down-sampling to the output, where down-sampling uses max pooling and up-sampling uses interpolation. After this, Traj-UNet integrates a middle attention block, which consists of two Resnet blocks and an attention layer. Note that there are no additional down-/up-sampling operations in the Resnet block. Finally, we integrate a conditional embedding block to learn the diffusion time step and conditional information. For the diffusion step, we employ Sinusoidal embedding to represent each t as a 128 -dimensional vector, and then apply two shared-parameter fully connected layers. For conditional information, such as distance, speed, departure time, travel time, trajectory length, and starting and ending locations, we use the Wide & Deep module for embedding. After getting the diffusion step embedding and conditional embedding, we sum them up and add them to each Resnet block.

A.2 Implementation Details

For the proposed DiffTraj framework, we summarize the adopted hyperparameters in Table 3. In addition, to facilitate reproduction by the researcher, we provide a reference range of hyperparameters based on the experience and general settings of the present work.

The training and sampling phase of the proposed framework is summarized in Algorithm 1 and Algorithm 2, respectively.

B Details of the Experimental Setup

B.1 Dataset

We evaluate the performance of DiffTraj and all baselines methods on two datasets with different cities, Chengdu and Xi'an 3 . Both datasets are collected from cab trajectory data starting from November 1, 2016, to November 30, 2016. Table 4 summarizes the statistical information of these two datasets, and Fig. 6 shows the trajectory distribution and heat map of these two datasets, where the deeper color indicates the more concentrated trajectory in the region. For all datasets, we remove all trajectories with lengths less than 120 and sample them to a set fixed length.

+

-

(a) Chengdu Trajectory

+

-

(b) Chengdu Heatmap

(c) Xi'an Trajectory

(d) Xi'an Heatmap

Leaflet (ht ps:/ leafletjs.com) | Data by © OpenStreetMap (ht p:/ openstreetmap.org), under ODbL (ht p:/ www.openstreetmap.org/copyright).

B.2 Evaluation Metrics

file:///C:/Users/Yongchao Ye/Downloads/heatmap_xian.html Leaflet (https://leafletjs.com) | Data by © OpenStreetMap (http://openstreetmap.org), under ODbL (http://www.openstreetmap.org/copyright)., attribution As trajectory generation aims to generate trajectories that can replace real-world activities and further benefit downstream tasks, we need to evaluate the 'similarity' between the generated trajectories and real ones. In this work, we follow the common practice in previous studies [8] and measure the quality of the generated ones by Jenson-Shannon divergence (JSD). JSD compares the distribution of the real and generated trajectories, and a lower JSD indicates a better match with the original statistical features. Suppose that the original data has a probability distribution P and the generated data has a probability distribution G , the JSD is calculated as follows:

1/1

For the evaluation, we divided each city into 16 × 16 size grids and recorded the corresponding values for each grid. Based on this, we adopt the following metrics to evaluate the quality of the generated trajectories from four perspectives:

Density error: This a global level metric that used to evaluate the geo-distribution between the entire generated trajectory D ( T gen ) and the real trajectory D ( T ) .

where D ( · ) denotes the grid density distribution in a given trajectory set, and JSD( · ) represents the Jenson-Shannon divergence between two distributions.

Trip error: This a trajectory level metric that measures the correlation between the starting and ending points of a travel trajectory. Specifically, we calculate the probability distribution of the start/end points in the original and generated trajectories and use JSD to measure the difference between them.

heatmap_xian.html

Length error: This a trajectory level metric to evaluate the distribution of travel distances. It can be obtained by calculating the Euclidean distance between consecutive points.

Pattern score: This is a semantic level metric defined as the topn grids that occur most frequently in the trajectory. We define P and P gen to denote the original and generated pattern sets, respectively, and compute the following metrics:

B.3 Baselines

In this section, we introduce the implementation of baseline methods.

Random Perturbation (RP): We generate -0 . 01 ∼ 0 . 01 random noise to perturb the original trajectory. This degree of noise ensures that the maximum distance between the perturbed points and the original does not exceed 2 km

Gaussian Perturbation (GP): We generate Gaussian noise perturbed original trajectories with mean 0 and variance 0 . 01 .

Variational AutoEncoder (VAE) [17, 34]: In this work, trajectories are first embedded as a hidden distribution through two consecutive convolutional layers and a linear layer. Then, we generate the trajectories by a decoder consisting of a linear layer and two deconvolutional layers. The size of convolution kernels in convolutional and deconvolutional layers is set to 4 to ensure that input and output trajectories have the same size.

TrajGAN [9]: The trajectory is first combined with random noise and then passes through a generator consisting of two linear layers and two convolution layers. Subsequently, a convolutional layer and a linear layer are adopted as the discriminator. The generator and the discriminator are trained in an alternating manner.

Dp-TrajGAN [38]: The model is similar to TrajGAN, with the difference that this model replaces CNN with LSTM.In addition, we remove the unnecessary operation of differential privacy for fair comparison.

Diffwave [14]: Diffwave is a Wavenet structure model designed for sequence synthesis, which employs extensive dilated convolution. Here, we use 16 residual connected blocks, each consisting of a bi-directional dilated convolution. Then they are summed using sigmoid and tanh activation, respectively, and fed into the 1D CNN.

Diff-scatter: We randomly sample GPS scatter points from trajectories and generate scatter points using a 4-layer MLP (neutrons: { 128 , 256 , 256 , 128 } ) and the diffusion model.

Diff-wo/UNet: This model uses only two Resnet blocks combined with a single attention layer between them. Compared with DiffTraj, this model does not have a UNet-type structure, which can be used to evaluate the necessity of the UNet structure.

Diff-LSTM: This model has the same UNet-type structure and number of Resnet blocks as DiffTraj, and the difference is that Diff-LSTM replaces the CNN with LSTM in Resnet block.

DiffTraj-wo/Con: DiffTraj-wo/Con represents that the Wide & Deep conditional information embedding module is removed. The rest is the same as DiffTraj.

C Additional Experiments

C.1 Porto Dataset Experiment

To further validate the generalizability of our approach, we conducted experiments on a different Porto dataset. Through the new experiment, we can see that DiffTraj achieves the best performance on this dataset, demonstrating its ability to adapt to different geographic regions and capture different trajectory patterns. These results underscore the generalizability across different cities.

C.2 Data Utility Additional Experiments

To illustrate the performance of DiffTraj generated trajectories, we use the trajectory data generated based on different baselines for the inflow/outflow prediction task. As can be seen from the results in Table 6, the training results using DiffTraj to generate trajectories are closer to the real environment than using the baseline generation method, which is in line with the trend shown in Table 1.

C.3 Data Utility Setup

In this paper, we use inflow/outflow traffic forecasting to test the utility of the generated data. Inflow/outflow traffic forecasting is a critical task in urban traffic management that involves predicting the volume of vehicles entering (inflow) or leaving (outflow) a specific region within a certain period of time. In this experiment, we divided a city into 16 × 16 grids, where each grid represents a specific region. The traffic volume entering (inflow) or leaving (outflow) each region within a certain period is predicted. The primary goal of this experiment is to train various prediction models using both original and generated trajectory data, comparing their prediction performance. This evaluation provides an important perspective on the real-world applicability of the data generated by DiffTraj, assessing not just the fidelity of the generated trajectories, but also their utility in downstream tasks. In the experimental setup, we train the prediction models using the generated data and the original data separately, and then test their prediction performance on real data. Advanced neural network models, such as AGCRN, Graph WaveNet, DCRNN, and MTGNN, have been employed to handle this task due to their ability to capture complex spatial-temporal dependencies in multivariate time series data. All the above models and code in this section are followed the publicly available code 4 provided in the literature [13].

AGCRN (Adaptive Graph Convolutional Recurrent Network): AGCRN is a sophisticated model for spatial-temporal forecasting, which leverages both spatial and temporal features of data. It uses graph convolution to capture spatial dependencies and RNNs to model temporal dynamics, making it capable of handling complex spatial-temporal sequences.

GWNet (Graph WaveNet): GWNet is designed for high-dimensional, structured sequence data. It incorporates a Graph Convolution Network (GCN) to model spatial correlations and a WaveNet-like architecture to model temporal dependencies. The combination allows for capturing both the spatial and temporal complexities present in high-dimensional data.

DCRNN (Diffusion Convolutional Recurrent Neural Network): DCRNN is a deep learning model designed for traffic forecasting, which handles the spatial and temporal dependencies in traffic flow data. It uses a diffusion convolution operation to model spatial dependencies and a sequence-to-sequence architecture with scheduled sampling and residual connections to model temporal dependencies.

MTGNN(Multivariate Time-series Graph Neural Network): MTGNNis a model that captures complex spatial-temporal relationships in multivariate time series data. The model leverages a graph neural network to model spatial dependencies and an auto-regressive process to capture temporal dependencies. It also uses a gating mechanism to adaptively select the relevant spatial-temporal components, thus improving the forecasting performance.

For accuracy comparison, we use the mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE) as metrics to assess the prediction accuracy of all methods. These three metrics are defined as follows:

where X ( i ) and ˆ X ( i ) are the ground truth and predicted inflow/outflow value at time i , respectively.

C.4 Conditional Generation

As we described in Sec. 4.2 and Sec. 4.3, the DiffTraj framework takes into account various external factors that influence real-world trajectories, such as road network structure and departure time. These factors are used to guide the generation process, ensuring the synthetic trajectories mimic real-world patterns and behaviors. The model employs a Wide & Deep network to effectively embed this conditional information, enhancing the capabilities of the Traj-UNet model.

To evaluate the conditional generation capability of DiffTraj, we investigate the case of generated trajectories where the start and end regions of the trajectories were pre-defined. The model was tasked to generate 20 random trajectories adhering to these conditions. The results depicted in Fig. 7 and Fig. 8 (The red and blue boxes indicate the starting and ending regions, respectively), effectively demonstrate proficiency in generating trajectories that align with the specified start and end regions of DiffTraj. This is observed consistently across both cities under study, reinforcing the model's ability to accurately incorporate and adhere to conditional information. This robust capability underscores the versatility of DiffTraj in generating meaningful trajectories under specific conditions, and its applicability in real-world scenarios where such conditions often exist.

C.5 Ensuring Generation Diversity

In addition, DiffTraj is designed to generate high-quality trajectories and ensure a level of diversity that prevents overly deterministic behavior patterns, thereby upholding intended privacy protections. By integrating a classifier-free diffusion guidance method, DiffTraj can strike a calculated balance between sample quality and diversity. To validate the capacity for generating diverse trajectories of DiffTraj, we devised an experiment that manipulates the guiding parameter, ω . This experiment aimed to examine the quality-diversity balance in trajectories generated by DiffTraj, and how this equilibrium responds to variations in ω . In this experimental setup, we studied the trajectories yielded under different ω settings (specifically ω ∈ 0 . 1 , 1 , 10 ) while keeping the conditional information the same.

The results, as illustrated in Fig. 7 and Fig. 8, reveal an unambiguous link between an increase in ω and a rise in trajectory diversity. This finding affirms that DiffTraj adeptly manages the balance between diversity and quality. As ω increases, the model demonstrates a tendency to spawn more varied trajectories. This is because a higher ω prompts the model to place more emphasis on unconditional noise prediction and reduce the sway of the conditional information. Thus, the model grows more proficient at creating diverse trajectories, albeit potentially compromising some quality. This greater diversity is a consequence of the model having fewer constraints from specific conditions, providing more latitude to explore a wider range of possible trajectories. This experiment underscores

the flexibility and control inherent in DiffTraj in balancing trajectory quality and diversity, vital characteristics for generating realistic and diverse trajectories. Therefore, ω serves as a control knob for modulating the trade-off between trajectory quality and diversity, providing a powerful tool for users to align the generated trajectories with specific application requirements.

2023/5/10 19:54

2023/5/10 19:54

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_VAE.html file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_MLP.html

D Visualization Results

We append a series of experimental results in this section due to space constraints. As shown in Fig. 9, we visualize the heat map of the trajectory distribution with multiple resolutions. Specifically, we divide the whole city into 32 × 32 , 16 × 16 , and 8 × 8 grids, and then count the distribution of trajectories in each grid. The comparison clearly indicates that the distributions are highly consistent from all resolutions. The visualized results also verify the effectiveness of metrics in Table 1, revealing that the proposed model can generate high-quality trajectories with remarkable accuracy and retain the original distribution.

104.06

104.09

30.68   30.70

Real

104.06

104.09

30.68  30.70

104.06

104.09

30.68  30.70

104.06

104.09

30.68   30.70

Generated

104.06

104.09

30.68  30.70

104.06

104.09

30.68  30.70

0.01

0.02

0.03

0.04

0.05

(a) Chengdu.

108.93

108.96

34.23  34.26

Real

108.93

108.96

34.23  34.26

108.93

108.96

34.23  34.26

108.93

108.96

34.23  34.26

Generated

108.93

108.96

34.23  34.26

108.93

108.96

34.23  34.26

0.01

0.02

0.03

0.04

0.05

0.06

(b) Xi'an.

In addition, we also show the geographic results of the trajectories generated by different generation methods for two cities, Chengdu and Xi'an. The visualization results are concluded in Fig. 10 and Fig. 11. Chengdu_Gen_VAE.html 2023/5/10 19:54 Chengdu_Gen_GAN.html 2023/5/10 19:54 Chengdu_Gen_Diffwave.html 2023/5/10 19:54 Chengdu_Gen_scat er.html

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(a) VAE

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_GAN.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(b) TrajGAN

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_Diffwave.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(c) Diffwave

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_scat er.html

(d) Diff-scatter

(e) Diff-wo/UNet

2023/5/10 19:54

Chengdu_Gen_Difflstm.html

(f) Diff-LSTM

2023/5/10 19:53

(g) Diff-Traj

2023/5/10 19:53

Chengdu_origin.html

(h) Real

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_Gen_Difflstm.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

file:/ /Users/yongchao/Downloads/nipsfig/Chengdu_origin.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

The rest visualize the forward trajectory addition noise process and reverse trajectory denoising process of Diff-Traj.

2023/5/10 20:02

2023/5/10 20:02

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_VAE.html file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_MLP.html

2023/5/10 20:02

Xian_Gen_GAN.html

2023/5/10 20:02

2023/5/10 20:01

Xian_Gen_scat er.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(a) VAE

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_GAN.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(b) TrajGAN

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_Diffwave.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_scat er.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(e) Diff-wo/UNet

2023/5/10 20:01

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_Difflstm.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(f) Diff-LSTM

2023/5/10 20:02

Xian_Gen_DiffTraj.html

file:/ /Users/yongchao/Downloads/nipsfig/Xian_Gen_DiffTraj.html

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

(g) Diff-Traj

2023/5/10 20:02

Xian_origin.html

file:/ /Users/yongchao/Downloads/nipsfig/Xian_origin.html

(h) Real

%

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

Leaflet (ht ps:/ leafletjs.com) | © OpenStreetMap (ht ps:/ www.openstreetmap.org/copyright) contributors © CARTO (ht ps:/ carto.com/at ributions)

1/1

Peer reviews:
{"IS_META_REVIEW": false, "comments": "SUMMARY:\nThe paper proposes DiffTraj: a trajectory generation model based on probabilistic diffusion. The model is trained using real spatio-temporal trajectory data, and aims to generate new trajectories with similar characteristics. This is motivated by the purpose of preserving privacy information that may be present in the actual data. Like all diffusion-based models, the proposed model has a forward and a reverse process, and the latter has an U-Net component, whose importance is highlighted in the ablation studies. Contextual information such as the starting time and location can be provided as input to the model in an encoded form, using a neural network trained on the actual dataset. The influence of this contextual information on the generated data can be controlled by a parameter. It is shown that the trajectories generated by DiffTraj are statistically more similar to the original ones (in two datasets) compared to other trajectory generation models. It is also shown that the trajectories generated by DiffTraj can be used instead of the original trajectories to train models for downstream tasks such as inflow and outflow predictions from particular blocks in the cities.\n\nSTRENGTHS:\n1) A new model DiffTraj is proposed for trajectory generation. It uses the currently popular probabilistic diffusion framework, but modifies it to bring in encoded contextual information, and an U-Net component in the reverse process to predict the noise levels for every next step\n2) Good generative performance is shown, where the trajectories generated by this approach are shown to be statistically more similar to the original ones compared to those generated by other methods\n3) The authors explore various practical uses of their model, such as downstream tasks (eg. inflow/outflow prediction), transfer learning (training model on one city and adapting it to another) etc\n\nWEAKNESSES:\n1) The model considers all trajectories as IID and does not aim to utilize any notion of \"trajectory clustering\" into their model. [In their defence, the encoded contextual information may carry such clues]\n2) The downstream task experiment is introduced almost as an afterthought, though such tasks seem to be the main motivation for the work. Also, these experiments seem to be incomplete [see questions below]\n3) The model includes U-Net as an important component for the reverse process, and its success is highlighted through ablation studies. But the exact role or contribution of the U-Net is not discussed\n4) The evaluation metrics used seem to be based mainly on spatial aspects, not temporal aspects\n\nOverall, I like the broad idea of the paper. I am willing to improve my ratings if the authors can address my concerns.\n\nQUESTIONS:\n1) I would expect the trajectories in any city to have \"clustering\" tendencies, some origins and destinations maybe \"hotspots\", some road segments (eg. highways) maybe \"hotspots\", etc. Similarly, there may be peak hours of trajectories. Or, certain types of trajectories may be more common in certain hours of the day (eg. those heading to downtown office areas during morning hours). Do you think DiffTraj can produce these features in their simulations?\n2) If not, is it possible to incorporate them into the model somehow?\n3) Can we have evaluation metrics based on time and velocity, instead of only space-based measures (trip error, length error etc)?\n4) In the downstream experiment, it is shown that various models perform almost equally when trained using the generated data instead of the actual data. But to really make the point, it should be shown that these models would have performed less well had they been trained with trajectories generated by some other baseline models\n5) What is the exact role played by the U-Net in the reverse process? Could any other architecture not have played the same role?\n6) If we want trajectories for a particular downstream task, can we get better results if we can use task-specific loss functions while training?\n7) What do the figures in Fig2 convey? Are they obtained by overlaying a set of trajectories?\n\nLIMITATIONS:\nNA", "TITLE": "Official Review", "RECOMMENDATION": 7, "REVIEWER_CONFIDENCE": 4, "SOUNDNESS_CORRECTNESS": 3, "DATE": "2023-06-20"}

{"IS_META_REVIEW": false, "comments": "SUMMARY:\nThe paper provides an innovative diffusion probabilistic-based model to simulate realistic GPS trajectories. The main contributions are as follows: 1) The paper introduces a diffusion-based probabilistic model that captures spatio-temporal dependencies in GPS trajectories. This model allows for personalized trajectory generation, considering individual preferences and behaviors. 2) The proposed approach generates personalized trajectories for individual users, enhancing the realism and accuracy of the generated trajectories compared to traditional methods. 3) By incorporating real-world GPS data, the generated trajectories closely resemble actual user movements, making them suitable for various location-based applications. 4) The paper demonstrates the scalability of the proposed method, enabling the generation of large-scale trajectory datasets efficiently. 5) The authors perform an extensive experiment of the proposed approach, comparing it with existing trajectory generation methods, showcasing its superiority in terms of trajectory realism and diversity.\n\nOverall, the paper presents a significant advancement in trajectory generation by introducing a diffusion probabilistic model and demonstrating its effectiveness in generating personalized and realistic GPS trajectories. The approach has the potential to impact various domains, including LBSs, transportation, and urban planning.\n\nSTRENGTHS:\n1.Generating realistic and personalized GPS trajectories has wide-ranging applications in various fields. The paper addresses this important problem and proposes a solution that has the potential to enhance applications such as LBSs, transportation, and urban planning. The diffusion probabilistic model offers a novel perspective and advances the state-of-the-art in trajectory modeling and generation.\n\n2.The proposed approach generates personalized trajectories, allowing for a more accurate representation of individual user movements. This customization increases the applicability of the method in various domains. The generated trajectories closely resemble actual user movements, exhibiting realistic patterns and behaviors. This realism enhances the reliability and usability of the trajectories for real-world applications.\n\n3.The authors present a well-designed study, including an extensive evaluation of their method using real-world datasets and appropriate statistical analysis. The experiments and comparisons with baseline methods demonstrate the robustness and effectiveness of their approach. The evaluation is thorough and includes relevant metrics, ensuring the validity and reliability of the presented results.\n\n4.The proposed approach demonstrates scalability and efficiency in handling large datasets. This characteristic makes it suitable for real-time applications, where processing speed and performance are crucial. The work presented in the paper has the potential to advance the field of trajectory generation, providing a valuable tool for generating context-aware GPS trajectories. The paper's contributions can benefit various domains that rely on precise GPS data for decision-making and analysis.\n\n5.The paper is well-written and organized, effectively conveying the methodology, experimental setup, and results. The logical flow and clear explanations contribute to the ease of understanding for readers.\n\nWEAKNESSES:\n1. Some details of experiment setup are not clearly provided, such as datasets, metrics, and baselines.\n\n2. While the paper provides detailed descriptions of the proposed method, the absence of an openly available implementation or codebase limits reproducibility and further exploration by the research community.\n\n3. It is better to discuss about the generality of the propose model. Can it be applied to other application domains?\n\nQUESTIONS:\n1. How does DiffTraj handle potential privacy concerns associated with generating realistic trajectories?\n2. Could you provide more details on the selection of baseline methods for comparison and why these specific methods were chosen? Are there any plans to release the implementation or codebase of the proposed method to facilitate replication and further research in trajectory generation?\n\nLIMITATIONS:\nThe availability and accessibility of the datasets used in the experiments should be clearly stated.", "TITLE": "Official Review", "RECOMMENDATION": 7, "REVIEWER_CONFIDENCE": 5, "SOUNDNESS_CORRECTNESS": 4, "DATE": "2023-07-03"}

{"IS_META_REVIEW": false, "comments": "SUMMARY:\nThe paper introduces a good approach for generating realistic GPS trajectories based on a diffusion probabilistic model. The paper addresses the challenge of generating personalized trajectories that capture both temporal and spatial dependencies while ensuring privacy preservation. \nThe paper proposes the DiffTraj framework, which combines a personalized transition matrix and a diffusion process to generate trajectories that closely resemble real-world GPS data. The personalized transition matrix captures the individual movement patterns of users, while the diffusion process introduces randomness and ensures diversity in the generated trajectories. Overall, the model is reasonable.\nThe paper presents a comprehensive evaluation of the DiffTraj framework using real-world datasets. The experimental results demonstrate that DiffTraj outperforms existing trajectory generation methods in various aspects. The proposed approach achieves high accuracy in replicating individual movement patterns while maintaining privacy by generating trajectories that deviate from the original data.\n\nSTRENGTHS:\n1 The paper introduces a unique approach to GPS trajectory generation by utilizing a diffusion probabilistic model, setting it apart from existing methods that may rely on different techniques or assumptions. The proposed diffusion probabilistic model captures both temporal and spatial dependencies, allowing for more accurate trajectory generation. This consideration enhances the realism and relevance of the generated trajectories. The diffusion probabilistic model captures both spatial and temporal dependencies, enabling the generation of trajectories that reflect the underlying dynamics of user movements.\n2 Incorporating user preferences into the trajectory generation process adds a personalized aspect, enhancing the relevance and usefulness of the generated trajectories for individual users. This feature contributes to the practicality and applicability of the proposed method. The generated trajectories exhibit high diversity, capturing the variability in user behaviors and preferences. This diversity expands the range of applications where the trajectories can be utilized.\n3 The paper provides a comprehensive comparison with baseline methods, showcasing the advantages of the proposed approach. The comparisons highlight the strengths and improvements of the diffusion probabilistic model for trajectory generation.  The authors provide sufficient details and code availability, enabling other researchers to reproduce the experiments and verify the results. This transparency contributes to the reliability and integrity of the presented work.\n4 The paper discusses potential applications of the proposed method beyond trajectory generation, such as urban planning, transportation analysis, and location-based services. This discussion broadens the scope of the paper and highlights its practical relevance.\n\nWEAKNESSES:\n1 The paper could provide more in-depth discussions on the assumptions made by the diffusion probabilistic model and their potential impact on the generated trajectories. Understanding these assumptions is crucial for interpreting and contextualizing the results.\n2 No clear instruction is provided on how the hyperparameters are selected for DiffTraj.\n\nQUESTIONS:\n1 How does the proposed diffusion probabilistic model capture both temporal and spatial dependencies in the trajectory generation process? \n2 Can you elaborate on the generalizability of your approach to different geographic areas and datasets? \n3 Can you explicitly state the limitations of your approach and discuss potential avenues for addressing them in future work? Acknowledging limitations and outlining future research directions would guide the community in further advancing trajectory generation methods.\n\nLIMITATIONS:\nThe generalizability of the approach to diverse scenarios and datasets could be a limitation that warrants further exploration.", "TITLE": "Official Review", "RECOMMENDATION": 8, "REVIEWER_CONFIDENCE": 4, "SOUNDNESS_CORRECTNESS": 3, "DATE": "2023-07-04"}

{"IS_META_REVIEW": false, "comments": "SUMMARY:\nThis paper adapts DDPM for trajectory generation within smart cities. The major contributions include the combination of different factors and the integration of some existing modules. The experiments over two real-world datasets can demonstrate the efficacy of the proposed model.\n\nSTRENGTHS:\n1. The paper is well-written and easy to follow. \n2. The paper addresses an essential and important task in spatio-temporal data mining.\n3. The experiments demonstrate the effectiveness of the proposed model over two real-world datasets.\n\nWEAKNESSES:\n1. Technical contribution is a bit weak. DDPM is popular in the era of AIGC. The paper adapts DDPM to trajectory generation but lacks novel or innovative designs. This drawback can be also seen in recent studies that borrow the idea of DDPMs to spatio-temporal data mining, e.g., DiffSTG [1]. By the way, this paper is very similar to DiffSTG, from model design to speed-up. \n2. The paper suggests that incorporating the influence of external factors is challenging, but this claim may not be entirely supported. To the best of my knowledge, existing models can easily handle such influence, e.g., conditional GAN. As the proposed model simply integrates these factors as a condition in DDPM, it is unclear why capturing external factors would pose a significant challenge. Additionally, the paper lacks an ablation study that examines the impact of these external factors on the proposed model's performance.\n3. To establish the generalizability of the proposed model, more real-world datasets from diverse applications and domains are needed. The exclusive use of datasets from DiDi in this paper limits the scope of the model's applicability and may not reflect its performance on other datasets.\n4. The paper omits some important related work, such as [1, 2, 3]. Furthermore, [3] and [4, 5] (included in the paper) should be used as baselines for comparison to provide a comprehensive evaluation of the proposed model's performance.\n\n\nRef:\n\n[1] Wen, Haomin, et al. \"Diffstg: Probabilistic spatio-temporal graph forecasting with denoising diffusion models.\" arXiv preprint arXiv:2301.13629 (2023).\n\n[2] Yuan, Yuan, et al. \"Spatio-temporal Diffusion Point Processes.\" arXiv preprint arXiv:2305.12403 (2023).\n\n[3] Feng, Jie, et al. \"Learning to simulate human mobility.\" Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining. 2020.\n\n[4] Liu, Xi, Hanzhou Chen, and Clio Andris. \"trajGANs: Using generative adversarial networks for geo-privacy protection of trajectory data (Vision paper).\" Location privacy and security workshop. 2018.\n\n[5] Zhang, Jing, et al. \"Dp-trajgan: A privacy-aware trajectory generation model with differential privacy.\" Future Generation Computer Systems 142 (2023): 25-40.\n\nQUESTIONS:\nPlease answer the questions in the weaknesses.\n\nLIMITATIONS:\nNo", "TITLE": "Official Review", "RECOMMENDATION": 4, "REVIEWER_CONFIDENCE": 4, "SOUNDNESS_CORRECTNESS": 3, "DATE": "2023-07-09"}