ANT: Adaptive Noise Schedule for Time Series Diffusion Models

Authors: seunghan  lee
kibok  lee
taeyoung  park
Venue: NeurIPS_cc_2024_Conference
Published: 2024-04-23 07:04:55

Abstract: Advances in diffusion models for generative artificial intelligence have recently propagated to the time series (TS) domain, demonstrating state-of-the-art performance on various tasks. However, prior works on TS diffusion models often borrow the framework of existing works proposed in other domains without considering the characteristics of TS data, leading to suboptimal performance. In this work, we
propose Adaptive Noise schedule for Time series diffusion models (ANT), which automatically predetermines proper noise schedules for given TS datasets based on their statistics representing non-stationarity. Our intuition is that an optimal noise schedule should satisfy the following desiderata: 1) It linearly reduces the non-stationarity of TS data so that all diffusion steps are equally meaningful, 2) the data is corrupted to the random noise at the final step, and 3) the number of steps is sufficiently large. The proposed method is practical for use in that it eliminates the necessity of finding the optimal noise schedule with a small additional cost to compute the statistics for given datasets, which can be done offline before training. We validate the effectiveness of our method across various tasks, including TS forecasting, refinement, and generation, on datasets from diverse domains. Code is available at this repository: https://github.com/seunghan96/ANT.

Main paper: 
 introduction: 
 Diffusion models have demonstrated outstanding performance in generative tasks across diverse domains, and various methods have been proposed in the time series (TS) domain to address a range of tasks, including forecasting, imputation, and generation [26, 34, 38, 18, 30, 1] . However, recent works primarily focus on determining which architecture to use for a diffusion model, overlooking the useful information from the domain knowledge for other components, e.g., noise schedule. Noise schedules control the noise added to the data across the diffusion process, with the choice of schedule being crucial for performance [4] . Several works have explored the design of noise schedules [24, 21] ; however, they do not consider the characteristics of data, resulting in suboptimal performance, especially in the TS domain. Figure 1 shows the forecasting performance of various models including our method applied to TSDiff [15] on the M4 dataset [23] . Among the various schedules, our method chooses a cosine schedule for the M4 dataset, yielding a 27.8% gain compared to a linear schedule of TSDiff, which is a common schedule across TS datasets. This highlights the importance of selecting an appropriate schedule for each dataset.In this work, we propose Adaptive Noise schedule for Time series diffusion models (ANT), a method for choosing an adaptive noise schedule based on the statistics representing non-stationarity of the TS dataset. These statistics measure the patterns appeared in the TS, with TS from the real world exhibiting high non-stationarity while white noise TS exhibiting low non-stationarity. We argue that a desirable schedule should gradually transform non-stationary TS into stationary ones, in line with prior research suggesting that the noise level at each step should remain consistent [24] . Furthermore, we opt for a schedule that corrupts the TS into random noise at the final step to align the training and inference stages [21] , and a schedule that has a sufficient number of diffusion steps to enhance sample quality [31] . Specifically, we discover that a schedule which decreases the non-stationarity of TS on a linear scale corrupts the TS into random noise gradually, making TS across steps more distinguishable, i.e., making each step equally meaningful. Figure 2a shows the forward process using two schedules: the base schedule of TSDiff (w/o ANT) and the schedule proposed by our method (w/ ANT) which aims to decrease the non-stationarity linearly. Additionally, we investigate the usefulness of diffusion step embedding (DE) in TS diffusion models and argue that it is not necessary when using a linear schedule, as the step information is inherent in the data. We also discover that a non-linear schedule is more robust to total diffusion steps (T ) compared to a linear schedule, yielding consistent performance across various resource constraints on T . The main contributions of this paper are summarized as follows:• We introduce ANT, an algorithm designed to select an appropriate noise schedule, which is 1) adaptive in that the schedule is selected based on the statistics of datasets, 2) flexible in that any noise schedule can be a candidate, 3) model-agnostic in that it only depends on the statistics of datasets, and 4) efficient in that no training is required, as the statistics can be precomputed offline. • We study the components of diffusion models regarding noise schedules, arguing that diffusion step embedding is unnecessary when using a linear schedule. Additionally, we find that a non-linear schedule exhibits greater robustness to the number of diffusion steps compared to a linear schedule. • We provide extensive experimental results across various datasets, demonstrating that our method outperforms the baseline in a range of tasks, including TS forecasting, refinement, and generation. 
background and related works: 
 Denoising diffusion probabilistic model (DDPM). DDPM [12] is a well-known diffusion model where input x 0 is corrupted to a Gaussian noise during the forward process and x 0 is denoised from x T during the backward process with total T diffusion steps. For the forward process, x t is corrupted from x t-1 iteratively with Gaussian noise of variance β t ∈ [0, 1] : q x t | x t-1 = N x t ; 1 -β t x t-1 , β t I , t = 1, . . . , T.Using a property of Gaussian transition kernel, the forward process of multiple steps can be written as q x t | x 0 = N x t ; √ ᾱt x 0 , (1 -ᾱt ) I , where ᾱt = Π t s=1 α s and α t = 1 -β t . For the backward process, x t-1 is denoised from x t by sampling from the following distribution:EQUATIONwhere µ θ (x t , t) is defined by a neural network and Σ θ (x t , t) is usually fixed as σ 2 t I. DDPM formulates this task as a noise estimation problem, where ε θ predicts the noise added to x t . With the predicted noise ε θ (x t , t), µ θ (x t , t) can be obtained byEQUATIONand ε θ is optimized using L ε = E t,x 0 ,ε ∥ε -ε θ (x t , t)∥ 2 as a training objective.Unconditional TS diffusion models. Unlike most TS diffusion models which are conditional models [26, 38, 18, 30, 1, 6, 29, 40, 19] , unconditional TS diffusion models do not use conditions (i.e. information of the observed values x 0 obs ) as explicit inputs during the training stage. Instead, they utilize them as guidance during the inference stage through a self-guidance mechanism. The backward process of unconditional models with the self-guidance term can be expressed asEQUATION)where s is the scale parameter controlling the self-guidance term. As the self-guidance mechanism helps avoid the need for architectural changes depending on the condition or task, we apply our method to TSDiff [15] , which is the SOTA unconditional TS diffusion model. However, our method is not limited to the unconditional model; application to a conditional model, such as CSDI [34] , is also discussed in Appendix M. Noise schedules for diffusion models. The choice of the noise schedule is crucial for the performance of diffusion models [4] , and various methods have been proposed in the computer vision domain [12, 32, 13] , including a cosine schedule [24] to maintain the noise level at each step consistent, and rescaling method [21] to achieve zero signal-to-noise ratio (SNR) at the terminal step to address the misalignment between the training and inference stages. However, these methods are handcrafted for each dataset, without considering the characteristics of TS datasets. Moreover, recent TS diffusion models overlook the importance of noise schedules, treating them merely as hyperparameters, which motivates us to develop a noise schedule specifically tailored for TS datasets using their characteristics.Non-stationarity of TS. The non-stationarity of a TS indicates how different it is from white noise, and various statistics using autocorrelation (AC) exist to assess this. Integrated autocorrelation time (IAT) [22] , defined as τ IAT = 1 + 2 ∞ k=1 ρ k where ρ k is AC at lag k, quantifies AC over different lags. Additionally, lag-one autocorrelation (Lag1AC) quantifies AC between adjacent observations, and variance of autocorrelation (VarAC) measures the variance of AC over different lags [37] . These statistics, which capture the noisiness of TS, inform the speed at which the TS collapses into noise during the diffusion process. In this paper, we propose a new statistic based on IAT that captures the non-stationarity of TS, accounting for both positive and negative AC.Question: Does the paper discuss the limitations of the work performed by the authors? Answer: [Yes] Justification: The paper discuss the limitations of the work. Guidelines:• The answer NA means that the paper has no limitation while the answer No means that the paper has limitations, but those are not discussed in the paper. • The authors are encouraged to create a separate "Limitations" section in their paper.• The paper should point out any strong assumptions and how robust the results are to violations of these assumptions (e.g., independence assumptions, noiseless settings, model well-specification, asymptotic approximations only holding locally). The authors should reflect on how these assumptions might be violated in practice and what the implications would be. • The authors should reflect on the scope of the claims made, e.g., if the approach was only tested on a few datasets or with a few runs. In general, empirical results often depend on implicit assumptions, which should be articulated. • The authors should reflect on the factors that influence the performance of the approach.For example, a facial recognition algorithm may perform poorly when image resolution is low or images are taken in low lighting. Or a speech-to-text system might not be used reliably to provide closed captions for online lectures because it fails to handle technical jargon. • The authors should discuss the computational efficiency of the proposed algorithms and how they scale with dataset size. • If applicable, the authors should discuss possible limitations of their approach to address problems of privacy and fairness. • While the authors might fear that complete honesty about limitations might be used by reviewers as grounds for rejection, a worse outcome might be that reviewers discover limitations that aren't acknowledged in the paper. The authors should use their best judgment and recognize that individual actions in favor of transparency play an important role in developing norms that preserve the integrity of the community. Reviewers will be specifically instructed to not penalize honesty concerning limitations. 
methodology: 
 In this section, we introduce our main contribution, ANT, an adaptive noise schedule for TS diffusion models. ANT proposes a noise schedule resembling an ideal one that gradually diminishes the non-stationarity of TS as the diffusion step progresses. Subsequently, we investigate the properties of commonly used noise schedules and argue that: 1) The diffusion step embedding (DE) is unnecessary for TS diffusion models when a linear schedule is employed, and 2) non-linear schedules are more robust to the change of the number of diffusion steps than linear schedules in terms of the performance and the scale parameter of the self-guidance mechanism of unconditional diffusion models.The overall framework of ANT is illustrated in Figure 2 , where we aim to find a noise schedule that decreases the non-stationarity of TS on a linear scale. Figure 2a shows how the non-stationarity of a TS gradually decreases with ANT, while it decreases abruptly without ANT. This difference can be explained by computing the non-stationarity curve of a TS for a given noise schedule as shown in Figure 2b . ANT proposes a noise schedule that minimizes the discrepancy between the ideal linear line and the non-stationarity curve of the schedule, whose x-axis and y-axis represent the progress of the step (%) and the (normalized) statistics of non-stationarity, respectively. As illustrated in Figure 2c , reduction in discrepancy with ANT yields better performance compared to without ANT. Statistics of non-stationarity. While various statistics can be used to quantify the non-stationarity of TS, we propose the integrated absolute autocorrelation time (IAAT). IAAT is a variation of IAT [22] that takes the absolute value of the autocorrelation to account for positive and negative correlations without canceling them out:τ IAAT = 1 + 2 ∞ k=1 |ρ k |.Although IAAT shows the best performance, we note that ANT is robust across different statistics as shown in Table 8 . Adaptive schedule. Figure 3 illustrates the non-stationarity curves of various schedules for two datasets [17] , with line width indicating total diffusion steps. The figure reveals that different schedules yield different shapes of curves, and that the same schedule may yield different curve shapes per dataset, highlighting the importance of selecting an adaptive schedule for each dataset. ANT score. To select an adaptive noise schedule for each dataset, ANT takes a dataset D and a schedule s as inputs and returns the ANT score that measures how well s works on D, with a lower score indicating a better schedule. The key component of the score is the discrepancy between a linear line l ⋆ and the non-stationarity curve l s , which is normalized to the range [0, 1] to account for potential differences in scales across statistics and datasets. On top of that, as shown in Figure 4 , ANT considers two other desiderata of noise schedules: 1) Noise collapse: A noise schedule should corrupt data to random noise at the final step of the forward process to align the training and inference stages [21] . 2) Sufficient # of steps: A noise schedule should have a sufficiently large T , as increasing it generally improves sample quality [31] . To meet the desiderata, ANT opts for a schedule with relatively low non-stationarity at the final step l (T ) s than the first step l(1)s , and a large T . Then, given D and s, the ANT score is defined as:EQUATION)where λ linear = d(l ⋆ , ls ),EQUATIONs , and λ step = 1 + 1/T are the terms considering linear reduction of non-stationarity, noise collapse, and sufficient steps, respectively, and d is a discrepancy metric between the two lines. Among various metrics, we use the difference in the area under the curve (AUC) using the trapezoidal rule, as it empirically performs the best in our experiments. However, we note that ANT is robust across different metrics d, as shown in Table 9 . The pseudocode for calculating the ANT score is described in Appendix E.Diffusion models take the t-th step data (x t ) and the step number t as inputs, where t is typically encoded in a DE. However, we argue that DE is not necessary for TS diffusion models employing a linear schedule, because information about the step is inherent in the data. To validate our claim, we conduct two experiments: 1) A proxy classification task to predict t with x t , and 2) visualization of the embeddings of x t with various t. Proxy classification. We design a proxy classification task that identifies the step number in the forward diffusion pass given a noisy TS. For the task, we sample multiple subseries from M4 [23] , each with varying steps of up to 100 steps. We build a 1D convolutional neural network (CNN) classifier with the architecture of [Conv1D -ReLU -Flatten -Linear], where Conv1D has the kernel size of 3 and 4 output channels. Figure 5a shows the results in confusion matrices, indicating that a TS corrupted using a linear schedule retains step information (high accuracy), whereas a TS corrupted using a non-linear schedule does not (low accuracy), making DE redundant for a model employing a linear schedule. We argue that this is due to the variance of noise for each step (β t ), as a non-linear schedule adds most of the noise at the end of the steps, making a TS less distinguishable for most of the steps. In contrast, a linear schedule that gradually increases β t makes a TS more distinguishable across steps, allowing us to eliminate the DE in the model. The results show directional point movement across all output channels as the step progresses, implying that diffusion step information is inherently present in the TS. As discussed in Appendix P, t-SNE visualizations employing a non-linear schedule also show directional point movement but with a common pattern across all output channels, indicating limited step information compared to a linear schedule. Based on these observations, we remove the DE from the diffusion models when employing a linear schedule. In experiments, we observe that DE is useful for models with non-linear schedules, but not for models with linear schedules, as shown in Table 6 .In diffusion models, the number of steps T determines the efficiency of overall process and sample quality. We argue that non-linear schedules are more robust to T than linear schedules in two aspects: 1) performance and 2) the optimal scale parameter s controlling the self-guidance in Eq. ( 4).Robustness of performance to T . Figure 6a depicts the coefficient of variation of continuous ranked probability score (CRPS) [9] of forecasting task with various T , illustrating that the performance is robust to T when employing a non-linear schedule. This is supported by Figure 6b , which shows the non-stationarity curves of various schedules, with each color representing a different dataset. The figure indicates that the shape of the curve, which determines the ANT score, remains consistent regardless of T when employing a non-linear schedule. It is important to note that the ANT score is highly correlated with the performance, as discussed in Section 4.4. Robustness of optimal s to T . Figure 7a shows that the optimal s is sensitive to T when employing linear schedules, whereas robust when using non-linear schedules. We discover that this robustness stems from the posterior variance (σ 2 t ) of a schedule, which affects the self-guidance term in Eq. ( 4). Figure 7b illustrates the sum of the posterior variances ( T t=1 σ 2 t ) of various schedules, indicating that this sum is more robust to the choice of T for non-linear schedules compared to linear schedules.Question: For each theoretical result, does the paper provide the full set of assumptions and a complete (and correct) proof? Answer: [Yes] Justification: The paper provides the full set of assumptions. Guidelines:• The answer NA means that the paper does not include theoretical results.• All the theorems, formulas, and proofs in the paper should be numbered and crossreferenced. • All assumptions should be clearly stated or referenced in the statement of any theorems.• The proofs can either appear in the main paper or the supplemental material, but if they appear in the supplemental material, the authors are encouraged to provide a short proof sketch to provide intuition. • Inversely, any informal proof provided in the core of the paper should be complemented by formal proofs provided in appendix or supplemental material. • Theorems and Lemmas that the proof relies upon should be properly referenced. 
experiments: 
 Experimental setup. We demonstrate the effectiveness of our proposed method on three tasks: TS forecasting, refinement, and generation. For evaluation, we adopt ANT to TSDiff [15] , where we use the official code to replicate the results. All experimental protocols adhere to that of TSDiff, where we utilize the CRPS [9] to assess the quality of probabilistic forecasts. We conduct experiments on eight TS datasets from different domains -Solar [17] , Electricity [3] , Traffic [3] , Exchange [17] , M4 [23] , UberTLC [7] , KDDCup [10] , and Wikipedia [8] . We present the mean and standard deviations calculated from three independent trials. Noise schedules. ANT finds the best schedule for a given dataset from candidate schedules based on the ANT score. Table 1 shows candidate schedules that we use for our experiments based on the three components: noise function (f ), temperature (τ ), and the number of diffusion steps (T ). We denote f (T ) for a linear schedule and f (T, τ ) for a non-linear schedule. Note that TSDiff [15] employs Lin(100) as a common schedule for all datasets, following TimeGrad [26] .For baseline methods in forecasting tasks, we compare our method with various approaches, including DeepAR [28] , MQ-CNN [36] , DeepState [25] , Transformer [35] , TFT [20] , CSDI [34] , and TSDiff [15] . We note that we do not aim to outperform all SOTA methods, but rather to demonstrate the efficacy of our proposed adaptive noise schedules when applied within the framework of TS diffusion models. Nonetheless, Table 2a indicates that TSDiff employing the noise schedule proposed by our method achieves the best performance on all datasets. To show the effectiveness of our method across various prediction horizons, we conduct an experiment with different horizons using the same input window. Specifically, we multiply α by the standard horizon H used in Table 2a , where the range of α depends on the sequence length of the dataset. Table 2b shows that ANT enhances TSDiff with variable prediction lengths.We conduct an experiment refining the forecasting results of other base forecasters to evaluate the quality of the implicit probability density of TSDiff applied with ANT. For the experiment, we employ Gaussian (MS) and asymmetric Laplace negative log-likelihoods (Q) as regularizers for both energy (LMC) and maximum likelihood (ML)-based refinement, following TSDiff. Table 3 displays the results using a linear model as the base forecaster, showing that TSDiff, when applied with our method, yields performance gains across all datasets and refinement methods. To assess the generation quality of TS diffusion models with ANT, we evaluate the forecasting performance of downstream forecasters trained on the synthetic samples generated by various models. For the baseline methods, we employ TimeGAN [39] , TimeVAE [5] , and TSDiff [15] . For the downstream models, we employ a simple linear (ridge) regression model, DeepAR [28] , and Transformer [35] . The results are shown in Table 4 , indicating that ANT improves the performance of TSDiff, leading to SOTA performance in most cases. Further details regarding the generation task with Electricity are discussed in Section O.Proposed noise schedule. Table 5 shows the schedules proposed by ANT and the schedules that yield the best performance (oracle) among all candidate schedules, along with the forecasting performance obtained when using these schedules. The result indicates that the schedules selected by ANT are mostly consistent with the oracle, and even for an exceptional case that ANT fails to select the best schedule, e.g., on Traffic, the performance gap from the oracle is not significant. Ablation study. To show the effectiveness of each component in ANT, we conduct an ablation study in Table 7 .The result demonstrates that enforcing the schedule to gradually drop the non-stationarity is the most important component (λ linear ), and ensuring noise collapse (λ noise ) and sufficient steps (λ step ) also help ANT achieve oracle for three datasets [23, 17, 3] when combined together. Figure 8 shows the correlation between the ANT score and CRPS on forcasting tasks via a scatter plot of candidate schedules and a bar plot of schedules selected in Table 7 , implying that there is a strong correlation between the ANT score and CRPS, and the components in ANT strengthen the correlation further. Robustness to statistics. To see if ANT is sensitive to the choice of statistics of non-stationarity, we compare IAAT with other statistics including Lag1AC and VarAC. Table 8 shows the average CRPS across eight datasets in forecasting tasks, demonstrating that ANT with different statistics still outperforms the model without ANT, while IAAT performs best. We conjecture that this is because IAAT considers AC at all time lags, whereas Lag1AC only considers a single lag and VarAC focuses on the variance of AC rather than their exact values. Robustness to d. Among the various metrics that can be employed for d to measure the discrepancy between the two lines, we compare AUC with the mean-squared error (MSE), mean-absolute error (MAE), Pearson correlation (Corr.), and R-squared (R 2 ). Table 9 presents the average CRPS of eight datasets on the forecasting task, demonstrating the robustness of our method to the choice of metric. Generation process. Figure 9 illustrates the generation process of a TSDiff model trained on M4 with and without ANT, where the color changes from black to red as the step progresses. The figure on the left shows the generated TS for each step, while the one on the right shows the non-stationarity of each step in terms of IAAT. As shown in Figure 9 , ANT indeed makes the generation process linearly increase the non-stationarity. Effect of T on performance. While it was believed that the larger the T , the better the performance in diffusion models [31] , we argue that this is not always true in the TS domain. Table 10 shows the oracle performance for each T among candidate schedules on forecasting tasks, indicating that the best performance is not always achieved with the largest T , e.g., the best performance is achieved with T = 20 on UberTLC [7] . Furthermore, as shown in Figure 10 , ANT often outperforms the baseline method TSDiff with smaller T , achieving the oracle performance in most cases. Efficiency of ANT. ANT offers efficiency in two aspects: 1) Statistics of non-stationarity can be precomputed offline with a small additional cost, and 2) the proposed schedule with T smaller than that of the base schedule results in faster inference. First, Table 11a displays the time spent calculating IAAT using the entire train dataset of Traffic [3] with schedules of five different values for T . The results indicate that the computational cost is negligible compared to the training time shown in Furthermore, ANT offers a performance-computational cost trade-off in that it can be optimized with a constraint on T by selecting a schedule among candidates with T no larger than T * (T ≤ T * ).Table 11c shows the forecasting results with a constraint of T * = 50, achieving better performance with no more than half of the steps of the base schedule. Further analyses regarding computational time and forecasting results under constraints on T are discussed in Appendix N and J, respectively. Flexibility of ANT. As ANT does not require direct access to the noise schedule but the TS data corrupted by the schedule, any noise schedule can be a candidate. To confirm if ANT can judge the usefulness of non-trivial noise schedules other than the functions described in Table 1 , we experiment an ensemble of cosine functions (Cos * ), illustrated in Figure 11 . Table 12 shows the results on two datasets [7, 3] that achieve lower ANT scores with Cos * , indicating the potential for a better schedule to be selected by relaxing structural constraints, or even without any functional form f .Avg.Linear 0.166 Cos [24] 0.160 Zero [21] Comparison with other schedules. To demonstrate the effectiveness of ANT compared to noise schedules from other domains, we compare ANT with a cosine schedule (Cos) [24] and a schedule that enforces zero terminal SNR (Zero) [21] , applied to TSDiff. Table 13 shows the average CRPS across eight datasets on forecasting tasks, where ANT outperforms the others. The results highlight the importance of a schedule being adaptive to the given TS dataset and considering the corruption speed.Question: Does the paper fully disclose all the information needed to reproduce the main experimental results of the paper to the extent that it affects the main claims and/or conclusions of the paper (regardless of whether the code and data are provided or not)? Answer: [Yes] Justification: The paper fully disclose all the information needed to reproduce the main experimental results. Guidelines:• The answer NA means that the paper does not include experiments.• If the paper includes experiments, a No answer to this question will not be perceived well by the reviewers: Making the paper reproducible is important, regardless of whether the code and data are provided or not. • If the contribution is a dataset and/or model, the authors should describe the steps taken to make their results reproducible or verifiable. • Depending on the contribution, reproducibility can be accomplished in various ways.For example, if the contribution is a novel architecture, describing the architecture fully might suffice, or if the contribution is a specific model and empirical evaluation, it may be necessary to either make it possible for others to replicate the model with the same dataset, or provide access to the model. In general. releasing code and data is often one good way to accomplish this, but reproducibility can also be provided via detailed instructions for how to replicate the results, access to a hosted model (e.g., in the case of a large language model), releasing of a model checkpoint, or other means that are appropriate to the research performed. • While NeurIPS does not require releasing code, the conference does require all submissions to provide some reasonable avenue for reproducibility, which may depend on the nature of the contribution. , with an open-source dataset or instructions for how to construct the dataset). (d) We recognize that reproducibility may be tricky in some cases, in which case authors are welcome to describe the particular way they provide for reproducibility. In the case of closed-source models, it may be that access to the model is limited in some way (e.g., to registered users), but it should be possible for other researchers to have some path to reproducing or verifying the results. • Providing as much information as possible in supplemental material (appended to the paper) is recommended, but including URLs to data and code is permitted. 
conclusion: 
 In this work, we introduce ANT, a method designed to select an adaptive noise schedule for TS diffusion models using the statistics of non-stationarity. ANT is practical in that it predetermines a noise schedule before training, as the statistics can be precomputed offline with minimal additional cost. The proposed ANT is a simple yet effective method for TS diffusion models across various tasks, e.g., ANT improves the SOTA method TSDiff by 9.5% on average across eight forecasting tasks, highlighting the importance of adaptive schedules tailored to the characteristics of TS datasets.Limitations and future work. We note that our contribution is not in finding the optimal schedule but in proposing a criterion for efficiently selecting a better noise schedule from a set of candidates based on the dataset characteristics. While our experiments search for an appropriate schedule from 35 candidates derived from linear, cosine, and sigmoid functions, any schedule can be considered a candidate for ANT, and incorporating additional schedules could lead to further performance gains at the expense of longer search times. We leave developing algorithms to determine the optimal schedule parameters based on our proposed criterion for future work. We hope that our research motivates further research across various domains to incorporate domain knowledge in the design of machine learning models, extending beyond noise schedules for diffusion models. 
experimental setting/details: 
 Question: Does the paper specify all the training and test details (e.g., data splits, hyperparameters, how they were chosen, type of optimizer, etc.) necessary to understand the results?Answer: [Yes]Justification: The paper specify all the training and test details.Guidelines:• The answer NA means that the paper does not include experiments.• The experimental setting should be presented in the core of the paper to a level of detail that is necessary to appreciate the results and make sense of them. • The full details can be provided either with the code, in appendix, or as supplemental material. 
experiment statistical significance: 
 Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?Answer: [Yes]Justification: The paper reports standard deviations of the results.Guidelines:• The answer NA means that the paper does not include experiments.• The authors should answer "Yes" if the results are accompanied by error bars, confidence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper. • The factors of variability that the error bars are capturing should be clearly stated (for example, train/test split, initialization, random drawing of some parameter, or overall run with given experimental conditions). • The method for calculating the error bars should be explained (closed form formula, call to a library function, bootstrap, etc.) • The assumptions made should be given (e.g., Normally distributed errors).• It should be clear whether the error bar is the standard deviation or the standard error of the mean. • It is OK to report 1-sigma error bars, but one should state it. The authors should preferably report a 2-sigma error bar than state that they have a 96% CI, if the hypothesis of Normality of errors is not verified. • For asymmetric distributions, the authors should be careful not to show in tables or figures symmetric error bars that would yield results that are out of range (e.g. negative error rates). • If error bars are reported in tables or plots, The authors should explain in the text how they were calculated and reference the corresponding figures or tables in the text. 
experiments compute resources: 
 Question: For each experiment, does the paper provide sufficient information on the computer resources (type of compute workers, memory, time of execution) needed to reproduce the experiments?Answer: [Yes]Justification: The paper provides sufficient information on the computer resources, including computational time.Guidelines:• The answer NA means that the paper does not include experiments.• The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage. • The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute. • The paper should disclose whether the full research project required more compute than the experiments reported in the paper (e.g., preliminary or failed experiments that didn't make it into the paper). 
code of ethics: 
 Question: Does the research conducted in the paper conform, in every respect, with the NeurIPS Code of Ethics https://neurips.cc/public/EthicsGuidelines? 
broader impacts: 
 Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?Answer: [Yes] Justification: The proposed method for selecting an adaptive noise schedule for time series diffusion models has the potential to significantly impact the field of diffusion models across various domains, including time series. The ability to utilize the characteristics of datasets for noise schedules is promising, as different statistics can be employed depending on the domain. To ensure responsible use of the algorithm, we make the datasets and code publicly available at https://github.com/seunghan96/ANT. Public availability ensures transparency and reproducibility, enabling other researchers to evaluate and address potential biases and misuse.Guidelines:• The answer NA means that there is no societal impact of the work performed.• If the authors answer NA or No, they should explain why their work has no societal impact or why the paper does not address societal impact. • Examples of negative societal impacts include potential malicious or unintended uses (e.g., disinformation, generating fake profiles, surveillance), fairness considerations (e.g., deployment of technologies that could make decisions that unfairly impact specific groups), privacy considerations, and security considerations. • The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments. However, if there is a direct path to any negative applications, the authors should point it out. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate deepfakes for disinformation. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster. • The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from (intentional or unintentional) misuse of the technology. • If there are negative societal impacts, the authors could also discuss possible mitigation strategies (e.g., gated release of models, providing defenses in addition to attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML). 
safeguards: 
 Question: Does the paper describe safeguards that have been put in place for responsible release of data or models that have a high risk for misuse (e.g., pretrained language models, image generators, or scraped datasets)?Answer: [NA] Justification: The research does not contain any data or models that have a high risk for misuse.Guidelines:• The answer NA means that the paper poses no such risks.• Released models that have a high risk for misuse or dual-use should be released with necessary safeguards to allow for controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters. • Datasets that have been scraped from the Internet could pose safety risks. The authors should describe how they avoided releasing unsafe images. • We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make a best faith effort.12. Licenses for existing assets Question: Are the creators or original owners of assets (e.g., code, data, models), used in the paper, properly credited and are the license and terms of use explicitly mentioned and properly respected?Answer: [Yes] Justification: The creators or original owners of assets (e.g., code, data, models) used in the paper are properly credited.Guidelines:• The answer NA means that the paper does not use existing assets.• The authors should cite the original paper that produced the code package or dataset.• The authors should state which version of the asset is used and, if possible, include a URL. • The name of the license (e.g., CC-BY 4.0) should be included for each asset.• For scraped data from a particular source (e.g., website), the copyright and terms of service of that source should be provided. • If assets are released, the license, copyright information, and terms of use in the package should be provided. For popular datasets, paperswithcode.com/datasets has curated licenses for some datasets. Their licensing guide can help determine the license of a dataset. • For existing datasets that are re-packaged, both the original license and the license of the derived asset (if it has changed) should be provided. • If this information is not available online, the authors are encouraged to reach out to the asset's creators. 
new assets: 
 Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?Answer: [Yes] Justification: The new assets introduced in the paper are well documented.Guidelines:• The answer NA means that the paper does not release new assets.• Researchers should communicate the details of the dataset/code/model as part of their submissions via structured templates. This includes details about training, license, limitations, etc. • The paper should discuss whether and how consent was obtained from people whose asset is used. • At submission time, remember to anonymize your assets (if applicable). You can either create an anonymized URL or include an anonymized zip file. 
crowdsourcing and research with human subjects: 
 Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation (if any)? 
institutional review board (irb) approvals or equivalent for research with human subjects: 
 Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board (IRB) approvals (or an equivalent approval/review based on the requirements of your country or institution) were obtained?Answer: [NA]Justification: The paper does not contain any potential risks incurred by study participants.Guidelines:• The answer NA means that the paper does not involve crowdsourcing nor research with human subjects.• Depending on the country in which research is conducted, IRB approval (or equivalent) may be required for any human subjects research. If you obtained IRB approval, you should clearly state this in the paper. • We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution. • For initial submissions, do not include any information that would break anonymity (if applicable), such as the institution conducting the review. 
 
 Appendix: In our experiments, we employ eight widely-used univariate datasets from various fields which can be found in GluonTS [2] in their preprocessed form, with training and test splits provided. Following TSDiff [15] , the validation set is created by splitting a portion of the training dataset, with the split ratio determined by the sizes of the training and test datasets. Table A .1 shows the statistics of the dataset, annotated with their corresponding frequencies (daily or hourly) and lengths of predictions.For the daily datasets, the sequence lengths are set at 390, roughly equivalent to 13 months. For the hourly datasets, we utilize sequence lengths of 360, corresponding to 15 days. These sequences are created by randomly slicing the original time series at various time steps. Below, we provide a brief description of each dataset.• Solar [17] : This dataset contains data on solar power production in 2006 from 137 solar power plants located in Alabama. 2 • Electricity [17, 3] : This dataset includes electricity consumption data from 370 customers. 3 • Traffic [17, 3] : This dataset features hourly occupancy rates on the freeways in the San Francisco Bay area from 2015 to 2016. 4 • Exchange [17] : This data is comprised of daily exchange rates from eight countries-Australia, the UK, Canada, Switzerland, China, Japan, New Zealand, and Singapore-from 1990 to 2016. 5 • M4 [23] : This is an hourly data subset derived from the M4 forecasting competition. 6 • UberTLC [7] : This dataset includes data on Uber pickups in NYC from January to June 2015, collected by the NYC Taxi & Limousine Commission. Metrics. Following TSDiff, we employ the Continuous Ranked Probability Score (CRPS) as our evaluation metric. It is defined by the integral of the pinball loss over the interval from 0 to 1:CRPS(F -1 , y) = 1 0 2Λ κ (F -1 (κ), y)dκ, (B.1)where Λ κ (q, y) = (κ -1 y<q )(y -q) denotes the pinball loss for a given quantile level κ, F -1 denotes the predicted inverse cumulative distribution function, and y denotes the observed value.Since the quantile function is not analytically accessible in practice, it is approximated using discrete quantile levels derived from sample forecasts. For the experiment, we utilize the CRPS implementation in GluonTS [2] , which uses 100 sample forecasts to calculate nine predefined quantile levels {0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9}. Hyperparameters. Table B .1 presents the hyperparameters of the backbone model utilized in our experiment, which are aligned with those used in TSDiff. Note that the diffusion step embeddings [35] are only applied to the model employing a non-linear schedule. Moreover, we employ skip connections for certain datasets, following the TSDiff approach, which results in improvements in validation performance. For the normalization method, we employ the mean scaler from GluonTS [2] , which normalizes each TS by dividing it by the mean of the absolute values of its observations. The scale parameter s which controls the self-guidance term is searched over the form 2 α where α ranges through the set [- For the baseline methods in TS forecasting and generation tasks, we adhere to the methods outlined in TSDiff [15] .• DeepAR [28] is a probabilistic forecasting method that outputs the parameters for distributions, optimized with the (conditional) log-likelihood. The model employs an RNN-based autoregressive framework that leverages past lags and external features to predict future values. • DeepState [25] integrates RNNs with linear dynamical systems (LDS), where the LDS parameters, such as transition and emission matrices, are predefined to reflect trend and seasonality of TS. The parameters of LDS and RNN are simultaneously optimized using maximum likelihood estimation. • Transformer utilizes a self-attention mechanism [35] for sequence-to-sequence forecasting, employing TS lags and additional covariates to predict future distribution parameters. • TFT [20] is a Transformer-based forecasting method that incorporates that employs a variable selection mechanism to filter out irrelevant features while training on quantile loss. • CSDI [34] is a conditional diffusion model that adapts the DiffWave framework [16] to multivariate TS forecasting and imputation, incorporating transformer layers into its architecture. • TSDiff [15] is unconditional diffusion model that utilizes a self-guidance mechanism, that leverages conditioning information during the inference stage with an unconditional network, without requiring additional architectural changes.• TimeVAE utilizes variational autoencoders [14] , with its architecture tailored for TS analysis to handle trends and seasonality in TS. • TimeGAN utilizes an autoencoder framework to train a generative adversarial network (GAN) [11] in the latent space, which is optimized with a composite loss function that integrates supervised, unsupervised, and discriminative losses.The goal of TS prediction tasks is to predict x 0 miss ∈ R d×H given x 0 obs ∈ R d×L , where d, H, L are the number of variables, the length of the target window, and the length of the input window, respectively. Most of TS diffusion models for prediction tasks are conditional models [26, 38, 18, 30, 1, 6, 29, 40, 19] , employing a conditioning network F to construct a condition c using x 0 obs , which contains the information of the observed values used to predict the unobserved values. The distribution for conditional TS diffusion models is formulated asp θ x 0:T miss | c = p θ x T miss T t=1 p θ x t-1 miss | x t miss , c , (D.1)where c = F x 0 obs and x T miss ∼ N (0, I). The corresponding backward process can be expressed as x 0 i := x i 3:p θ x t-1 miss | x t miss , c = N x t-1 miss ; µ θ x t miss , t | c ,for t = 1 to T do 4:Add noise:x t i ∼ q x t i | x t-1 i based on s 5:Calculate non-stationarity:g t i = G(x t i ),where G is a non-stationarity metric 6:end for 7: end for 8: Define non-stationarity curve:l s = [l (1) s , • • • , l (T )s ], where l TSDiff offers a strategy to improve predictions from base forecasters, adaptable to any type of base forecaster as it only requires their initial outputs. These initial forecasts are iteratively enhanced through an implicit density learned by the diffusion model, which acts as a prior. The refinement process can be conducted using one of two methods: (a) sampling from an energy function (LMC), or (b) maximizing the likelihood to determine the most probable sequence (ML). Furthermore, the approach includes an option between two types of regularizers: (a) Gaussian (MS) and (b) Laplace negative log-likelihoods (Q). Energy based sampling (LMC). LMC improves the initial forecast of a given base forecaster g, by framing the refinement as a task of sampling from a regularized energy-based model (EBM). This can be expressed as E θ (y; ỹ) = -log p θ (y) + λR(y, ỹ), (F.1) where ỹ represents the time series formed by combining y obs with g(y obs ), R denotes a regularizer, and λ is a Lagrange multiplier controlling the strength of regularization. To sample from the specified EBM, overdamped Langevin Monte Carlo (LMC) [33] is used, with y (0) initialized to ỹ. The iterative refinement process is outlined as follows:y (i+1) = y (i) -η∇ y (i) E θ y (i) ; ỹ + 2ηγξ i where ξ i ∼ N (0, I), (F.2)where η represents the step size, and γ is the noise scale.Maximizing the likelihood (ML). The refinement procedure can alternatively be viewed as a regularized optimization problem aimed at identifying the most probable TS while adhering to specific constraints on the observed time steps. Formally, this is expressed asarg min y [-log p θ (y) + λR(y, ỹ)] , (F.3)which can be optimized using gradient descent.Integrated autocorrelation time (IAT) [22] . Integrated autocorrelation time (IAT) quantifies the efficiency of an MCMC sampler by estimating the effective number of independent samples produced by the sampler through calculating the autocorrelation (AC) within a chain. A sampler with a lower IAT is considered more efficient. Additionally, IAT can be used to diagnose the level of noise in a TS, as a TS with higher noise levels will exhibit smaller AC in their absolute values. The IAT and its absolute version (IAAT) are defined asτ IAT = 1 + 2 ∞ k=1 ρ k , τ IAAT = 1 + 2 ∞ k=1 |ρ k |, (G.1)respectively, where ρ k is an AC at lag k. Note that this computation needs to be truncated at a practical lag where the ACF values are essentially zero.Lag-one autocorrelation (LagAC) [37] . LagAC (ρ 1 ) is a measure of AC that quantifies the correlation between adjacent observations in a TS, which is defined asρ 1 = n-1 t=1 (x t -x)(x t+1 -x) n t=1 (x t -x) 2 , (G.2)where x t and x t+1 are consecutive observations in the TS, x is the mean of the TS observations, and n is the total number of observations in the TS.Variance of autocorrelation (VarAC) [37] . VarAC (σ 2 ρ ) measures the variance of the AC over different lags, which is defined asσ 2 ρ = 1 m m k=1 (ρ k -ρ) 2 , (G.3)where ρ is the mean of the AC over m lags, and m is the total number of lags considered. Tables I.1 and I.2 present the schedules proposed by ANT and the CRPS on forecasting tasks with eight datasets using various discrepancy metrics between the non-stationarity curve and a linear line, respectively. For the metrics, we employ mean-squared error (MSE), mean-absolute error (MAE), Pearson correlation (Corr.), and R-squared (R 2 ), along with the area under the curve (AUC). The result demonstrates our method's robustness across various metrics for d. Table K .1 shows the comparison of our method with a cosine schedule [24] and a recently proposed method [21] in the computer vision domain that utilizes a schedule enforcing a zero signal-to-noise ratio (SNR) at the terminal step and employs v-prediction [27] . Note that we tune the hyperparameters for the above methods using the same range as our method. The results show that our method outperforms the two other methods across all eight datasets in terms of CRPS on forecasting tasks, emphasizing the importance of using an adaptive schedule that considers the rate of data corruption during the forward process. IAAT for multivariate TS can be applied in two different ways: (1) by calculating IAAT for each variable individually, and (2) by calculating a single IAAT that considers all variables together, which we denote as mIAAT (multivariate IAAT). Calculation of mIAAT. First, the autocorrelation function is defined for each pair of variables at different lags. For a multivariate TS X l = (x 1l , x 2l , . . . , x dl ) with d variables of length L, the ρ at lag k for variable pairs (i, j) is computed asρ (i,j) k = L-k t=1 (x il -xi ) (x j,l+k -xj ) L l=1 (x il -xi ) 2 L t=1 (x jl -xj ) 2 , (L.1)where xi and xj are the means of the TS for variables i and j, respectively.Then, for each variable X (d) , IAAT is calculated by computing the sum of autocorrelations across all lags and variables:τ (i) IAAT = 1 + 2 ∞ k=1 d j=1 ρ (i,j) k . (L.2)To aggregate the IAAT across multiple variables, a weighted average of the IAAT values for individual variables can be employed. In this method, the weights are determined by the variances of the individual variables, thereby assigning greater importance to variables with higher variance. Consequently, the IAAT for the multivariate TS (mIAAT) can be calculated as follows:τ mIAAT = d i=1 σ 2 i τ (i) IAAT d i=1 σ 2 i , (L.3)where σ 2 i is the variance of the i-th variable. To demonstrate the effectiveness of our method with other model architectures and multivariate TS, we apply our method to CSDI [34] , which is a score-based conditional diffusion model that uses transformer layers for multivariate TS forecasting and imputation. For the experiment, we conduct a forecasting task using Solar [17] , M4 [23] and Electricity [17, 3] , employing the CRPS as an evaluation metric and a Lin(100) as a base schedule. Table M .1 displays the statistics of the datasets, where D, L, and H represent the number of variables, the length of the input window, and the length of the target window, respectively. Following the original paper, we normalize each feature to have zero mean and unit variance, and set β 1 = 0.0001 and β T = 0.5 for the schedule. Note that as CSDI adds noise only to certain parts of the TS which are randomly masked with a ratio r ∼ Uniform(0,1), we calculate the IAAT with a partially noised TS by randomly masking certain series with ratio r and only performing the forward process on the masked parts, excluding the unmasked parts.As we use a multivariate TS dataset, we apply our method in two ways: (1) using a common schedule across all variables (with mIAAT) where we compute the ANT score based on Equation L.3, and ( 2) using a variable-specific schedule for all variables (with IAAT). For the variable-specific schedule, we choose a schedule with a common T for all variables, and Figure M.1 shows the ratio of schedules chosen as adaptive schedules for each variable. Table M .2 shows the results of TS forecasting, indicating that our method improves performance when using a common schedule for all variables, but hampers performance when using an adaptive schedule for each variable, underscoring the importance of employing a common schedule for all variables using mIAAT. Furthermore, Figure M.2 shows the non-stationarity curves for all variables of Solar, with the 5th and 95th percentiles shaded, using both the base schedule and the schedule proposed by ANT. It is evident that ANT resembles the ideal linear line (black) more closely. N.1 Inference Time by T Table N.1 displays the inference time of TSDiff with schedules of different T s. Specifically, we report inference time for a TS data averaged on the test dataset of Wikipedia [8] . The results highlight the efficiency of using a smaller T , achieving the best forecasting performance (low CRPS) with a schedule of T = 75, as proposed by ANT. Notably, the base schedule performs worse despite using a larger T of T = 100. It's noteworthy that the performance is the worst with the real samples, suggesting the inability of the forecasters to predict TS with different modalities using a single model. This also suggests that the quality of the synthetic dataset cannot be fully captured by the TS generation task of train-synthetic-test-real (TSTR), indicating its insufficiency. shows that both visualizations of the linear and non-linear schedules yield directional point movement across all output channels as the step progresses. However, with the linear schedule, the directions appear more diverse, indicating that step information is captured by both schedules, but more limited with a non-linear schedule. Q Visualization of Non-stationarity Curves NA answer to this question will not be perceived well by the reviewers. • The claims made should match theoretical and experimental results, and reflect how much the results can be expected to generalize to other settings. • It is fine to include aspirational goals as motivation as long as it is clear that these goals are not attained by the paper.Justification: The research conform with the NeurIPS Code of Ethics.Guidelines:• The answer NA means that the authors have not reviewed the NeurIPS Code of Ethics.• If the authors answer No, they should explain the special circumstances that require a deviation from the Code of Ethics. • The authors should make sure to preserve anonymity (e.g., if there is a special consideration due to laws or regulations in their jurisdiction).Justification: There are no crowdsourcing experiments or research with human subjects in this paper.Guidelines:• The answer NA means that the paper does not involve crowdsourcing nor research with human subjects. • Including this information in the supplemental material is fine, but if the main contribution of the paper involves human subjects, then as much detail as possible should be included in the main paper. • According to the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector. 


Decision: This paper introduces a novel methodology to build time series diffusion models. All the reviewers are positive about the contribution. The authors should incorporate the reviewers' feedback in the final version of their paper.

Reviews: review: paper_summary: paper_summary: This paper addresses the non-stationarity in time series data by proposing an ANT score to enable an adaptive noise schedule for diffusion models. It provides extensive experimental results on time series forecasting and generation tasks.
strength_weakness: strength_weakness: 1. Though the ANT score seems effective in empirical evaluations, the paper does not provide theoretical analysis on how the score plays a role in addressing the proposed limitations of traditional diffusion models.
2. The proposed ANT noise schedule can be applied to different types of diffusion models, however in the experiments the ANT is only adapted to TSDiff, which lacks enough evidence to demonstrate its generalizability.
questions: questions: 1. I wonder whether the authors can provide more rigorous theoretical analysis on ANT score.
2. It would be nice to see whether the ANT can be adapted to other diffusion models.
limitations: limitations: The paper limits the noise functions to linear, cosine, and sigmoid, and it may be more imperative to be extended to other cases.
paper_summary: paper_summary: This paper proposes ANT, which adaptively selects the optimal noise schedule for time series diffusion models. The ANT score is computed for each schedule offline based on the datasets' statistics, which is the basis for selection. Extensive experiments demonstrate the method's superior performance in multiple time series tasks.
strength_weakness: strength_weakness: - These candidate schedules are manually set in advance and are not guaranteed to include the optimal schedules.
- The ANT score is a simple multiplication of three factors, which is relatively intuitive. Their high or low values ​​cannot guarantee the quality of the schedules.
questions: questions: - What is the basis for the design of your candidate schedule? What if they do not include the optimal schedule? Will it have a big impact on the results of the experiment?
- Although a lower score indicates a better schedule, are there many cases where schedules with higher scores have better results?
- Are the optimal schedules for the same data set significantly different between different diffusion methods? Can the proposed method consider the characteristics of specific methods when selecting a schedule?
limitations: limitations: Yes
paper_summary: paper_summary: Paper introduces the new method, adaptive noise schedule  for time series diffusion model(ANT) . This is a new methodology as per my knowledge and hence extends the boundaries of the field. Diffusion models are highly effective in generating data but their inclusion in Time Series tasks overlooks the significance of properties of time series and don't focus on dedicated noise scheduling. 

The paper introduces an algorithm to choose an adaptive noise scheduling which has not been done in the past for time series. Authors clearly define the statistics used to quantify the non-stationarity and ANT score. The proposed schedule noise aims to corrupt the TS data gradually instead of abruptly as done with Linear scheduling. It also demonstrates the need for different scheduling needed for different datasets. One size fit all solution does not serve the purpose. 

Another important aspect of the paper discusses and proves why diffusion embedding is not needed for linear schedule. In addition, there was several analysis which shows the importance and stability of ANT.
strength_weakness: strength_weakness: Although paper is well structures and provide tables and figured for all the experiments conducted, details on the evaluation of experiments would help the reader further. E.g. How is metric calculated for the time series forecasting task; what fraction of data is used for inference and which evaluation method is used.
questions: questions: 1. There are several places in the text where language can be improved to avoid ambiguity and enhance the clarity of paper.  E.g. L27 text: "Several works have been proposed to design appropriate schedules [24, 21], but they are not tailored to the TS domain, considering the characteristics of TS data.". L31: it should be M4 dataset and a reference added to it. 

2. Conclusion/Summary does not discuss/report the main results quantitatively.
limitations: limitations: Authors does mention about the limitation at the end of the draft that ANT could take long time if to find the noise schedule if there are too many candidate schedules and this motivated future work in this direction.   It is also noted that the comparison for forecasting task is done using very limited models to show the effectiveness of the ANT but more advanced models (DLinear/FEDFormer etc) could be used in comparison for completeness and also give a hint how big is the difference in metric.

Comments: comment: Thank you for raising your score!

If you have any further questions or suggestions, please feel free to share them with us.
Thanks for addressing my concerns and I decide to raise the score.
Thank you for raising your score! 

If you have any further questions or suggestions, please feel free to share them with us.
Thank you for answering my questions in detail. My concerns have been addressed, so I decide to improve my rating to 6.