Original: Robust Streaming PCA
Revised: Robust Streaming PCA

Original: Abstract
Revised: Abstract

Original: We consider streaming principal component analysis when the stochastic datagenerating model is subject to perturbations.
Revised: We consider streaming principal component analysis when the stochastic datagenerating model is subject to perturbations.

Original: While existing models assume a ﬁxed covariance, we adopt a robust perspective where the covariance matrix belongs to a temporal uncertainty set.
Revised: While existing models assume a fixed covariance, we adopt a robust perspective where the covariance matrix belongs to a temporal uncertainty set.

Original: Under this setting, we provide fundamental limits on  any algorithm recovering principal components.
Revised: Under this setting, we provide fundamental limits on convergence of any algorithm recovering principal components.

Original: We analyze the convergence of the noisy power method and Oja’s algorithm, both studied for the stationary data generating model, and argue that the noisy power method is rate-optimal in our setting.
Revised: We analyze the convergence of the noisy power method and Oja’s algorithm, both studied for the stationary data generating model, and argue that the noisy power method is rate-optimal in our setting.

Original: Finally, we demonstrate the validity of our analysis through numerical experiments.
Revised: Finally, we demonstrate the validity of our analysis through numerical experiments on synthetic and real-world dataset.

Original:  Introduction
Revised:  Introduction

Original: Principal component analysis (PCA) is one of the most extensively studied methods for obtaining the low-dimensional representation of observed data [22].
Revised: Principal component analysis (PCA) is one of the most extensively studied methods for obtaining the low-dimensional representation of observed data [22].

Original: However, classical algorithms for PCA store all the observations and use cubic-time complexity, thereby imposing prohibitively large computationtime and space requirements.
Revised: However, classical algorithms for PCA store all the observations and use cubic-time complexity, thereby imposing prohibitively large computationtime and space requirements.

Original: Recently, several works on PCA have focused on the design and analysis of streaming algorithms with near-optimal memory and storage complexity [25, 29, 40, 43].
Revised: Recently, several works on PCA have focused on the design and analysis of streaming algorithms with near-optimal memory and storage complexity [25, 29, 40, 43].

Original: These algorithms assume that all the observations belong to the same low-dimensional space.
Revised: These algorithms assume that all the observations belong to the same low-dimensional space.

Original: However, this situation is unlikely when the unknown/unexplored alterations corrupt a system’s observations.
Revised: However, this situation is unlikely when the unknown/unexplored alterations corrupt a system’s observations.

Original: For instance, it is well known that typical data attacks on power grids can signiﬁcantly change the estimated covariance matrix of the data observed from sensors [9, 10, 23].
Revised: For instance, it is well known that typical data attacks on power grids can significantly change the estimated covariance matrix of the data observed from sensors [9, 10, 23].

Original: Similarly, PCA can be used to explain stock returns in terms of macroeconomic factors [27], and product pricing taking into account cross-product elasticity and demands [45].
Revised: Similarly, PCA can be used to explain stock returns in terms of macroeconomic factors [27], and product pricing taking into account cross-product elasticity and demands [45].

Original: In all these scenarios, the underlying data-generating model changes every instant, and the decisions are based on identifying the changed model.
Revised: In all these scenarios, the underlying data-generating model changes every instant, and the decisions are based on identifying the changed model.

Original: Current work considers perturbations of the data lying in a ﬁxed low-dimensional space [49].
Revised: Current work considers perturbations of the data lying in a fixed low-dimensional space [49].

Original: They determine the worst-case position of the adversarial data point to incur the maximum error in the subspace estimated through PCA and measure the distance between the two subspaces using the notion of the principal angle between them.
Revised: They determine the worst-case position of the adversarial data point to incur the maximum error in the subspace estimated through PCA and measure the distance between the two subspaces using the notion of the principal angle between them.

Original: Another line of work considers PCA through the lens of stochastic optimization [5, 42, 51, 52].
Revised: Another line of work considers PCA through the lens of stochastic optimization [5, 42, 51, 52].

Original: Our work differs from these approaches since we assume that the data-generating model changes at every time instant.
Revised: Our work differs from these approaches since we assume that the data-generating model changes at every time instant.

Original: Further, we propose near-optimal algorithms for recovering principal components under this framework.
Revised: Further, we propose near-optimal algorithms for recovering principal components under this framework.

Original: We assume a system relies on the time-series of p -dimensional vectors sampled from the time-variant model.
Revised: We assume a system relies on the time-series of p -dimensional vectors sampled from a time-varying model.

Original: The available observations are the vectors ( x t )
Revised: The available observations are the vectors ( x t )

Original: Tt =1 .
Revised: Tt =1 .

Original: The noisy observation x t 2 R p is a vector lying in the column space of an unobserved full-rank matrix A t 2 R p ⇥ k .
Revised: The noisy observation x t ∈ R p is a vector lying in the column space of an unobserved full-rank matrix A t ∈ R p × k .

Original: Precisely, from the standard spiked covariance model [35], we consider the time-dependent environment:
Revised: Precisely, from the standard spiked covariance model [35], we consider the time-dependent environment:

Original: [Equation]
Revised: [Equation]

Original:  where A t can vary with time.
Revised: The authors are ordered where A t can vary with time.

Original: The parameter k ⌧ p is the desired number of principal components.
Revised: The parameter k ≪ p is the desired number of principal components.

Original: Assuming A t belongs to a temporal uncertainty set (deﬁned in the equation (2)), our goal is to recover the top- k principal components of the terminal subspace A T .
Revised: Assuming A t belongs to a temporal uncertainty set (defined in the equation (2)), our goal is to recover the top- k principal components of the terminal subspace A T .

Original: In ﬁnancial applications, our model captures the market evolution in terms of the changing A T with the ultimate goal of explaining the market conditions for an appropriately chosen T .
Revised: In financial applications, our model captures the market evolution in terms of the changing A T with the ultimate goal of explaining the market conditions for an appropriately chosen T .

Original: Previous works on the stationary environment assume A t =
Revised: Previous works on the stationary environment assume A t =

Original: A for all t and have focused on computing a basis for the column space of the matrix A using streaming algorithms [21, 29, 33, 36, 38, 43].
Revised: A for all t and have focused on computing a basis for the column space of the matrix A using streaming algorithms [21, 29, 33, 36, 38, 43].

Original: The accurate reconstruction of the principal components for the standard streaming PCA problem depends on the magnitude of observation noise  , the dimension of observations p , the number of principal components k of the matrix A , and the spectral gap  between k -th and k +1 -th spectrums.
Revised: The accurate reconstruction of the principal components for the standard streaming PCA problem depends on the magnitude of observation noise σ , the dimension of observations p , the number of principal components k of the matrix A , and the spectral gap δ between k -th and k +1 -th spectrums.

Original: singular value of AA > .
Revised: singular value of AA ⊤ .

Original: In a marked departure from previous work, we study the case when the column space of A varies across time, possibly perturbed by  .
Revised: In a marked departure from previous work, we study the case when the column space of A varies across time.

Original: This paper explores these avenues and proposes a tractable analysis framework for the streaming PCA problem, robust to perturbations in thestochastic data-generating model.
Revised: This paper explores these avenues and proposes a tractable analysis framework for the streaming PCA problem, robust to perturbations in the data-generating model.

Original: Our contributions can be summarized as follows:
Revised: Our contributions can be summarized as follows:

Original: (Lower Bound; Section 4)
Revised: (Lower Bound; Section 4)

Original: Our ﬁrst contribution is establishing a fundamental lower bound for estimating the principal components when the covariance matrix belongs to a temporal uncertainty set Tu (  ,  ) .
Revised: Our first contribution is establishing a fundamental lower bound for estimating the principal components when the covariance matrix belongs to a temporal uncertainty set Tu ( δ, Γ) .

Original: In Theorem 1, we derive the minimax bounds of the expected error for recovering the top singular vectors for any streaming algorithm.
Revised: In Theorem 1, we derive the minimax bounds of the expected error for recovering the top singular vectors for any streaming algorithm.

Original: Because the underlying distribution can vary observations from the far past become less important and the estimation of principal components associated with A T should be determined by a subset of samples.
Revised: Because the underlying distribution can vary, observations from the far past become less important and the estimation of principal components associated with A T should be determined by a subset of samples.

Original: Simultaneously, it becomes imperative to ﬁnd the block size B that can be used to recover the principal components
Revised: Simultaneously, it becomes imperative to find the block size B that can be used to recover the principal components.

Original: This is in sharp contrast to the standard spiked covariance model
Revised: This is in sharp contrast to the standard spiked covariance model.

Original: We show that:
Revised: We show that:

Original: • For T
Revised: • For T

Original: =
Revised: =

Original: O (  9 2 / 3 ) , the minimax estimation error decreases as O ( p 1 / 2 T 9 1 / 2 ) .
Revised: O (Γ (cid:57) 2 / 3 ) , the minimax estimation error decreases as O ( p 1 / 2 T (cid:57) 1 / 2 ) .

Original: • On the other hand, for T = ⌦ (  9 2 / 3 ) , the error stagnates to O ( p 1 / 3  1 / 
Revised: • On the other hand, for T = Ω(Γ (cid:57) 2 / 3 ) , the error stagnates to O ( p 1 / 3 Γ 1 / 3 ) and does

Original: 3 ) and does not decrease upon collecting more observations 1 .
Revised: not decrease upon collecting more observations 1 .

Original: (Algorithm Analysis; Section 5)
Revised: (Algorithm Analysis; Section 5)

Original: We then analyze two algorithms to recover the principal components extensively used in the standard streaming PCA setting; the noisy power method [29] and
Revised: We then analyze two algorithms to recover the principal components extensively used in the standard streaming PCA setting; the noisy power method [29] and

Original: Oja’s algorithm [48].
Revised: Oja’s algorithm [48].

Original: These algorithms represent two very different design principles for computing principal components from data in streaming fashion, processing data in blocks vis-à-vis single observations.
Revised: These algorithms represent two very different design principles for computing principal components from data in streaming fashion, processing data in blocks vis-à-vis single observations.

Original: We determine the optimal choice for critical parameters: the block size in the noisy power method on Lemma 1 and the learning rate in Oja’s algorithm on Lemma 2.
Revised: We determine the optimal choice for critical parameters: the block size in the noisy power method on Lemma 1 and the learning rate in Oja’s algorithm on Lemma 2.

Original: Next, we leverage these results to obtain an upper bound on the convergence error for these algorithms in
Revised: Next, we leverage these results to obtain an upper bound on the convergence error for these algorithms in

Original: Theorem 2 and 3, respectively.
Revised: Theorem 2 and 3, respectively.

Original: From these results, we have:
Revised: From these results, we have:

Original: • The block size B for the noisy power method and inverse of the learning rate, ⇣  1 for Oja’s algorithm, plays a similar role even in the non-stationary environment.
Revised: • The block size B for the noisy power method and inverse of the learning rate, ζ − 1 for Oja’s algorithm, plays a similar role even in the non-stationary environment.

Original: In either case, the optimal parameters scale with ⇥ (   2 / 3 ) , where  is the perturbation budget.
Revised: In either case, the optimal parameters scale with Θ(Γ − 2 / 3 ) , where Γ is the perturbation budget.

Original: • The derived upper bound on the estimation error for the noisy power method matches the minimax error in terms of p,  , and  and becomes rate-optimal if it satisﬁes the mild conditions.
Revised: • The derived upper bound on the estimation error for the noisy power method matches the minimax error in terms of p, δ, and Γ and becomes rate-optimal if it satisfies the mild conditions.

Original: Notation.
Revised: Notation.

Original: We ﬁx notation throughout the main body of the paper.
Revised: We fix notation throughout the main body of the paper.

Original: Matrices are denoted by bold uppercase letters (e.g. M ) and vectors are denoted by bold lowercase letters (e.g. x ).
Revised: Matrices are denoted by bold uppercase letters (e.g. M ) and vectors are denoted by bold lowercase letters (e.g. x ).

Original: For M 2 R p ⇥ k ,
Revised: For M ∈ R p × k ,

Original: M i denote the i th column of M , M i : j denote the submatrix consists with i th ⇠ j th column of M and M i,j be the ( i, j ) -element of M .
Revised: M i denote the i th column of M , M i : j denote the submatrix consists with i th ∼ j th column of M and M i,j be the ( i, j ) -element of M .

Original: k · k denote matrix 2-norm or equivalently operator norm for matrices and standard 2-norm for vectors.
Revised: ∥ · ∥ denote matrix 2-norm or equivalently operator norm for matrices and standard 2-norm for vectors.

Original: We use St k ( R p ) for the class of orthogonal matrices in R p ⇥ k .
Revised: We use St k ( R p ) for the class of orthogonal matrices in R p × k .

Original: b ( M ) is the orthogonal matrix where the columns form basis for ran( M ) .
Revised: b ( M ) is the orthogonal matrix where the columns form basis for ran( M ) .

Original: s i ( M ) represents the i th largest singular value of the matrix.
Revised: s i ( M ) represents the i th largest singular value of the matrix.

Original: The singular value decomposition of M is deﬁned as SVD( M ) =
Revised: The singular value decomposition of M is defined as SVD( M ) =

Original: UDV > , where U 2 St p ( R p ) ,
Revised: UDV ⊤ , where U ∈ St p ( R p ) ,

Original: [Equation]
Revised: V ∈ St k

Original: ( R k ) , and D 2 R p ⇥ k is a diagonal matrix whose i th diagonal element equals s i ( M ) .
Revised: ( R k ) , and D ∈ R p × k is a diagonal matrix whose i th diagonal element equals s i ( M ) .

Original: Therefore, we assume without loss of generality that the singular values and respective singular vectors are ordered from largest to smallest.
Revised: Therefore, we assume without loss of generality that the singular values and respective singular vectors are ordered from largest to smallest.

Original: We denote by M ? the orthogonal projection onto the orthogonal complement of the ran( M ) .
Revised: We denote by M ⊥ the orthogonal projection onto the orthogonal complement of the ran( M ) .

Original: Therefore, if rk( M ) =
Revised: Therefore, if rk( M ) =

Original: r and SVD( M )
Revised: r and SVD( M )

Original: =
Revised: =

Original: UDV > , M ? given by M ? =
Revised: UDV ⊤ , M ⊥ given by M ⊥ =

Original: I  U 1: r U > 1: r .
Revised: I − U 1: r U ⊤ 1: r .

Original: Moreover, when rk( M ) =
Revised: Moreover, when rk( M ) =

Original: rk( ˜ M ) and SVD( ˜ M ) = ˜
Revised: rk( ˜ M ) and SVD( ˜ M ) = ˜

Original: U
Revised: U

Original: ˜ D ˜ V > , the distance between ran( M ) and ran( ˜ M ) is deﬁned by: d (ran( M ) , ran( ˜ M )) =
Revised: ˜ D ˜ V ⊤ , the distance between ran( M ) and ran( ˜ M ) is defined by: d (ran( M ) , ran( ˜ M )) =

Original: k b ( M ) b ( M ) >  b ( ˜ M ) b ( ˜ M ) > k = k U 1: k U > 1: k  ˜U 1: k ˜U > 1: k k .
Revised: ∥ b ( M ) b ( M ) ⊤ − b ( ˜ M ) b ( ˜ M ) ⊤ ∥ = ∥ U 1: k U ⊤ 1: k − ˜U 1: k ˜U ⊤ 1: k ∥ .

Original: We denote d (ran( M ) , ran( ˜ M )) by d ( M , ˜ M ) whenever clear from the context.
Revised: We denote d (ran( M ) , ran( ˜ M )) by d ( M , ˜ M ) whenever clear from the context.

Original: The letter A stands for abbreviation of sequence of matrices ( A t )
Revised: The letter A stands for abbreviation of sequence of matrices ( A t )

Original: Tt =1 .
Revised: Tt =1 .

Original: We write X ⇠ A when each element x t in sequence X = ( x t )
Revised: We write X∼A when each element x t in sequence X = ( x t )

Original: Tt =1 are drawn from N ( 0 , A t A > t +  2{+σ 
+} I p ⇥ p ) .
Revised: Tt =1 are drawn from N ( 0 , A t A ⊤ t + {+σ 
+} I p × p ) .

Original: We denote the expectation of f ( X ) over x t ⇠ N ( 0 , A t A > t +  2{+σ 
+} I p ⇥ p ) as E X ⇠ A [ f ] .
Revised: We denote the expectation of f ( X ) over x t ∼ N ( 0 , A t A ⊤ t + {+σ 
+} I p × p ) as E X∼A [ f ] .

Original: We denote ˜ O , ˜ ⇥ as the O , ⇥ notation with ignore the multiplicative dependency of log( pT 2 ) or smaller.
Revised: We denote ˜ O , ˜Θ as the O , Θ notation with ignore the multiplicative dependency of log( pT 2 ) or smaller.

Original:  Related Work
Revised:  Related Work

Original: Principal component analysis (PCA) has been extensively studied across operations research, computer science, and other communities.
Revised: Principal component analysis (PCA) has been extensively studied across operations research, computer science, and other communities.

Original: We highlight how our work differs from existing literature.
Revised: We highlight how our work differs from existing literature.

Original: Robust PCA.
Revised: Robust PCA.

Original: Robust PCA deals with the problem of retrieving the principal components robust to the presence of outliers in the data.
Revised: Robust PCA deals with the problem of retrieving the principal components robust to the presence of outliers in the data.

Original: The cornerstone work in this direction is the principal component pursuit framework wherein they assume that the matrix of observations M can be decomposed in terms of a low-rank matrix L and a sparse matrix (with entries of arbitrarily large magnitude) S [15].
Revised: The cornerstone work in this direction is the principal component pursuit framework wherein they assume that the matrix of observations M can be decomposed in terms of a low-rank matrix L and a sparse matrix (with entries of arbitrarily large magnitude) S [15].

Original: Several works consider the robust PCA problem and propose algorithms in the ofﬂine, batch, and online settings [17, 24, 26, 46].
Revised: Several works consider the robust PCA problem and propose algorithms in the offline, batch, and online settings [17, 24, 26, 46].

Original: Our work differs from this line of literature in two aspects: assumptions about the data-generating model and convex optimization techniques.
Revised: Our work differs from this line of literature in two aspects: assumptions about the data-generating model and convex optimization techniques.

Original: First, our data generation model is unrelated to those considered in the robust PCA literature.
Revised: First, our data generation model is unrelated to those considered in the robust PCA literature.

Original: Further, rich theories from convex optimization can be used in the PCA framework to design efﬁcient algorithms, but our problem is not amenable to such techniques.
Revised: Further, rich theories from convex optimization can be used in the PCA framework to design efficient algorithms, but our problem is not amenable to such techniques.

Original: Streaming PCA.
Revised: Streaming PCA.

Original: Streaming algorithms for PCA have been proposed, among other works on PCA [2, 29, 34, 43, 60].
Revised: Streaming algorithms for PCA have been proposed, among other works on PCA [2, 29, 34, 43, 60].

Original: Algorithms analyzed in this work, such as the noisy power method [29] and Oja’s algorithm [48], are iterative methods for estimating the principal components.
Revised: Algorithms analyzed in this work, such as the noisy power method [29] and Oja’s algorithm [48], are iterative methods for estimating the principal components.

Original: These iterative schemes are instances of stochastic approximation-based solutions for the optimization version of the PCA problem [5].
Revised: These iterative schemes are instances of stochastic approximation-based solutions for the optimization formulation of the PCA problem [5].

Original: The stochastic approximation is a root-ﬁnding framework extensively used for stochastic optimization [11, 37].
Revised: The stochastic approximation is a root-finding framework extensively used for stochastic optimization [11, 37].

Original: Oja’s algorithm, originally proposed by [48], was the ﬁrst such scheme.
Revised: Oja’s algorithm, originally proposed by [48], was the first such scheme.

Original: This framework is also used to analyze gradient-type and proximal-type incremental methods akin to algorithms for convex optimization.
Revised: This framework is also used to analyze gradient-type and proximal-type incremental methods akin to algorithms for convex optimization.

Original: Stochastic gradient descent-based algorithms for the streaming
Revised: Stochastic gradient descent-based algorithms for the streaming

Original: PCA problem, where a single observation is used at every point in time to update the principal components’ estimate, have been extensively studied.
Revised: PCA problem, where a single observation is used at every point in time to update the principal components’ estimate, have been extensively studied.

Original: Along this line, [30] propose GRASTA, an incremental online gradient method for learning over different subspaces.
Revised: Along this line, [30] propose GRASTA, an incremental online gradient method for learning over different subspaces.

Original: Similarly, [6] proposes
Revised: Similarly, [6] proposes

Original: GROUSE, based on the idea of gradient updates over the Grassmannian manifold.
Revised: GROUSE, based on the idea of gradient updates over the Grassmannian manifold.

Original: These and other related works consider Oja’s algorithm for the standard streaming PCA problem [1, 16, 31, 31, 53, 59, 62].
Revised: These and other related works consider Oja’s algorithm for the standard streaming PCA problem [1, 16, 31, 31, 53, 59, 62].

Original: However, all these works are based on a completely different modeling assumption than this paper and do not provide theoretical guarantees for our setting.
Revised: However, all these works are based on a completely different modeling assumption than this paper and do not provide theoretical guarantees for our setting.

Original: Streaming and robust PCA algorithms are used in the presence of outliers or data with a lot of missing entries [18, 55].
Revised: Streaming and robust PCA algorithms are used in the presence of outliers or data with a lot of missing entries [18, 55].

Original: From this literature, the closest to our work is the work on robust subspace tracking [2, 30, 60].
Revised: From this literature, the closest to our work is the work on robust subspace tracking [2, 30, 60].

Original: However, the robustness considered there is against erasures or sparse outliers.
Revised: However, the robustness considered there is against erasures or sparse outliers.

Original: While these algorithms provide theoretical guarantees in that setting, those guarantees cannot be extended to our model.
Revised: While these algorithms provide theoretical guarantees in that setting, those guarantees cannot be extended to our model.

Original: Considerations of erasures and outliers under the model proposed in this paper are beyond the scope of this work and remain an interesting future direction.
Revised: Considerations of erasures and outliers under the model proposed in this paper are beyond the scope of this work and remain an interesting future direction.

Original:  Mathematical Framework
Revised:  Mathematical Framework

Original: Observations from the standard spiked covariance model belong to a ﬁxed k -dimensional column space A 2 R p .
Revised: Observations from the standard spiked covariance model belong to a fixed k -dimensional column space A ∈ R p .

Original: Previous work has focused on reconstructing this space from the observed time series.
Revised: Previous work has focused on reconstructing this space from the observed time series.

Original: Under our framework, we assume that the sequence of observations ( x t )
Revised: Under our framework, we assume that the sequence of observations ( x t )

Original: Tt =1 follows the time-dependent spiked covariance model (1).
Revised: Tt =1 follows the time-dependent spiked covariance model (1).

Original: We consider the problem of computing top- k singular vectors of A T .
Revised: We consider the problem of [Table] vectors of A T .

Original: We formulate this model by addressing minimax optimization as a robust optimization problem.
Revised: We formulate this model by addressing minimax optimization as a robust optimization problem.

Original: When the adversary is allowed to select a completely arbitrary sequence of matrices ( A t )
Revised: When the adversary is allowed to select a completely arbitrary sequence of matrices ( A t )

Original: Tt =1 , it is impossible to accurately recover the column space of A T .
Revised: Tt =1 , it is impossible to accurately recover the column space of A T .

Original: Instead, we deﬁne temporal uncertainty sets to restrict the power of the adversary.
Revised: Instead, we define temporal uncertainty sets to restrict the power of the adversary.

Original: Deﬁnition 1.
Revised: Definition 1.

Original: Let  ,   0 .
Revised: Let Γ , δ ≥ 0 .

Original: We only allow the sequence of matrices ( A t )
Revised: We only allow the sequence of matrices ( A t )

Original: Tt =1 that lie in an temporal uncertainty set
Revised: Tt =1 that lie in an temporal uncertainty set

Original: Tu (  ,  ) deﬁned as:
Revised: Tu ( δ, Γ) defined as:

Original: [Equation]
Revised: [Equation]

Original: We constrain the difference between any two consecutive covariance matrices of the underlying process by  .
Revised: We constrain the difference between any two consecutive covariance matrices of the underlying process by Γ .

Original: The assumption s k
Revised: The assumption s k

Original: ( A t A > t )   is crucial for establishing bounds of estimation error.
Revised: ( A t A ⊤ t ) ≥ δ is crucial for establishing bounds of estimation error.

Original: It is also justiﬁed in any setting where the underlying phenomenology guarantees covariance of rank k; the stated lower bound excludes pathological cases of near-rank k  1 or smaller.
Revised: It is also justified in any setting where the underlying phenomenology guarantees covariance of rank k; the stated lower bound excludes pathological cases of near-rank k − 1 or smaller.

Original: Having described the constraints on the perturbation power, we present the algorithms and the performance metric of interest.
Revised: Having described the constraints on the perturbation power, we present the algorithms and the performance metric of interest.

Original: In particular, we consider (i) streaming algorithms, i.e., make a single pass through the time series in chronological order; only the previous samples are stored at any point in the past.
Revised: In particular, we consider (i) streaming algorithms, i.e., make a single pass through the time series in chronological order; only the previous samples are stored at any point in the past.

Original: These characteristics model the behavior of an algorithm that receives data in real-time and only stores samples in limited memory.
Revised: These characteristics model the behavior of an algorithm that receives data in real-time and only stores samples in limited memory.

Original: Among those streaming algorithms, we consider (ii) the algorithms whose output is a set of k orthonormal vectors in R p .
Revised: Among those streaming algorithms, we consider (ii) the algorithms whose output is a set of k orthonormal vectors in R p .

Original: Let us denote by  the family of algorithms just described.
Revised: Let us denote by Φ the family of algorithms just described.

Original: The output of algorithm  2  for a given observations X = ( x t )
Revised: The output of algorithm ϕ ∈ Φ for a given observations X = ( x t )

Original: Tt = sampled using model (2) is a set of k orthonormal vectors, which we denote by  X .
Revised: Tt = sampled using model (2) is a set of k orthonormal vectors, which we denote by ϕ X .

Original: We will also view  X as a matrix in R p ⇥ k or the subspace generated by  X .
Revised: We will also view ϕ X as a matrix in R p × k or the subspace generated by ϕ X .

Original: Following deﬁnition 2 illustrates how we treat the lower bound and when we call the algorithm optimal.
Revised: Following definition 2 illustrates how we treat the lower bound and when we call the algorithm optimal.

Original: We note that this formulation has been widely studied [14, 57, 58].
Revised: We note that this formulation has been widely studied [14, 57, 58].

Original: Deﬁnition 2.
Revised: Definition 2.

Original: Let A
Revised: Let A

Original: =
Revised: =

Original: ( A t )
Revised: ( A t )

Original: Tt [-=1 
-]
Revised: Tt [-=1 
-]=

Original:  Tu (  ,  ) , and  2  .
Revised: 1 ∈ Tu ( δ, Γ) , and ϕ ∈ Φ .

Original: The estimation error of  given X ⇠ A is the distance between the space spanned by  X and the column space of A T ( d ( ran ( A T ) ,  X ) ).
Revised: The estimation error of ϕ given X ∼ A is the distance between the space spanned by ϕ X and the column space of A T ( d ( ran ( A T ) , ϕ X ) ).

Original: The metric can be easily extended to the cumulative error.
Revised: The metric can be easily extended to the cumulative error.

Original: Refer Appendix A for the discussion.
Revised: Refer Appendix A for the discussion.

Original: R  is the maximum expected estimation error of  under A over all A 2 Tu (  ,  ) .
Revised: R ϕ is the maximum expected estimation error of ϕ under A over all A ∈ Tu ( δ, Γ) .

Original: [Equation]
Revised: [Equation]

Original: R ⇤ is the minimax estimation error deﬁned as the minimum of the largest expected estimation error incurred by  2  :
Revised: R ∗ is the minimax estimation error defined as the minimum of the largest expected estimation error incurred by ϕ ∈ Φ :

Original: [Equation]
Revised: [Equation]

Original: An algorithm  2  is rate-optimal if R   C · R ⇤ , where constant C > 0 is independent of the problem parameters T ,  , p , k , and  .
Revised: An algorithm ϕ ∈ Φ is rate-optimal if R ϕ ≤ C · R ∗ , where constant C > 0 is independent of the problem parameters T , δ , p , k , and Γ .

Original: In this work, we establish the minimax estimation error R ⇤ and propose rate-optimal sublinear-time, single-pass algorithms for robust streaming PCA.
Revised: In this work, we establish the minimax estimation error R ∗ and propose rate-optimal sublinear-time, single-pass algorithms for robust streaming PCA.

Original:  Minimax Lower Bound
Revised:  Minimax Lower Bound

Original: When A = ( A t )
Revised: When A = ( A t )

Original: Tt =1 belongs to the temporal uncertainty set
Revised: Tt =1 belongs to the temporal uncertainty set

Original: Tu (  ,  ) (Deﬁnition 1), an algorithm designed to recover the principal components of A T from the observations cannot guarantee zero estimation error.
Revised: Tu ( δ, Γ) (Definition 1), an algorithm designed to recover the principal components of A T from the observations cannot guarantee zero estimation error.

Original: Our ﬁrst goal is to obtain the minimax lower bound on the estimation error in the problem parameters T ,  , p , k , and  .
Revised: Our first goal is to obtain the minimax lower bound on the estimation error in the problem parameters T , δ , p , k , and Γ .

Original: In order to establish the lower bound, we leverage the fundamental limit of hypothesis tests [57].
Revised: In order to establish the lower bound, we leverage the fundamental limit of hypothesis tests [57].

Original: The crux of the proof lies in constructing the set of worst-case hypotheses and establishing a lower bound on the probability of error in distinguishing between these hypotheses using observed data.
Revised: The crux of the proof lies in constructing the set of worst-case hypotheses and establishing a lower bound on the probability of error in distinguishing between these hypotheses using observed data.

Original: The complete proof is provided in Appendix D.
Revised: The complete proof is provided in Appendix D.

Original: Theorem 1 (Lower Bound) .
Revised: Theorem 1 (Lower Bound) .

Original: Assume  >   0 and p > 2 k + 1 .
Revised: Assume δ > Γ ≥ 0 and p > 2 k + 1 .

Original: For any algorithm  2  , there exists a sequence
Revised: For any algorithm ϕ ∈ Φ , there exists a sequence

Original: A 2 Tu (  ,  ) such that E X ⇠ A ⇥ d  [Equation] [Equation] X ⇤ has lower bound with order:
Revised: A ∈ Tu ( δ, Γ) such that E X∼A (cid:2) d (cid:0) ran( A T ) , ϕ X (cid:1)(cid:3) has lower bound with order:

Original: [Equation]
Revised: [Equation]

Original: By taking inf  2  , we get the same lower bound for R ⇤ .
Revised: By taking inf ϕ ∈ Φ , we get the same lower bound for R ∗ .

Original: For the standard streaming PCA problem (Theorem 1 with the case of  = 0 ), the fundamental limit is ⇥ ((  /  )( p (  2 +  ) /T ) 1 / 2 ) , which has the expected ⇥ (1 / p T ) dependence [14, 58].
Revised: For the standard streaming PCA problem (Theorem 1 with the case of Γ = 0 ), the fundamental limit is Θ(( σ/δ )( p ( σ 2 + δ ) /T ) 1 / 2 ) , which has the expected Θ(1 / √ T ) dependence [14, 58].

Original: On the other hand, in the presence of perturbations (  > 0 ), the lower bound exhibits a phase transition phenomenon, with the ﬁrst term representing the effect of model ambiguity.
Revised: On the other hand, in the presence of perturbations ( Γ > 0 ), the lower bound exhibits a phase transition phenomenon, with the first term representing the effect of model ambiguity.

Original: To this end, deﬁne the critical time T c as
Revised: To this end, define the critical time T c as

Original: [Equation]
Revised: [Equation]

Original: For T
Revised: For T

Original: =
Revised: =

Original: O ( T c ) , the lower bound decreases with the rate of 1 / p T .
Revised: O ( T c ) , the lower bound decreases with the rate of 1 / √ T .

Original: However, when T = ⌦ ( T c ) , the ﬁrst term dominates the second term, and R ⇤ becomes independent of the number of observations T .
Revised: However, when T =Ω( T c ) , the first term dominates the second term, and R ∗ becomes independent of the number of observations T .

Original: In this regime, the error stagnates to O ((  /  ) 1 / p
Revised: In this regime, the error stagnates to O ((Γ /δ ) 1 / 3 (cid:0) pσ 2 ( σ 2 + δ ) /δ

Original:  2 (  2 +  ) /  1 / 3 ) .
Revised: 2 (cid:1) 1 / 3 ) .

Original: Therefore, as our intuition suggests, the information quickly becomes stale in a dynamic environment.
Revised: Therefore, as our intuition suggests, the information quickly becomes stale in a dynamic environment.

Original: Theorem 2 and 3 will prove that the noisy power method and Oja’s algorithm attain a near-optimal bound on the convergence guarantee.
Revised: Theorem 2 and 3 will prove that the noisy power method and Oja’s algorithm attain a near-optimal bound on the convergence guarantee.

Original: Theorem 2 guarantees that if s 1 ( A t A > t ) =⇥
Revised: Theorem 2 guarantees that if s 1 ( A t A ⊤ t ) =

Original: (  ) , the upper bound for estimation error on the noisy power method is of the following order:
Revised: Θ( δ ) , the upper bound for estimation error on the noisy power method is of the following order:

Original: [Equation]
Revised: [Equation]

Original: That is, if p  2 dominates k  , the noisy power method becomes rate-optimal under the controlled uncertainty with Tu (  ,  ) .
Revised: That is, if pσ 2 dominates kδ , the noisy power method becomes rate-optimal under the controlled uncertainty with Tu ( δ, Γ) .

Original: This regime is the case of noisy practical situations, with  2 6⌧  .
Revised: This regime is the case of noisy practical situations, with σ 2 ̸≪ δ .

Original:  Convergence Analysis
Revised:  Convergence Analysis

Original: In this section, we analyze two algorithms for the robust streaming PCA problem.
Revised: In this section, we analyze two algorithms for the robust streaming PCA problem.

Original: A generic template for algorithms,  2  of interest to us is as follows: (i)  is initialized with a random matrix with orthonormal columns
Revised: A generic template for algorithms, ϕ ∈ Φ of interest to us is as follows: (i) ϕ is initialized with a random matrix with orthonormal columns

Original: ˆ U 2 R p ⇥ k ; (ii) a running estimate of the principal components is maintained as the columns of ˆ U ; (iii) observations are projected onto the column space of ˆ U to update this estimate.
Revised: ˆ U ∈ R p × k ; (ii) a running estimate of the principal components is maintained as the columns of ˆ U ; (iii) observations are projected onto the column space of ˆ U to update this estimate.

Original: We consider two algorithms: a robust version of the noisy power method (Algorithm 1) and Oja’s algorithm (Algorithm 2).
Revised: We consider two algorithms: a robust version of the noisy power method (Algorithm 1) and Oja’s algorithm (Algorithm 2).

Original: The critical difference between the noisy power method and Oja’s algorithm is the data used to estimate the principal components.
Revised: The critical difference between the noisy power method and Oja’s algorithm is the data used to estimate the principal components.

Original: In the noisy power method, the estimates are updated after a batch of observations, whereas in Oja’s algorithm, the estimates are updated after scaling every observation with the learning rate.
Revised: In the noisy power method, the estimates are updated after a batch of observations, whereas in Oja’s algorithm, the estimates are updated after scaling every observation with the learning rate.

Original: Therefore, the parameters determining the performance of these algorithms are the batch size B for the robust power method and the learning rate ⇣ for Oja’s algorithm.
Revised: Therefore, the parameters determining the performance of these algorithms are the batch size B for the robust power method and the learning rate ζ for Oja’s algorithm.

Original: The analysis of these algorithms cannot be readily established with existing techniques when the covariance matrix belongs to a temporal uncertainty set since they rely on showing that the estimates improve every iteration.
Revised: The analysis of these algorithms cannot be readily established with existing techniques when the covariance matrix belongs to a temporal uncertainty set since they rely on showing that the estimates improve every iteration.

Original: Further, applying many concentration results requires random matrices to be bounded, which is not the case when the observations are sampled from (1).
Revised: Further, applying many concentration results requires random matrices to be bounded, which is not the case when the observations are sampled from (1).

Original: Therefore, in order to simplify the analysis of both algorithms, we introduce Assumption 1, adapted from [34].
Revised: Therefore, in order to simplify the analysis of both algorithms, we introduce Assumption 1, adapted from [34].

Original: Assumption 1.
Revised: Assumption 1.

Original: Let ( A t )
Revised: Let ( A t )

Original: Tt [-=1 
-]
Revised: Tt [-=1 
-]=

Original:  Tu (  ,  ) .
Revised: 1 ∈ Tu ( δ, Γ) .

Original: For ˜    and M , V > 0 , we consider the observations x t for t 2 [ T ] satisfy the following:
Revised: For ˜ δ ≥ δ and M , V > 0 , we consider the observations x t for t ∈ [ T ] satisfy the following:

Original: E [ x t x > t ] =
Revised: E [ x t x ⊤ t ] =

Original: A t A > t +  2{+σ 
+} I p ⇥ p while k A t A > t k  ˜  , 2.
Revised: A t A ⊤ t + {+σ 
+} I p × p while ∥ A t A ⊤ t ∥ ≤ ˜ δ , 2.

Original: k x t x > t  ( A t A > t +  2{+σ 
+} I p ⇥ p ) k
Revised: ∥ x t x ⊤ t − ( A t A ⊤ t + {+σ 
+} I p × p ) ∥

Original:  M a.s., and 3.
Revised: ≤ M a.s., and 3.

Original:  E ⇥ ( x t x > t  ( A tA > t +  2 I p ⇥ p ))
Revised: (cid:13)(cid:13) E (cid:2) ( x t x ⊤ t − ( A t

Original: ⇤{+A ⊤ t + σ 
 I p × p )) 2 (cid:3)(cid:13)(cid:13) ≤ V .+}
Revised: {+A ⊤ t + σ 
 I p × p )) 2 (cid:3)(cid:13)(cid:13) ≤ V .+}

Original:  V . When the observations follow model (1), we condition our analysis on the high-probability event E .
Revised: When the observations follow model (1), we condition our analysis on the high-probability event E .

Original: Deﬁnition 3.
Revised: Definition 3.

Original: Let SVD( A t A > t +  2{+σ 
+} I p ⇥ p )=
Revised: Let SVD( A t A ⊤ t + {+σ 
+} I p × p )=

Original: U t D t U Tt and x t =
Revised: U t D t U Tt and x t =

Original: U t D 1 / 2 t z t , where z t ⇠ N ( 0 , I p ⇥ p ) .
Revised: U t D 1 / 2 t z t , where z t ∼N ( 0 , I p × p ) .

Original: We deﬁne the event E as:
Revised: We define the event E as:

Original: [Equation]
Revised: [Equation]

Original: The observations from model (1) satisfy Assumption 1 with M = 2({+
 (+} k ˜  + p  2 )(1+ ⇥ (log( pT 2 ) /T )) ,
Revised: The observations from model (1) satisfy Assumption 1 with M = {+
 (+} k ˜ δ + pσ 2 )(1+Θ(log( pT 2 ) /T )) ,

Original: V = 2 M (˜  +  2 ) with probability P [ E ]  1  1 /T .
Revised: V = 2 M (˜ δ + σ 2 ) with probability P [ E ] ≥ 1 − 1 /T .

Original: Although after conditioning E [ x t x > t | E ] 6 =
Revised: Although after conditioning E [ x t x ⊤ t | E ] ̸ =

Original: A t A > t +  2 I p ⇥ p , we can use all the results in Section 5.1 and 5.2 with a multiplicative logarithmic factor.
Revised: A t A ⊤ t + σ 2 I p × p , we can use all the results in Section 5.1 and 5.2 with a multiplicative logarithmic factor.

Original: Please refer to Appendix B for the details.
Revised: Please refer to Appendix B for the details.

Original: 5.1 Noisy Power Method
Revised: 5.1 Noisy Power Method

Revised: Algorithm

Original: 1: Input: Stream of vectors: ( x t )
Revised: 1: Input: Stream of vectors: ( x t )

Original: Tt =1 , block size: B , dimensions: p, k 2: Sample each element of ˆU (0) in N (0 , 1) 3: for ` = 1 : L = b T/B c do 4:
Revised: Tt =1 , block size: B , dimensions: p, k 2: Sample each element of ˆU (0) in N (0 , 1) 3: for ℓ = 1 : L = ⌊ T/B ⌋ do 4:

Original: Y ( ` )  0 2 R p ⇥ k 5: for t = ( `  1) B + 1 : ` B do 6:
Revised: Y ( ℓ ) ← 0 ∈ R p × k 5: for t = ( ℓ − 1) B + 1 : ℓB do 6:

Original: Y ( ` )  Y ( ` ) + 1 B x t x > t ˆU ( `  1) 7: end for 8: ˆU ( ` )  Gram-Schmidt ( Y ( ` )) 9: end for 10: Output: ˆU ( L )
Revised: Y ( ℓ ) ← Y ( ℓ ) + 1 B x t x ⊤ t ˆU ( ℓ − 1) 7: end for 8: ˆU ( ℓ ) ← Gram-Schmidt ( Y ( ℓ )) 9: end for 10: Output: ˆU ( L )

Original: The noisy power method is an iterative algorithm for computing the top- k principal components of a matrix.
Revised: The noisy power method is an iterative algorithm for computing the top- k principal components of a matrix.

Original: Starting from the random matrix ˆ U (0) in R p ⇥ k , the algorithm runs for L iterations, each processing B samples.
Revised: Starting from the random matrix ˆ U (0) in R p × k , the algorithm runs for L iterations, each processing B samples.

Original: By repeating this procedure, we expect the algorithm to reconstruct the covariance matrix if the observations are derived from the ﬁxed distribution.
Revised: By repeating this procedure, we expect the algorithm to reconstruct the covariance matrix if the observations are derived from the fixed distribution.

Original: When observations are drawn from model (1) under Assumption 1, the later observation can be sampled from distributions with shifted covariance.
Revised: When observations are drawn from model (1) under Assumption 1, the later observation can be sampled from distributions with shifted covariance.

Original: Unlike the standard case, for any algorithm  2  , the presence of perturbation prevents the convergence of the columns of ˆ U ( ` ) to the singular vectors of the ﬁnal covariance matrix U ( ` ) .
Revised: Unlike the standard case, for any algorithm ϕ ∈ Φ , the presence of perturbation prevents the convergence of the columns of ˆ U ( ℓ ) to the singular vectors of the final covariance matrix U ( ℓ ) .

Original: The main difﬁculty here is that the columns of ˆ U ( ` ) do not converge towards a ﬁxed set of vectors but keep tracking the time-varying principal components.
Revised: The main difficulty here is that the columns of ˆ U ( ℓ ) do not converge towards a fixed set of vectors but keep tracking the time-varying principal components.

Original: Recall that our ultimate objective is to recover the principal components associated with the terminal observation.
Revised: Recall that our ultimate objective is to recover the principal components associated with the terminal observation.

Original: Hence, we decompose the covariance matrix in terms of the last observation and the remaining samples.
Revised: Hence, we decompose the covariance matrix in terms of the last observation and the remaining samples.

Original: For ` -th block, we denote the covariance matrix for ` B -th observation as M ( ` ) and have:
Revised: For ℓ -th block, we denote the covariance matrix for ℓB -th observation as M ( ℓ ) and have:

Original: [Equation]
Revised: [Equation]

Original: Due to perturbations in the robust model, E ( ` ) is a non-zero mean random variable.
Revised: Due to perturbations in the robust model, E ( ℓ ) is a non-zero mean random variable.

Original: Therefore, we ﬁrst decompose E ( ` ) in terms of the contribution due to inherent noise and the perturbations the robust model allows.
Revised: Therefore, we first decompose E ( ℓ ) in terms of the contribution due to inherent noise and the perturbations the robust model allows.

Original: Then, in Lemma 1, we decompose the error k E ( ` ) k with respect to the block size B and the allowed perturbations  in the robust model.
Revised: Then, in Lemma 1, we decompose the error ∥E ( ℓ ) ∥ with respect to the block size B and the allowed perturbations Γ in the robust model.

Original: We provided complete proof in Appendix E.
Revised: We provided complete proof in Appendix E.

Original: Lemma 1 (Spectral norm of noise) .
Revised: Lemma 1 (Spectral norm of noise) .

Original: Assume that the observations ( x t )
Revised: Assume that the observations ( x t )

Original: Tt =1 generated according to the Assumption 1.
Revised: Tt =1 generated according to the Assumption 1.

Original: With probability greater than 1  1 /T , the matrices E ( ` ) in the equation (6) are bounded by:
Revised: With probability greater than 1 − 1 /T , the matrices E ( ℓ ) in the equation (6) are bounded by:

Original: [Equation]
Revised: [Equation]

Original:  when the block size B is larger than M 2 log(2 pT 2 ) / V .
Revised: 7) when the block size B is larger than M 2 log(2 pT 2 ) / V .

Original: Lemma 1 highlights the effect of allowing perturbations in the data generation model.
Revised: Lemma 1 highlights the effect of allowing perturbations in the data generation model.

Original: From classical results in statistics, our intuition tells us that the effect of noise washes out as the block size increases, i.e., the error decays with the ‘inverse square root’ of the block size.
Revised: From classical results in statistics, our intuition tells us that the effect of noise washes out as the block size increases, i.e., the error decays with the ‘inverse square root’ of the block size.

Original: Hence, barring memory and data issues, a larger block size is better when  = 0 .
Revised: Hence, barring memory and data issues, a larger block size is better when Γ = 0 .

Original: In contrast, covariance perturbations add errors proportional to the block size.
Revised: In contrast, covariance perturbations add errors proportional to the block size.

Original: Consequently, we have a trade-off between two terms in this case, and an optimal block size exists depending on the  .
Revised: Consequently, we have a trade-off between two terms in this case, and an optimal block size exists depending on the Γ .

Original: We establish the convergence guarantee of the robust power method in Theorem 2.
Revised: We establish the convergence guarantee of the robust power method in Theorem 2.

Original: In the proof of
Revised: In the proof of

Original: Theorem 2 (Appendix F), we bound the distance, d  U ( L ) , ˆ U ( L )  between the output of Algorithm 1, ˆ U 1: k ( L ) and k -orthonormal vectors spanning the column space of A T , U 1: k ( L ) .
Revised: Theorem 2 (Appendix F), we bound the distance, d (cid:0) U ( L ) , ˆ U ( L ) (cid:1) between the output of Algorithm 1, ˆ U 1: k ( L ) and k -orthonormal vectors spanning the column space of A T , U 1: k ( L ) .

Original: We identify the optimal block size B , the unique parameter for the noisy power method, and establish an upper bound on the estimation error of the noisy power method.
Revised: We identify the optimal block size B , the unique parameter for the noisy power method, and establish an upper bound on the estimation error of the noisy power method.

Original: Theorem 2 (Robust power method) .
Revised: Theorem 2 (Robust power method) .

Original: Assume that   0 .
Revised: Assume that δ ≥ 0 .

Original: 71  2 and  =
Revised: 71 σ 2 and Γ =

Original: O (  3 / ( V log(2 pT 2 ))) .
Revised: O ( δ 3 / ( V log(2 pT 2 ))) .

Original: When the observations ( x t ) Tt =1 satisﬁes the assumption 1, for B =⇥
Revised: When the observations ( x t ) Tt =1 satisfies the assumption 1, for B =

Original: ( V 1 / 3 log(2 pT 2 ) 1 / 3 /  2 / 3 ) we have: d (ran( A T ) , NPM X [Equation]
Revised: Θ( V 1 / 3 log(2 pT 2 ) 1 / 3 / Γ 2 / 3 ) we have: d (ran( A T ) , NPM X ) =

Original: = O [Equation]
Revised: O (cid:18) ( V

Original: [Equation]
Revised: [Equation]

Original: (8) with probability 1  2 /T  c ⌦ ( p  k +1)
Revised: ) with probability 1 − 2 /T − c Ω( p − k +1)

Original:  e  ⌦ ( p ) .
Revised: − e − Ω( p ) .

Original: When  = ⌦ (  3 / ( V log(2 pT 2 )))
Revised: When Γ = Ω( δ 3 / ( V log(2 pT 2 )))

Original: we have that ( V  log(2 pT 2 )) 1 / 3 /  = ⌦ (1) .
Revised: we have that ( V Γ log(2 pT 2 )) 1 / 3 /δ = Ω(1) .

Original: Therefore, the condition on  in Theorem 2 is necessary to avoid a trivial upper bound ⇥ (1) .
Revised: Therefore, the condition on Γ in Theorem 2 is necessary to avoid a trivial upper bound Θ(1) .

Original: This condition encompasses several applications of interest alluded to earlier.
Revised: This condition encompasses several applications of interest alluded to earlier.

Original: For example, in the ﬁnancial applications alluded to earlier, individual market changes of interest happen on a millisecond time scale.
Revised: For example, in the financial applications alluded to earlier, individual market changes of interest happen on a millisecond time scale.

Original: It is of signiﬁcant interest to terminally detect incremental market changes.
Revised: It is of significant interest to terminally detect incremental market changes.

Original: Our results hold on to the large value of cumulative changes and allow us to study them.
Revised: Our results hold on to the large value of cumulative changes and allow us to study them.

Original: They further imply that the noisy power method is rate-optimal for non-trivial values of  .
Revised: They further imply that the noisy power method is rate-optimal for non-trivial values of Γ .

Original: When the observations follow model (1), under the event E  ,
Revised: When the observations follow model (1), under the event E ∆ ,

Original: Theorem 2 shows that the robust power method can achieve an estimation error of:
Revised: Theorem 2 shows that the robust power method can achieve an estimation error of:

Original: [Equation]
Revised: [Equation]

Original: if T = ⌦ (max( T c ,  ( p  2 )  1 )) ,  = ⌦ (( c ⌦ ( p  k +1)
Revised: if T = Ω(max( T c , δ ( pσ 2 ) − 1 )) , Γ = Ω(( c Ω( p − k +1)

Original: + e  ⌦ ( p ) )
Revised: + e − Ω( p ) )

Original:  2 ( p  2 )  1 ) , and ˜  = ⇥ (  ) .
Revised: δ 2 ( pσ 2 ) − 1 ) , and ˜ δ = Θ( δ ) .

Original: Then it becomes order-wise identical to the fundamental limit established in Theorem 1 when p dominates k  .
Revised: Then it becomes order-wise identical to the fundamental limit established in Theorem 1 when pσdominates kδ .

Original: The ﬁrst condition on T illustrates when past observations become less critical.
Revised: The first condition on T illustrates when past observations become less critical.

Original: The probability for the upper bound on the noisy power method [29] with random initialization should not be small to construct expectation bounds from the high probability bound.
Revised: The probability for the upper bound on the noisy power method [29] with random initialization should not be small to construct expectation bounds from the high probability bound.

Original: We address this regime by condition on  , which is coarse due to exponential terms and ( p  2 )  1 .
Revised: We address this regime by condition on Γ , which is coarse due to exponential terms and ( pσ 2 ) − 1 .

Original: Establishing bounds on the estimation error when the underlying singular vectors change is intricate since the subspace to which consecutive observations belong is potentially different.
Revised: Establishing bounds on the estimation error when the underlying singular vectors change is intricate since the subspace to which consecutive observations belong is potentially different.

Original: Conventional proofs that analyze noisy power methods or Oja’s algorithm show that under a variety of assumptions at every iteration ` , the distance between the estimated and true subspace, d ( U ( ` ) , ˆ U ( ` )) decreases.
Revised: Conventional proofs that analyze noisy power methods or Oja’s algorithm show that under a variety of assumptions at every iteration ℓ , the distance between the estimated and true subspace, d ( U ( ℓ ) , ˆ U ( ℓ )) decreases.

Original: For instance, the proof in [29] requires k E ( ` ) U ( ` ) k
Revised: For instance, the proof in [29] requires ∥E ( ℓ ) U ( ℓ ) ∥

Original: =O
Revised: =

Original:  ( p k/p ) , which does not hold under our model since k M ( ` )  M ( `  1) k is, in general, greater than p k/p .
Revised: O ( (cid:112) k/p ) , which does not hold under our model since ∥ M ( ℓ ) − M ( ℓ − 1) ∥ is, in general, greater than (cid:112) k/p .

Original: Similarly, the concentration approach in [33] can be used only when the covariance matrix is time-invariant.
Revised: Similarly, the concentration approach in [33] can be used only when the covariance matrix is time-invariant.

Original: We brieﬂy describe our proof technique to establish Theorem 2, deferring details to Appendix F. Let M ( L ) denotes the product 
Revised: We briefly describe our proof technique to establish Theorem 2, deferring details to Appendix F. Let M ( L ) denotes the product (cid:81)

Original: Q [Equation]  .
Revised: Lℓ =1 (cid:0) M ( ℓ ) + E ( ℓ ) (cid:1) .

Original: Then, the output of the algorithm ˆ U 1: k
Revised: Then, the output of the algorithm ˆ U 1: k

Original: ( L ) is an orthonormal basis of M ( L ) ˆ U (0) , which estimates the ﬁrst k principal components U 1: k of the M ( L ) .
Revised: ( L ) is an orthonormal basis of M ( L ) ˆ U (0) , which estimates the first k principal components U 1: k of the M ( L ) .

Original: To address this, we construct sequences of k and ( p  k ) -dimensional subspaces of R p from observations { ( x t ) ` Bt =( `  1) B } L ` =1 , denoted by { N ( ` ) } L ` =1 2 St p  k ( R p ) and { W ( ` )
Revised: To address this, we construct sequences of k and ( p − k ) -dimensional subspaces of R p from observations { ( x t ) ℓBt =( ℓ − 1) B } Lℓ =1 , denoted by { N ( ℓ ) } Lℓ =1 ∈

Original:  } L ` =1 2 St k
Revised: St p − k ( R p ) and { W ( ℓ ) } Lℓ =1 ∈ St k

Original: ( R p ) respectively, such that for all iterations ` :
Revised: ( R p ) respectively, such that for all iterations ℓ :

Original: 1. ran  ( M ( ` )+ E ( ` )) N ( ` )  ✓ ran  N
Revised: 1. ran (cid:0) ( M ( ℓ )+ E ( ℓ )) N ( ℓ ) (cid:1) ⊆

Original:  ( ` +1)  and ran  ( M ( ` )+ E ( ` )) 
Revised: ran (cid:0) N ( ℓ +1) (cid:1) and ran (cid:0) ( M ( ℓ )+ E ( ℓ )) W ( ℓ ) (cid:1) ⊆

Original: W ( ` )  ✓ ran  W ( ` +1)  , 2.
Revised: ran (cid:0) W ( ℓ +1) (cid:1) , 2.

Original: k ( M ( ` ) + E ( ` ))
Revised: ∥ ( M ( ℓ ) + E ( ℓ ))

Original: N ( ` ) k · k (( M ( ` ) + E ( ` )) W ( ` ) )  1 k < 1 , 3.
Revised: N ( ℓ ) ∥ · ∥ (( M ( ℓ ) + E ( ℓ )) W ( ℓ ) ) − 1 ∥ < 1 , 3.

Original: d ( U 1: k ( ` ) , W ( ` +1) ) , d ( U k
Revised: d ( U 1: k ( ℓ ) , W ( ℓ +1) ) , d ( U k

Original: +1: p ( ` ) , N ( ` +1) )
Revised: +1: p ( ℓ ) , N ( ℓ +1) )

Original: =
Revised: =

Original: O ( k E ( ` ) k ) .
Revised: O ( ∥E ( ℓ ) ∥ ) .

Original: The initial random matrix ˆ U 1: k (0) consists of both N (1) and W (1) with high probability.
Revised: The initial random matrix ˆU 1: k (0) consists of both N (1) and W (1) with high probability.

Original: From the ﬁrst two properties, at every iteration ` , the projection of ˆ U 1: k ( `  1) in W ( ` ) is ampliﬁed more than that on N ( ` ) and thus ˆU 1: k ( L ) becomes very close to W ( L ) after sufﬁciently large L .
Revised: From the first two properties, at every iteration ℓ , the projection of ˆU 1: k ( ℓ − 1) in W ( ℓ ) is amplified more than that on N ( ℓ ) and thus ˆU 1: k ( L ) becomes very close to W ( L ) after sufficiently large L .

Original: From the last property, we can conclude that W ( L ) is close to U 1: k ( L ) , where the distance between W ( L ) and
Revised: From the last property, we can conclude that W ( L ) is close to U 1: k ( L ) , where the distance between W ( L ) and

Original: U 1: k ( L ) is proportional to k E ( L ) k .
Revised: U 1: k ( L ) is proportional to ∥E ( L ) ∥ .

Original: Combining these ideas with Lemma 1 establishes the results.
Revised: Combining these ideas with Lemma 1 establishes the results.

Original: 5.2 Oja’s Algorithm
Revised: 5.2 Oja’s Algorithm

Original: Algorithm 2 Oja’s Algorithm with learning rate ⇣ [48] 1: Input: Stream of vectors: ( x t )
Revised: Algorithm 2 Oja’s Algorithm with learning rate ζ [48] 1: Input : Sample

Original: Tt =1 , learning rate: ⇣ , and dimensions: p, k 2: Sample each element of ˆU (0) in N (0 , 1) 3: fort = 1 : T do 4: ˆU ( t )
Revised: 3: for do 4: ˆU ← Gram

Original: Gram-Schmidt (( I p ⇥ p + ⇣ xt x > t ) ˆU ( t  1)) 5: end for 6:Output: ˆU ( T )
Revised: × x x ⊤ ) ˆU − 5: end for 6:

Original: We now establish the convergence guarantee for Oja’s Algorithm (Algorithm 2) when observations follow the equation (1).
Revised: We now establish the convergence guarantee for Oja’s Algorithm (Algorithm 2) when observations follow the equation (1).

Original: Unlike the noisy power method, Oja’s Algorithm is multiplicative in its construction of the estimated subspace.
Revised: Unlike the noisy power method, Oja’s Algorithm is multiplicative in its construction of the estimated subspace.

Original: We extend the existing analysis for Oja’s algorithm [3, 33, 34] by considering a virtual block with B = B ⇣ = ⇣  1 observations.
Revised: We extend the existing analysis for Oja’s algorithm [3, 33, 34] by considering a virtual block with B = B ζ = ζ − 1 observations.

Original: Building upon the analysis framework for the noisy power method and intuition from binomial approximation (1 + ⇣ x ) 1 / ⇣ ' (1 + x ) we establish the convergence guarantees for Oja’s algorithm.
Revised: Building upon the analysis framework for the noisy power method and intuition from binomial approximation (1 + ζx ) 1 /ζ ≃ (1 + x ) we establish the convergence guarantees for Oja’s algorithm.

Original: Like the previous section, we decompose the block with target M ( ` ) and error matrix E [-
-] ( ` ) as:
Revised: Like the previous section, we decompose the block with target M ( ℓ ) and error matrix E [-
-]′ ( ℓ ) as:

Original: [Equation]
Revised: [Equation]

Original: (10) where E 0 is scaled error matrix.
Revised: where E ′ is scaled error matrix.

Original: In Lemma 2, we provide bound for scaled error matrix with respect to the learning parameter ⇣ , or the virtual block size B ⇣ = ⇣  1 similar to Lemma 1.
Revised: In Lemma 2, we provide bound for scaled error matrix with respect to the learning parameter ζ , or the virtual block size B ζ = ζ − 1 similar to Lemma 1.

Original: The proof is provided in Appendix G.
Revised: The proof is provided in Appendix G.

Original: Lemma 2 (Spectral norm of noise, Oja’s algorithm case) .
Revised: Lemma 2 (Spectral norm of noise, Oja’s algorithm case) .

Original: Assume that the observations ( x t )
Revised: Assume that the observations ( x t )

Original: Tt = generated according to the Assumption 1.
Revised: Tt = generated according to the Assumption 1.

Original: With probability greater than 1  1 /T , the matrices E [-
-] ( ` ) on the equation (10) are bounded by:
Revised: With probability greater than 1 − 1 /T , the matrices E [-
-]′ ( ℓ ) on the equation (10) are bounded by:

Original: [Equation]
Revised: [Equation]

Original: when the virtual block size B ⇣ = ⇣  1 is larger than 2 M 2 log( pT 2 ) .
Revised: when the virtual block size B ζ = ζ − 1 is larger than 2 M 2 log( pT 2 ) .

Original: The difference in parameter M , rather than V , as in the case of Lemma 1 arises due to the use of a different concentration inequality.
Revised: The difference in parameter M , rather than V , as in the case of Lemma 1 arises due to the use of a different concentration inequality.

Original: The estimator of the noisy power method averages the outer product of vectors (equation (10)), making it straightforward to use Bernstein’s inequality.
Revised: The estimator of the noisy power method averages the outer product of vectors (equation (10)), making it straightforward to use Bernstein’s inequality.

Original: On the other hand, Oja’s algorithm averages the product of random matrices rather than the sum of random matrices.
Revised: On the other hand, Oja’s algorithm averages the product of random matrices rather than the sum of random matrices.

Original: Therefore, we introduce the multiplicative concentration inequality [32], which requires the (probabilistic) norm bound for matrices.
Revised: Therefore, we introduce the multiplicative concentration inequality [32], which requires the (probabilistic) norm bound for matrices.

Original: Combining multiplicative concentration inequalities with Lemma 2 and the techniques developed for the noisy power method, we obtain a convergence guarantee for Oja’s algorithm in Theorem 3.
Revised: Combining multiplicative concentration inequalities with Lemma 2 and the techniques developed for the noisy power method, we obtain a convergence guarantee for Oja’s algorithm in Theorem 3.

Original: The complete proof is provided in Appendix H.
Revised: The complete proof is provided in Appendix H.

Original: Theorem 3 (Oja’s algorithm) .
Revised: Theorem 3 (Oja’s algorithm) .

Original: Assume that   0 .
Revised: Assume that δ ≥ 0 .

Original: 71 and  = O
Revised: 71 and Γ = O

Original: (  3 / ( e 3(˜    ) M 2 log( pT 2 ))) .
Revised: ( δ 3 / ( e 3(˜ δ − δ ) M 2 log( pT 2 ))) .

Original: When the observations { x t } Tt =1 satisﬁes the assumption 1, for ⇣  1 = ⇥ ( M 2 / 3 log( pT 2 ) 1 / 3 /  2 / 3 ) we have:
Revised: When the observations { x t } Tt =1 satisfies the assumption 1, for ζ − 1 = Θ( M 2 / 3 log( pT 2 ) 1 / 3 / Γ 2 / 3 ) we have:

Original: [Equation]
Revised: [Equation]

Original: with probability1  2 /T  c ⌦ ( p  k +1)
Revised: with probability

Original:  e  ⌦ ( p ) .
Revised: [Equation] ( p ) .

Original: Unlike the noisy power method, the upper bound in Theorem 3 is O ( p 2 / 3 ) rather than the optimaldependence of O ( p 1 / 3 ) from Theorem 1.
Revised: Unlike the noisy power method, the upper bound in Theorem 3 is O ( p 2 / 3 ) rather than the optimaldependence of O ( p 1 / 3 ) from Theorem 1.

Original: It is unclear whether the upper bound can be improved.
Revised: It is unclear whether the upper bound can be improved.

Original: Sharpening our analysis with a two-phase strategy [33, 39] (wherein the ﬁrst phase identiﬁes a good initial point and the second phase establishes convergence given an initial point) might be an excellent direction for future investigation.
Revised: Sharpening our analysis with a two-phase strategy [33, 39] (wherein the first phase identifies a good initial point and the second phase establishes convergence given an initial point) might be an excellent direction for future investigation.

Original:  Numerical Results
Revised:  Numerical Results

Original: Key observations from Theorem 2 and 3 on each algorithm illustrate; (i) the existence of the optimal block size B and the learning rate ⇣ to obtain the minimum recovery error, and (ii)   3 / 2 dependencies of that optimal B and 1 / ⇣ .
Revised: Key observations from Theorem 2 and 3 on each algorithm illustrate; (i) the existence of the optimal block size B and the learning rate ζ to obtain the minimum recovery error, and (ii) Γ − 3 / 2 dependencies of that optimal B and 1 /ζ .

Original: In order to verify the established results for both algorithms, this section provides the performance of algorithms for various environments.
Revised: In order to verify the established results for both algorithms, this section provides the performance of algorithms for various environments.

Original: We synthesized the A =
Revised: We synthesized the A =

Original: ( A t )
Revised: ( A t )

Original: Tt = and sample X =
Revised: Tt = and sample X =

Original: ( x t )
Revised: ( x t )

Original: Tt =1 from A .
Revised: Tt =1 from A .

Original: We generate ( A t )
Revised: We generate ( A t )

Original: Tt =1 2 R p ⇥ k as the product of three matrices,
Revised: Tt =1 ∈ R p × k as the product of three matrices,

Original: U t 2 St p ( R p ) , D t 2 R p ⇥ k (; diagonal), and V t 2 St k
Revised: U t ∈ St p ( R p ) , D t ∈ R p × k (; diagonal), and V t ∈ St k

Original: ( R k ) .
Revised: ( R k ) .

Original: To obtain the matrix of the next step, we rotate the ﬁrst matrix as U t =
Revised: To obtain the matrix of the next step, we rotate the first matrix as U t =

Original: U t  1 R t ( R t 2 SO( p ) ).
Revised: U t − 1 R t ( R t ∈ SO( p ) ).

Original: The vectors x t are sampled from the model (1).
Revised: The vectors x t are sampled from the model (1).

Original: More details for experimental setup are described in Appendix I.
Revised: More details for experimental setup are described in Appendix I

Original: [Figure]
Revised: [Figure]

Original: Our ﬁrst observation in Figure 1a is that convergence error decreases as the block size increases without any covariance perturbation (  =0 ).
Revised: Our first observation in Figure 1a is that convergence error decreases as the block size increases without any covariance perturbation ( Γ=0 ).

Original: This behavior is expected since increasing the number of past information results in better accuracy guarantees for the recovered space in the absence of a covariance shift.
Revised: This behavior is expected since increasing the number of past information results in better accuracy guarantees for the recovered space in the absence of a covariance shift.

Original: However, if the covariance perturbation exists (  > 0 ), the optimal learning parameter exists, and we have the smaller optimal block size with stronger perturbation.
Revised: However, if the covariance perturbation exists ( Γ > 0 ), the optimal learning parameter exists, and we have the smaller optimal block size with stronger perturbation.

Original: This phenomenon is also expected since an increase in the adversarial budget implies that the past information becomes less relevant.
Revised: This phenomenon is also expected since an increase in the adversarial budget implies that the past information becomes less relevant.

Original: Our observations also corroborate our theoretical results in Theorem 1.
Revised: Our observations also corroborate our theoretical results in Theorem 1.

Original: In Figure 1b, we focus on the optimal value of the block size B and the inverse of the learning rate 1 / ⇣ and its variation with the perturbation budget  .
Revised: In Figure 1b, we focus on the optimal value of the block size B and the inverse of the learning rate 1 /ζ and its variation with the perturbation budget Γ .

Original: We plot the empirically optimal learning rate for the case of the noisy power method and Oja’s algorithm with   2 / 3 .
Revised: We plot the empirically optimal learning rate for the case of the noisy power method and Oja’s algorithm with Γ − 2 / 3 .

Original: We observe that the optimal block size and the inverse learning rate are proportional to   2 / 3 .
Revised: We observe that the optimal block size and the inverse learning rate are proportional to Γ − 2 / 3 .

Original: This experimental dependency of   2 / 3 veriﬁes the theoretically prescribed results in Theorem 2 and 3.
Revised: This experimental dependency of Γ − 2 / 3 verifies the theoretically prescribed results in Theorem 2 and 3.

Original: 6.1 Experiments on Stock Price Dataset
Revised: 6.1 Experiments on Stock Price Dataset

Original: We provide the real-world benchmark using the S&P500 stock market dataset [44] in Kaggle to test our ﬁndings in the non-stationary environment.
Revised: We provide the real-world benchmark using the S&P500 stock market dataset [44] in Kaggle to test our findings in the non-stationary environment.

Original: Refer the Appendix J for the non-stationarity of environments and further experimental details that do not appear in the main paper.
Revised: Refer the Appendix J for the non-stationarity of environments and further experimental details that do not appear in the main paper.

Original: The stream of vectors consisted of 133( = p ) companies’ normalized daily returns.
Revised: The stream of vectors consisted of 133( = p ) companies’ normalized daily returns.

Original: Since each company in S&P500 has a different time horizon of available information, we considered 133 companies with the cost information from Mar.18, 1980, to Jul.22, 2022 ( T =10677 ).
Revised: Since each company in S&P500 has a different time horizon of available information, we considered 133 companies with the cost information from Mar.18, 1980, to Jul.22, 2022 ( T =10677 ).

Original: Then we calculated the ‘daily return,’ which is the difference of adjusted close cost between two days; normalized by the adjusted close cost of the day.
Revised: Then we calculated the ‘daily return,’ which is the difference of adjusted close cost between two days; normalized by the adjusted close cost of the day.

Original: The stream of vectors from the environment can be seen as sampled from time-varying distributions with  ' 0 .
Revised: The stream of vectors from the environment can be seen as sampled from time-varying distributions with Γ ≃ 0 .

Original: The objective is to predict the principal components of the covariance matrix of daily returns as in [4, 54, 61].
Revised: The objective is to predict the principal components of the covariance matrix of daily returns as in [4, 54, 61].

Original: We tested the noisy power method and Oja’s algorithm on the preprocessed stream.
Revised: We tested the noisy power method and Oja’s algorithm on the preprocessed stream.

Original: For the target space A T , we used the k -dimensional subspace consisting of top-k singular vectors of covariance estimator calculated with the ﬁnal 500 samples ( k =1 , . . . 
Revised: For the target space A T , we used the k -dimensional subspace consisting of top-k singular vectors of covariance estimator calculated with the final 500 samples ( k =1 , . . . B or 15ζ − 0. d ( U 1 : k , ̂ U 1 : k ) k= B or 300ζ − 0.

Revised: k=

Revised: B or 150ζ − 0.

Original: The results in Figure 2 indicate that our ﬁndings are also valid in the real-world environment with covariance shifts.
Revised: k= B or 400 ζ − 0. d ( U 1 : k , ̂ U 1 : k ) [Figure]

Revised: [Figure]

Revised: The results in Figure 2 indicate that our findings are also valid in the real-world environment with covariance shifts.

Original: First, each result shows optimal parameters regimes observed at the U-shaped curves on recovery errors.
Revised: First, each result shows optimal parameters regimes observed at the U-shaped curves on recovery errors.

Original: Furthermore, the result on the noisy power method with varying block size B is akin to the recovery error on Oja’s algorithm, plotted with scaled inverse learning rate ⇣  1 .
Revised: Furthermore, the result on the noisy power method with varying block size B is akin to the recovery error on Oja’s algorithm, plotted with scaled inverse learning rate ζ − 1 .

Original: These two observations support the main ﬁndings in Figure 1a.
Revised: These two observations support the main findings in Figure 1a.

Original: We also note that different scaling for each k is natural since we have different spectral gaps  between k -th and k +1 -th spectrums.
Revised: We also note that different scaling for each k is natural since we have different spectral gaps δ between k -th and k +1 -th spectrums.

Original:  Conclusion
Revised:  Conclusion

Original: On the streaming PCA settings with time-varying covariance, we analyzed the fundamental lower bound of the minimax error and estimation errors for the noisy power method and Oja’s algorithm.
Revised: On the streaming PCA settings with time-varying covariance, we analyzed the fundamental lower bound of the minimax error and estimation errors for the noisy power method and Oja’s algorithm.

Original: Under this framework, when no perturbation exists (  =0 ), our theoretical result on a lower limit coincides with the order of the traditional outcome.
Revised: Under this framework, when no perturbation exists ( Γ=0 ), our theoretical result on a lower limit coincides with the order of the traditional outcome.

Original: Furthermore, when perturbation exists (  > 0 ), we have a non-avoidable positive minimax recovery error, although the time horizon becomes arbitrarily long.
Revised: Furthermore, when perturbation exists ( Γ > 0 ), we have a non-avoidable positive minimax recovery error, although the time horizon becomes arbitrarily long.

Original: Next, we found that the noisy power method order-wisely achieves this recovery error and becomes rate-optimal if the  2 = ⌦ ( k  /p ) .
Revised: Next, we found that the noisy power method order-wisely achieves this recovery error and becomes rate-optimal if the σ 2 = Ω( kδ/p ) .

Original: For the optimal learning parameters B or ⇣  1 , we showed that optimal block size and inverse learning rate minimizing recovery error are similar up to a multiplicative factor and proportional to   3 / 2 .
Revised: For the optimal learning parameters B or ζ − 1 , we showed that optimal block size and inverse learning rate minimizing recovery error are similar up to a multiplicative factor and proportional to Γ − 3 / 2 .

Original: Experimental results both on the synthetic data and real-world environments support the theoretical ﬁndings on the learning parameters.
Revised: Experimental results both on the synthetic data and real-world environments support the theoretical findings on the learning parameters.

Original: Although our analysis requires the spectral gap assumption, a recent line of literature considers effective rank [12, 50] as a crucial metric.
Revised: Although our analysis requires the spectral gap assumption, a recent line of literature considers effective rank [12, 50] as a crucial metric.

Original: Therefore, establishing guarantees for robust streaming
Revised: Therefore, establishing guarantees for robust streaming

Original: PCA in terms of effective rank is a perfect direction for future work.
Revised: PCA in terms of effective rank is a perfect direction for future work.

Original: Acknowledgement
Revised: Acknowledgement

Original: This work was supported by Institute of Information & communications Technology Planning &

Original: Evaluation (IITP) grant funded by the Korea government(MSIT)

Original: (No.2022-0-00311, Development of Goal-Oriented Reinforcement Learning Techniques for Contact-Rich Robotic Manipulation of

Original: Everyday Objects;

Original: No.2019-0-

Original: The checklist follows the references. Please read the checklist guidelines carefully for information on how to answer these questions. For each question, change the default [TODO] to [Yes] , [No] , or [N/A] .
Revised: DB and AS were supported by a DARPA Lagrange award.

Original: You are strongly encouraged to include a justiﬁcation to your answer , either by referencing the appropriate section of your paper or providing a brief inline description.

Original: For example:

Original: • Did you include the license to the code and datasets? [Yes] The datasets are public datasets and  the code is MIT license Please do not modify the questions and only use the provided macros for your answers. Note that the
Revised: MJ and SY were supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) grant funded by the Korea government(MSIT)

Original: Checklist section does not count towards the page limit.

Original: In your paper, please delete this instructions block and only keep the Checklist section heading above along with the questions/answers below.

Original: For all authors... (a) Do the main claims made in the abstract and introduction accurately reﬂect the paper’s contributions and scope? [Yes] We explain our new framework and contributions in both abstract and introduction. (b) Did you describe the limitations of your work? [Yes] There is a result which is partially suboptimal compare to the edge works.
Revised: (No.2022-0-00311, Development of Goal-Oriented Reinforcement

Original: We also describe and study the reason for that.

Original: (c) Did you discuss any potential negative societal impacts of your work?

Original: [N/A] (d) Have you read the ethics review guidelines and ensured that your paper conforms to them?

Original: [Yes] 2.

Original: If you are including theoretical results... (a) Did you state the full set of assumptions of all theoretical results?

Original: [Yes] We provide our assumptions on the Section 3 and Assumption(b) Did you include complete proofs of all theoretical results?

Original: [Yes] Detailed Proofs are in the appendix.

Original: If you ran experiments... (a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?

Original: [Yes] Those are included in the supplemental material. (b) Did you specify all the training details (e.g., data splits, hyperparameters, how they were chosen)? [Yes] Those are included in the Appendix. (c) Did you report error bars (e.g., with respect to the random seed after running experiments multiple times)?
Revised: Learning Techniques for Contact-Rich Robotic Manipulation of Everyday Objects; No.2019-0-00075,

Original: [Yes] Yes, we repeated every experiment 10 times and reported error bars or uncertainty markers.

Original: (d) Did you include the total amount of compute and the type of resources used (e.g., type of GPUs, internal cluster, or cloud provider)? [Yes] Those are included in the Appendix. (a) If your work uses existing assets, did you cite the creators? [N/A] (b) Did you mention the license of the assets?
Revised: Artificial Intelligence Graduate School Program(KAIST)).

Original: [N/A] (c) Did you include any new assets either in the supplemental material or as a URL?

Original: [N/A] (d) Did you discuss whether

Original: and how consent was obtained from people whose data you’re using/curating?

Original: [N/A] (e) Did you discuss whether the data you are using/curating contains personally identiﬁable information or offensive content?

Original: [N/A] We only used synthesized random matrix data.

Original: If you used crowdsourcing or conducted research with human subjects... (a) Did you include the full text of instructions given to participants and screenshots, if applicable?

Original: [N/A] (b) Did you describe any potential participant risks, with links to Institutional Review Board (IRB) approvals, if applicable?

Original: [N/A] (c) Did you include the estimated hourly wage paid to participants and the total amount spent on participant compensation?

Original: [N/A]