Abstract:
Methods and systems for estimating differential or difference equations that can govern a nonlinear, time-varying and parameter-varying dynamic process or system. The methods and systems for estimating the equations may be based upon estimations of observed outputs and, when desired, input data for the equations. The methods and systems can be utilized with any system or process that may be capable of being described with nonlinear, time-varying and parameter-varying difference equations and can used for automated extraction of the difference equations in describing detailed system or method behavior for use in system control, fault detection, state estimation and prediction and adaptation of the same to changes in a system or method.

Description:
CROSS-REFERENCE APPLICATIONS 
       [0001]    The present invention claims priority under 35 U.S.C. §120 to U.S. Provisional Patent Application No. 61/239,745, filed on Sep. 3, 2009, the disclosure of which is incorporated by reference herein in its entirety. 
     
    
     BACKGROUND 
       [0002]    The modeling of nonlinear and time-varying dynamic processes or systems from measured output data and possibly input data is an emerging area of technology. Depending on the area of theory or application, it may be called time series analysis in statistics, system identification in engineering, longitudinal analysis in psychology, and forecasting in financial analysis. 
         [0003]    In the past there has been the innovation of subspace system identification methods and considerable development and refinement including optimal methods for systems involving feedback, exploration of methods for nonlinear systems including bilinear systems and linear parameter varying (LPV) systems. Subspace methods can avoid iterative nonlinear parameter optimization that may not converge, and use numerically stable methods of considerable value for high order large scale systems. 
         [0004]    In the area of time-varying and nonlinear systems there has been work undertaken, albeit without the desired results. This work is typical of the present state of the art in that rather direct extensions of linear subspace methods are used for modeling nonlinear systems. This approach expresses the past and future as linear combinations of nonlinear functions of past inputs and outputs. One consequence of this approach is that the dimension of the past and future expand exponentially in the number of measured inputs, outputs, states, and lags of the past that are used. When using only a few of each of these variables, the dimension of the past can number over 10 4  or even more than 10 6 . For typical industrial processes, the dimension of the past can easily exceed 10 9  or even 10 12 . Such extreme numbers result in inefficient exploitation and results, at best. 
         [0005]    Other techniques use an iterative subspace approach to estimating the nonlinear teems in the model and as a result require very modest computation. This approach involves a heuristic algorithm, and has been used for high accuracy model identification in the case of LPV systems with a random scheduling function, i.e. with white noise characteristics. One of the problems, however, is that in most LPV systems the scheduling function is usually determined by the particular application, and is often very non-random in character. In several modifications that have been implemented to attempt to improve the accuracy for the case of nonrandom scheduling functions, the result is that the attempted modifications did not succeed in substantially improving the modeling accuracy. 
         [0006]    In a more general context, the general problem of identification of nonlinear systems is known as a general nonlinear canonical variate analysis (CVA) procedure. The problem was illustrated with the Lorenz attractor, a chaotic nonlinear system described by a simple nonlinear difference equation. Thus nonlinear functions of the past and future are determined to describe the state of the process that is, in turn used to express the nonlinear state equations for the system. One major difficulty in this approach is to find a feasible computational implementation since the number of required nonlinear functions of past and future expand exponentially as is well known. This difficulty has often been encountered in finding a solution to the system identification problem that applies to general nonlinear systems. 
         [0007]    Thus, in some exemplary embodiments described below, methods and systems may be described that can achieve considerable improvement and also produce optimal results in the case where a ‘large sample’ of observations is available. In addition, the method is not ‘ad hoc’ but can involve optimal statistical methods. 
       SUMMARY 
       [0008]    One exemplary embodiment describes a method for utilizing nonlinear, time-varying and parameter-varying dynamic processes. The method may be used for generating reduced models of systems having time varying elements. The method can include steps for expanding state space difference equations; expressing difference equations as a linear, time-invariant system in terms of outputs and augmented inputs; and estimating coefficients of the state equations. 
         [0009]    Another exemplary embodiment may describe a system for estimating a set of equations governing nonlinear, time-varying and parameter-varying processes. The system can have a first input, a second input, a feedback box and a time delay box. Additionally, in the system, the first input and the second input may be passed through the feedback box to the time delay box to produce an output. 
     
    
     DETAILED DESCRIPTION 
       [0010]    Aspects of the present invention are disclosed in the following description and related figures directed to specific embodiments of the invention. Those skilled in the art will recognize that alternate embodiments may be devised without departing from the spirit or the scope of the claims. Additionally, well-known elements of exemplary embodiments of the invention will not be described in detail or will be omitted so as not to obscure the relevant details of the invention. 
         [0011]    As used herein, the word “exemplary” means “serving as an example, instance or illustration.” The embodiments described herein are not limiting, but rather are exemplary only. It should be understood that the described embodiments are not necessarily to be construed as preferred or advantageous over other embodiments. Moreover, the terms “embodiments of the invention”, “embodiments” or “invention” do not require that all embodiments of the invention include the discussed feature, advantage or mode of operation. 
         [0012]    Further, many embodiments are described in terms of sequences of actions to be performed by, for example, elements of a computing device. It will be recognized that various actions described herein can be performed by specific circuits (e.g., application specific integrated circuits (ASICs)), by program instructions being executed by one or more processors, or by a combination of both. Additionally, these sequence of actions described herein can be considered to be embodied entirely within any form of computer readable storage medium having stored therein a corresponding set of computer instructions that upon execution would cause an associated processor to perform the functionality described herein. Thus, the various aspects of the invention may be embodied in a number of different forms, all of which have been contemplated to be within the scope of the claimed subject matter. In addition, for each of the embodiments described herein, the corresponding form of any such embodiments may be described herein as, for example, “logic configured to” perform the described action. 
         [0013]    Generally referring to exemplary  FIGS. 1-6 , methods and systems for empirical modeling of time-varying, parameter-varying and nonlinear difference equations may be described. The methods and systems can be implemented and utilized to provide for a variety of results and which may be implemented efficiently. 
         [0014]    As shown in exemplary  FIG. 1 , a flow chart of a methodology for empirical modeling of time-varying, parameter varying and nonlinear difference equations according to an exemplary embodiment may be shown. Here, in  102 , a set of time-varying, parameter varying and, if desired, nonlinear state space difference equations may be utilized. In  104 , the equations may then be expanded with respect to a chosen set of basis functions, for example nonlinear input-output equations may be expanded in polynomials in x t  and u t . Then, in  106 , difference equations may then be expressed as a linear time-invariant, for example, in terms of outputs y t  and augmented inputs u t , which can include inputs u t  and basis functions, for example polynomials, in inputs u t  scheduling functions p t  and states x t . 
         [0015]    Exemplary  FIG. 2  may show an exemplary flow chart where a linear, parameter varying system of difference equations may be utilized. In this embodiment in  202  a set of linear parameter varying state space equations, such as those shown below as equation 1 and equation 2, may be used. 
         [0000]        x   t+1   =A   { }   x   t   +B   { }   u   t   +[A   1 ρ t (1)+ . . . + A   s ρ t ( s )] x   t   +[B   1 ρ t (1)+ . . . + B   S ρ t ( s )] u   t   (Equation 1)
 
         [0000]        y   t   =C   0   x   t   +D   0   u   t   +[C   1 ρ t (1)+ . . . + C   s ρ( s )] x   t   +[D   1 ρ t (1)+ . . . + D   s ρ t ( s )] u   t   (Equation 2)
 
         [0016]    Then, in  204 , the state space difference equations may be expanded with respect to polynomials in the scheduling function p t , states x t  and inputs u t , for example as shown in equations 3 and 4 below. 
         [0000]        x   t+1   =A   ( )   x   t   +B   ( )   u   t   +[A   1    . . . A   s ](ρ t             x   t )+[ B   t    . . . B   s ](ρ t             u   t )  (Equation 3)
 
         [0000]        y   t   =C   o   x   t   +D   o   u   t   +[C   1    . . . C   s ](ρ t             x )+[ D   1    . . . D   s ](ρ t             u   t )  (Equation 4)
 
         [0017]    Next, in  206 , the difference equations can be expressed in terms of original outputs y t  and augmented inputs [u t ,(p t           x t ),(p t           u t )] that are functions of u t , x t  and p t . Difference equations can have linear time-invariant unknown (A 0 ,[B 0 A ρ B ρ ],C 0 ,[D 0 C 92  D ρ ]) coefficients that can be estimated, and as shown in equations 5 and 6 below. 
         [0000]    
       
         
           
             
               
                 
                   
                     x 
                     
                       t 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       
                         A 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         [ 
                         
                           
                             
                               
                                 B 
                                 0 
                               
                             
                             
                               
                                 A 
                                 ρ 
                               
                             
                             
                               
                                 B 
                                 ρ 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 u 
                                 t 
                               
                             
                           
                           
                             
                               
                                 
                                   ρ 
                                   t 
                                 
                                 ⊗ 
                                 
                                   x 
                                   t 
                                 
                               
                             
                           
                           
                             
                               
                                 
                                   ρ 
                                   t 
                                 
                                 ⊗ 
                                 
                                   u 
                                   t 
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     5 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     y 
                     t 
                   
                   = 
                   
                     
                       
                         C 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         [ 
                         
                           
                             
                               
                                 D 
                                 0 
                               
                             
                             
                               
                                 C 
                                 ρ 
                               
                             
                             
                               
                                 D 
                                 ρ 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 u 
                                 t 
                               
                             
                           
                           
                             
                               
                                 
                                   ρ 
                                   t 
                                 
                                 ⊗ 
                                 
                                   x 
                                   t 
                                 
                               
                             
                           
                           
                             
                               
                                 
                                   ρ 
                                   t 
                                 
                                 ⊗ 
                                 
                                   u 
                                   t 
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     6 
                   
                   ) 
                 
               
             
           
         
       
     
         [0018]    Then, as shown in  208 , the augmented inputs [u t ,(ρ t           x t ), (ρ t           u t )], and, in some exemplary embodiments, specifically ρ t           x t , can involve an unknown state x t  vector, so iteration may be utilized or desired. Thus, in such exemplary embodiments, iteration using an iterated algorithm, as described in further detail below, may be utilized. 
         [0019]    Exemplary  FIG. 3  can show a flow chart of an iterated algorithm that may be implemented for iterated subspace identification. In this embodiment, and as seen in  302 , nonlinear difference equations can be expanded in additive basis functions and expressed in linear time-invariant form with augmented inputs u t . This can include, in some examples, nonlinear basis functions involving outputs, state and scheduling functions. 
         [0020]    Then, in  304 , the state estimate {circumflex over (x)} t   [0]  is unknown that is equivalent to (A ρ C ρ ) term not in the LPV model, so the corresponding terms may be deleted from the set of augmented inputs ũ t . The iterated algorithm may then be implemented using augmented inputs as the inputs and can compute estimates {circumflex over (Θ)} [1]  of the model parameters. Then, using, for example, a Kalman filter at the estimated parameter values {circumflex over (Θ)} [1] , the state estimates {circumflex over (x)} t   [1]  can be computed along with the one-step prediction innovations. Then the likelihood function can be evaluated. 
         [0021]    Next, in  306 , an iteration k for k≧2 may be made. Here the state estimate {circumflex over (x)} t   [k−1]  may be initialized for all t. The iterative algorithm may then be implemented using the augmented inputs as the inputs and can compute estimates {circumflex over (Θ)} [k]  of the parameters. Again, for example, using a Kalman filter at the estimated parameter values {circumflex over (Θ)} [k] , the state estimates {circumflex over (x)} t   [k]  may be computed. The one-step prediction innovations may also be made and the likelihood ρ(Y 1:N |Ũ 1:N ;{circumflex over (Θ)} [k] ) may also be evaluated. 
         [0022]    In  308  the convergence can be checked. Here the change in the values of the log likelihood function and the state orders between iteration k−1 and iteration k can be compared. If, in some examples, the state order is the same and the log likelihood function change is less than a chosen threshold β. This threshold in many examples may be less than one, for example 0.01, then the iterations may end or be stopped. Otherwise, where the value is above a chosen threshold β, step  306  above may be returned to and iteration k+1 may be performed. Following the performance of iteration k+1, the convergence may then be checked again. 
         [0023]    In another exemplary embodiment, a different approach may be taken to directly and simply obtain optimal or desired estimates of the unknown parameters for the case of autocorrelated errors and feedback in the system using, for example, subspace methods developed for linear time-invariant systems. This may be done by expressing the problem in a different form that can lead to a desire to iterate on the state estimate; however, the number of iterations may be very low, and, to further simplify the system and its development, stochastic noise may be removed. 
         [0024]    For example, consider a linear system where the system matrices are time varying functions of a vector of scheduling parameters ρ t =(ρ t (1) ρ t (2) . . . ρ t (s)) T  of the forms as shown in the equations below: 
         [0000]        x   t+1   =A (ρ t ) x   t   +B (ρ t ) u   t   (Equation 7)
 
         [0000]        y   t   =C (ρ t ) x   t   +D (ρ t ) u   t   (Equation 8)
 
         [0025]    For affine dependence on the scheduling parameters, the state space matrices can have the form of the following equations 9 through 12. 
         [0000]    
       
         
           
             
               
                 
                   
                     A 
                      
                     
                       ( 
                       
                         ρ 
                         t 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       A 
                       0 
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         s 
                       
                        
                       
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           A 
                           i 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     9 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     B 
                      
                     
                       ( 
                       
                         ρ 
                         t 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       B 
                       0 
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         s 
                       
                        
                       
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           B 
                           i 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     10 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     C 
                      
                     
                       ( 
                       
                         ρ 
                         t 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       C 
                       0 
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         s 
                       
                        
                       
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           C 
                           i 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     11 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     D 
                      
                     
                       ( 
                       
                         ρ 
                         t 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       D 
                       0 
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         s 
                       
                        
                       
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           D 
                           i 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     12 
                   
                   ) 
                 
               
             
           
         
       
     
         [0026]    In the above equations, it may be noted that where the matrices on the left hand side are expressed as linear combinations (1 ρ t (1)ρ t (2) . . . ρ t (s)) T  on the right hand side specified by the scheduling parameters ρ t , which may be called an affine form. In further discussion, the notation will be used for the system matrix A=[A 0 A 1  . . . A s ]=[A 0 A ρ ] and similarly for B, C, and D. 
         [0027]    In some further exemplary embodiments, system identification methods for the class of LPV systems can have a number of potential applications and economic value. Such systems can include, but are not limited to, aerodynamic and fluid dynamic vehicles, for example aircraft and ships, automotive engine dynamics, turbine engine dynamics, chemical processes, for example stirred tank reactors and distillation columns, amongst others. One feature can be that at any given operating point ρ t  the system dynamics can be described as a linear system. The scheduling parameters ρ t  may be complex nonlinear functions of operating point variables, for example, but not limited to, speed, pressures, temperatures, fuel flows and the like, that may be known or accurately measured variables that characterize the system dynamics within possibly unknown constant matrices A, B, C and D. It may also be assumed that ρ t  may be computable or determinable from the knowledge of any such operating point variables. For example LPV models of automotive engines can involve the LPV state space equations that explicitly express the elements of the vector ρ t  as very complex nonlinear functions of various operating point variables. In some exemplary embodiments described herein, it may only be desired that the scheduling parameter ρ t  may be available when the system identification computations are performed. This can be a relaxation of the real-time use or requirement for such applications as real-time control or filtering. 
         [0028]    To simplify the discussion, the LPV equations can be written in time-invariant form by associating the scheduling parameter ρ t  with the inputs u t  and states x t  as 
         [0000]        x   t+1   =A   0   x   t   +B   0   u   t   +[A   1    . . . A   s ](ρ t             x   t )+[ B   1    . . . B   s ](ρ t             u   t )  (Equation 13)
 
         [0000]        y   t   =C   0   x   t   +D   0   u   t   +[C   1    . . . C   s ](ρ t             x   t )+[ D   1    . . . D   s ](ρ t             u   t )  (Equation 14)
 
         [0029]    Here,           can denote the Kronecker product M         N, defined for any matrices M and N as the partitioned matrix formed from blocks of i,j as (M         N) i,j =m i,j N with the i,j element of M denoted as m i,j . Also, the notation [M;N]=[M T N T ] T  can be used for stacking the vectors or matrices M and N. Equations 13 and 14 above can then also be written as shown below in the formats of equations 15 and 16. 
         [0000]    
       
         
           
             
               
                 
                   
                     x 
                     
                       t 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       
                         A 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         [ 
                         
                           
                             
                               
                                 B 
                                 0 
                               
                             
                             
                               
                                 A 
                                 ρ 
                               
                             
                             
                               
                                 B 
                                 ρ 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 u 
                                 t 
                               
                             
                           
                           
                             
                               
                                 ( 
                                 
                                   
                                     ρ 
                                     t 
                                   
                                   ⊗ 
                                   
                                     x 
                                     t 
                                   
                                 
                                 ) 
                               
                             
                           
                           
                             
                               
                                 ( 
                                 
                                   
                                     ρ 
                                     i 
                                   
                                   ⊗ 
                                   
                                     u 
                                     t 
                                   
                                 
                                 ) 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   15 
                   ) 
                 
               
             
             
               
                 
                   
                     y 
                     t 
                   
                   = 
                   
                     
                       
                         C 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         [ 
                         
                           
                             
                               
                                 D 
                                 0 
                               
                             
                             
                               
                                 C 
                                 ρ 
                               
                             
                             
                               
                                 D 
                                 ρ 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 u 
                                 t 
                               
                             
                           
                           
                             
                               
                                 ( 
                                 
                                   
                                     ρ 
                                     t 
                                   
                                   ⊗ 
                                   
                                     x 
                                     t 
                                   
                                 
                                 ) 
                               
                             
                           
                           
                             
                               
                                 ( 
                                 
                                   
                                     ρ 
                                     i 
                                   
                                   ⊗ 
                                   
                                     u 
                                     t 
                                   
                                 
                                 ) 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   16 
                   ) 
                 
               
             
           
         
       
     
         [0030]    As discussed in more detail below, the above equations can be interpreted as a linear time-invariant (LTI) system with nonlinear feedback of ƒ t =[(ρ t           x t );(ρ t           u t )] where the states x t  and inputs u t  can be multiplied by the time varying scheduling parameters ρ t . The feedback ƒ t  inputs can now be considered as actual inputs to the LTI system. As shown in further detail below, the matrices [A ρ B ρ ;C ρ D ρ ] of the LPV system description can be the appropriate quantities to describe the LTI feedback representation of the LPV system. 
         [0031]    Further, the above equations may now be described as shown below in equations 17 and 18. 
         [0000]        x   t+1   =Ãx   t   {tilde over (B)}ũ   t   (17)
 
         [0000]        y   t   ={tilde over (C)}x   t   +{tilde over (D)}ũ   t   (18)
 
         [0032]    Thus for measurements of outputs {tilde over (y)} t =y t  and inputs ũ t =[u t   T (ρ t           x t ) T (ρ t           u t ) T ] T  the time-invariant matrices can be (Ã,{tilde over (B)},{tilde over (C)},{tilde over (D)})=(A 0 ,[B 0 A ρ B ρ ],C 0 ,[B 0 C ρ D ρ ]) respectively. Also, in situations where x t  in ρ t           x t  may not be a known or measured quantity, a prior estimate of x t  may be available or utilized and iterations may be used to obtain a more accurate or desired estimate of x t . 
         [0033]    In still further exemplary embodiments, an LPV system can be expressed as a linear time-invariant system with nonlinear internal feedback that can involve the known parameter varying functions ρ t . (see, Section 2.1 of Nonlinear System Identification:  A State - Space Approach , Vincent Verdult, 2002, Ph.D. thesis, University of Twente, The Netherlands, the contents of which are hereby incorporated by reference in their entirety). In this exemplary embodiment the system matrices P i  of rank r i  may be factored for each i with 1≦i≦s using a singular value decomposition, such as that shown in equation 19. 
         [0000]    
       
         
           
             
               
                 
                   
                     P 
                     i 
                   
                   = 
                   
                     
                       [ 
                       
                         
                           
                             
                               A 
                               i 
                             
                           
                           
                             
                               B 
                               i 
                             
                           
                         
                         
                           
                             
                               C 
                               i 
                             
                           
                           
                             
                               D 
                               i 
                             
                           
                         
                       
                       ] 
                     
                     = 
                     
                       
                         [ 
                         
                           
                             
                               
                                 B 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                           
                             
                               
                                 D 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 C 
                                 
                                   z 
                                   , 
                                   i 
                                 
                               
                             
                             
                               
                                 D 
                                 
                                   z 
                                   , 
                                   i 
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     19 
                   
                   ) 
                 
               
             
           
         
       
     
         [0034]    The quantities may then be defined as the following, shown in equations 20 through 23. 
         [0000]      B f =└B f,1 B f,2  . . . B f,s ┘  (Equation 20)
 
         [0000]      D f =└D f,1 D f,2  . . . D f,s ┘  (Equation 21)
 
         [0000]      C z   T =[C z,1   T C z,2   T  . . . C z,s   T ]  (Equation 22)
 
         [0000]      D z   T =[D z,1   T D z,2   T  . . . D z,s   T ]  (Equation 23)
 
         [0035]    Next, internal feedback in the LTI system P 0 =[A 0 B 0 ;C 0 D 0 ] may be considered with outputs z t +C z x t +D z u t  and with nonlinear feedback from z t  to ƒ t =ρ t           z t  entering the LTI system P 0  state equations through the input matrices B f  and D f . The state equations for x t+1  and y t  of the feedback system may be shown below in equations 24 through 27. 
         [0000]        x   t   =A   0   x   t   +B   o   u   t   +B   f ƒ t   (Equation 24)
 
         [0000]        y   t   =C   0   x   t   +D   o   u   t   +D   f ƒ t   (Equation 25)
 
         [0000]        z   t   =C   z   x   t   +D   z   u   t   (Equation 26)
 
         [0000]      ƒ t =[p t           z t ]  (Equation 27)
 
         [0036]    With respect to the above and referring now to exemplary  FIG. 4 , if it can be assumed that for any time t there is no effect of the feedback ƒ t  on the output z t  as in the feedback structure shown in  FIG. 4  and in equation 26, then there is no parameter dependence in the linear fractional transformation (LFT) description (see K. Zhou, J. Doyle, and K. Glover (1996),  Robust and Optimal Control , Prentice-Hall, Inc., Section 10.2, the contents of which are hereby incorporated by reference in their entirety). As shown in  FIG. 4 , there may be a system  400  having two boxes, box  404  which may be a memory-less nonlinear feedback system and box  402  that can be a linear time-invariant system. Therefore, in some exemplary embodiments, the parameter dependence can become affine. 
         [0037]    Exemplary  FIG. 4  may be a schematic diagram of Equations 15 and 16. The state Equation 15 involves the upper boxes in  402  while the measurement Equation 16 involves the lower boxes in  402 . ΔT  422  is a time delay of sample duration with the right hand side of Equation 15 at  444  entering  422  and the left hand side equal to state x t+1  at leaving. This is a recursion formula similar to equations 14 and 15, so the time index can be changed from “t” to “t+1” for the figure before the start of the next iteration and continuing until entering boxes  420 ,  430  and  410 . Scheduling parameters ρ t    406 , inputs u t    408  and outputs y t    446  are variables The upper four boxes are multiplication from left to right by B 0    418 , A 0    420 , B ρ   414 , A ρ   416 , respectively. Similarly, the lower boxes are multiplication with A replaced by C and B replaced by D, depicted as D ρ   424 , C ρ   426 , D 0    428  and C 0    430 . In the feedback box  404 , the Kronecker products involving p, and successively x t  and u t  are formed in  410  and  412  respectively. The pairs of boxes aligned vertically are multiplying respectively from left to right the variables x t , u t , ρ t           x t  and ρ t           . Additionally, arrows shown as touching a wire can symbolize addition. Further, ΔT  422  can represent a time delay block of duration ΔT that can act similar to a date line for this exemplary embodiment. Therefore the arrows in exemplary  FIG. 4  indicate a time flow or an actual sequence of operations, the flow may start at  406 ,  408  and the output of  422  and proceed through the diagram. Upon reaching ΔT  422 , all operations for sample t have been performed and, upon crossing through ΔT  422 , sample time t+1 may begin. Thus, for example, upon leaving ΔT  422 , the same quantity is maintained, but all of the time labels can be changed to t+1 throughout the process shown in exemplary  FIG. 4 . 
         [0038]    Further, as shown below, this can be equivalent to the LPV form shown in equations 15 and 16 where the state equations can be linear in the scheduling parameter vector ρ. 
         [0039]    In further exemplary embodiments and now using a definition of feedback defined as ƒ t =ρ t           z, as given by equations 26 and 27, the state equations for x t+1  and y t  may be as shown in equations 28 and 29 below. 
         [0000]    
       
         
           
             
               
                 
                   
                     x 
                     
                       t 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       
                         A 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         B 
                         0 
                       
                        
                       
                         u 
                         t 
                       
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         S 
                       
                        
                       
                         
                           B 
                           
                             f 
                             , 
                             i 
                           
                         
                          
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           C 
                           
                             z 
                             , 
                             i 
                           
                         
                          
                         
                           x 
                           t 
                         
                       
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         S 
                       
                        
                       
                         
                           B 
                           
                             f 
                             , 
                             i 
                           
                         
                          
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           D 
                           
                             z 
                             , 
                             i 
                           
                         
                          
                         
                           u 
                           k 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     28 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     y 
                     t 
                   
                   = 
                   
                     
                       
                         C 
                         0 
                       
                        
                       
                         x 
                         t 
                       
                     
                     + 
                     
                       
                         D 
                         0 
                       
                        
                       
                         u 
                         t 
                       
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         S 
                       
                        
                       
                         
                           D 
                           
                             f 
                             , 
                             i 
                           
                         
                          
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           C 
                           
                             z 
                             , 
                             i 
                           
                         
                          
                         
                           x 
                           t 
                         
                       
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         S 
                       
                        
                       
                         
                           D 
                           
                             f 
                             , 
                             i 
                           
                         
                          
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           D 
                           
                             z 
                             , 
                             i 
                           
                         
                          
                         
                           u 
                           k 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     29 
                   
                   ) 
                 
               
             
           
         
       
     
         [0040]    Then, if equation 19 is used to define the above factors, equations 28 and 29 may be the same as equations 15 and 16. 
         [0041]    Next, in a further exemplary embodiment, as the rank of P i  may not be known, the outputs z t  may be set as the states and inputs z t [x t   T ;u t   T ] T  that may subsequently be fed back through the static nonlinearity so that ƒ t =[ρ t           x t ;ρ t           u t ]. Then └C z,i D z,i ┘=[I dim x 0;0I dim u ] and equations 30 and 31 may be set as below. 
         [0000]    
       
         
           
             
               
                 
                   
                     P 
                     i 
                   
                   = 
                   
                     
                       [ 
                       
                         
                           
                             
                               A 
                               i 
                             
                           
                           
                             
                               B 
                               i 
                             
                           
                         
                         
                           
                             
                               C 
                               i 
                             
                           
                           
                             
                               D 
                               i 
                             
                           
                         
                       
                       ] 
                     
                     = 
                     
                       
                         [ 
                         
                           
                             
                               
                                 B 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                           
                             
                               
                                 D 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 C 
                                 
                                   z 
                                   , 
                                   i 
                                 
                               
                             
                             
                               
                                 D 
                                 
                                   z 
                                   , 
                                   i 
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     30 
                   
                   ) 
                 
               
             
             
               
                 
                   = 
                   
                     
                       
                         [ 
                         
                           
                             
                               
                                 B 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                           
                             
                               
                                 D 
                                 
                                   f 
                                   , 
                                   i 
                                 
                               
                             
                           
                         
                         ] 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 I 
                                 
                                   dim 
                                    
                                   
                                       
                                   
                                    
                                   x 
                                 
                               
                             
                             
                               0 
                             
                           
                           
                             
                               0 
                             
                             
                               
                                 I 
                                 
                                   dim 
                                    
                                   
                                       
                                   
                                    
                                   u 
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                     = 
                     
                       [ 
                       
                         
                           
                             
                               B 
                               
                                 f 
                                 , 
                                 i 
                               
                             
                           
                         
                         
                           
                             
                               D 
                               
                                 f 
                                 , 
                                 i 
                               
                             
                           
                         
                       
                       ] 
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     31 
                   
                   ) 
                 
               
             
           
         
       
     
         [0042]    Thus, from the above, the LPV coefficient matrix P i =[A i B i ;C i D i ] can be the regression matrix of the left hand side state equation variables (x t+1 ;y t ) on the vector of nonlinear terms [ρ i,t x t ;ρ i,t u t ]. More generally, the LPV coefficient matrix P ρ =[A ρ B ρ ;C ρ D ρ ]=[B f ;D f ] can be the regression matrix of the left hand side state equation variables (x t+1 ;y t ) on the vector of nonlinear feedback terms (ρ t           x t ;ρ t           u t ). 
         [0043]    The LTI nonlinear feedback representation can solve a major barrier to applying existing subspace identification algorithms to the identification of LPV systems and overcomes previous problems with exponentially growing numbers of nonlinear terms used in other methods. For example, the above LTI nonlinear feedback representation can make it clear that nonlinear terms (ρ t           x t ;ρ t           u t ) can be interpreted as inputs to an LTI nonlinear feedback system. Therefore it may be possible to directly estimate the matrices of the LTI system state space equations using linear subspace methods that can be accurate for processes with inputs and feedback. This can directly involve the use of the outputs y t  as well as augmented inputs [u t ;(ρ t           x t ;ρ t           u t )] of the LTI nonlinear feedback system. 
         [0044]    In another exemplary embodiment, LTI system matrices and state vectors may be determined following the reduction of an LTI subsystem of a nonlinear feedback system involving known scheduling functions and the state of the LTI subsystem. This embodiment can involve taking the iterative determination of both the LTI system state as well as the LTI state space matrices describing the LTI system. 
         [0045]    One example may be to consider the polynomial system as a linear system in x and u with additional additive input terms in the higher order product terms so the additional inputs are ρ t           x t  and ρ t           u t . The scheduling variables p t  are assumed to be available in real time as operating points or measured variables. If accurate estimates of the state x t  are also available, then the problem could be only a direct application of the iterative algorithm for system identification. Since the variables x t  are not available until after the solution of the system identification, a different approach may be utilized. 
         [0046]    Thus, in an exemplary first step, an initial estimate of the state vector may be made. Here, system identification may be performed on the terms in the state equations involving the variables x t , u t  and ρ t           u t  but not the variables ρ t           x t . From this an approximation of the linear time invariant (LTI) part of the system giving estimates of A 0 , B 0 , C 0 , D 0 , B ρ , and D ρ  as well as estimates for the state vectors X 1,N [1]=[x t   T x 2   T  . . . x N   T ] T  may be obtained. 
         [0047]    Then, in an exemplary second step, an iterate estimate of the state vectors may be made. Here the state vector X 1,N   [1]  can be used as an initial estimates for x t  in the terms ρ t           x t  in equations 15 and 16. Then the iterative algorithm can be applied to obtain an estimate of the system matrices A, B, C, and D and a refined estimate of X 1,N   [2] . Further, this step may then be iterated until a desired convergence is achieved. 
         [0048]    Exemplary steps one through three above may therefore work with only a few iterations. Thus, in an exemplary manner in which the iterative algorithm can be used to address the previously known problem of LPV system identification. Thus, the following is an exemplary discussion of using the iterative algorithm in directly identifying the coefficients F ij  and H ij  of the additive polynomial expansions of the nonlinear difference equation functions ƒ(X t ,U t ,V t ) and h(X t ,U t ,V t ,), respectively. This may be a very compact and parsimonious parameterization for such a nonlinear system. The iterative algorithm described herein for linear time-invariant systems can therefore be used with only a very modest increase in computational requirements. Further, this exemplary use of the iterative algorithm to directly treat additive nonlinear terms in the state equations involving the state vector such as ρ t           x t  as additional inputs. Since the state x t  may not be initially known, this may facilitate iteration to estimate the state sequence starting with only the linear time invariant (LTI) part of the system, A 0 , B 0 , C 0  and D 0 . 
         [0049]    As seen in the above exemplary discussion following equations 13 and 14, a linear parameter varying system that can be affine in the scheduling variables ρ t  can be expressed in time invariant form involving the additional input variables ρ t           x t  and ρ t           u t . Note that this involves nonlinear functions of ρ t  with x t  and u t . The dynamic system can be linear time-invariant in these nonlinear functions of the variables. 
         [0050]    In a further exemplary embodiment, the effect of additional inputs can be traced through the iterative algorithm. The exemplary steps outlined below may further be reflected in the table shown in exemplary  FIG. 5  and the flow chart of exemplary  FIG. 6 . 
         [0051]    Using elements  502  of exemplary  FIG. 5  and in step  602  of exemplary  FIG. 6 , an ARX model may be fitted to the observations on iteration k with outputs y t  and inputs [u t   T (ρ t           {circumflex over (x)} t   [k−1] ) T (ρ t           u t ) T ] T , where for k=1 the term ρ t           {circumflex over (x)} t   [k−1]  may be absent from the inputs and further can be the equivalent to removing the term involving (A ρ C ρ ) from the LPV model structure. The ARX model fitting can have a linear regression problem that makes no prior assumptions on the ARX order other than the maximum ARX order considered. If the identified ARX order is near a maximum considered, the maximum ARX order considered can be doubled and the regression recomputed. 
         [0052]    In exemplary step  604  a corrected future can be computed. The effect of future inputs on future outputs can be determined using the ARX model and subtracted from the outputs. The effect of this can be to compute the future outputs that could be obtained from the state at time t if there were no inputs in the future of time t. 
         [0053]    In exemplary step  606 , a canonical variate analysis (CVA) can be made or computed. Here, the CVA between the past and the corrected future can be computed. Again, the covariance matrices among and between the past and corrected future may also be computed. This may be similar to an SVD on the joint past-future covariance matrix which is of the order of the covariance of the past to obtain the ARX model. A result of this step is to obtain estimates of the states of the system called ‘memory’. 
         [0054]    In exemplary step  608 , a regression using the state equation may be performed. The ‘memory’ from step  606  can be used in the state equations as if it were data and resulting estimates of the state space matrices and covariance matrices of the noise processes can be obtained. These estimates can be asymptotically ML estimates of the state space model with no prior assumptions on the parameter values of the ARX or SS model. 
         [0055]    Thus, using the above-described methodology, the ML solution in the iterative algorithm can be obtain in one computation based on the assumed outputs and inputs in iteration k, as shown in  504  of exemplary  FIG. 5 , with no iteration on assumed parameter values. The iteration is the result of refinement of the state estimate in the nonlinear term (ρ t           {circumflex over (x)} t   [k−1] ) T  that can be part of the assumed data in the iteration k ( 504 ). 
         [0056]    Referring back to step  602 , the ARX model fitting, the dimension of the augmented outputs is increased from dimu to dimua=dimu+dimp(dimx+dimu). To fit the ARX model, the ARX order lagp identified can be substantially higher due to the nonlinear input terms and depending on the statistically significant dynamics present among the output and augmented input variables. The computation can involve computation of an SVD on the data covariance matrix that is dimension of the dimua*lagp where lagp is the maximum ARX order considered. The computation that may be utilized for the SVD is of the order of 60*(dimua*lagp) 3 , so the computation increases proportional to (dimp(dimx+dimu)/dimu) 3 . 
         [0057]    Therefore, one consequence of augmenting the system inputs by the nonlinear terms ρ t           x t  and ρ t           u t  may be to increase the past by a factor dimp(dimx+dimu)/dimu, and to increase the computation by this factor cubed. Depending on the particular dimensions of u t , x t , and ρ t , this can be very significant, however there is no exponential explosion in the number of terms or the computation time. The LPV subspace algorithm of this invention still corresponds to subspace system identification for a linear time-invariant system and, in addition, because of the nonlinearity of the terms [u t   T (ρ t           x t ) T (ρ t           u t ) T ] T  involved the state estimates X t , iteration on the estimate of the system states until convergence can be desired or, in some alternatives, required. 
         [0058]    Another factor to be considered is that the result of the CVA in exemplary step  606  is the computation of an estimate, denoted as m t , of the state sequence x t . The symbol ‘m’ is used as in the word ‘memory’ to distinguish it from the actual state vector and various estimates of the state vector as used in the EM algorithm discussed below. The estimate {circumflex over (m)} t  in combination with the maximization step of the EM algorithm can be shown to be a maximum likelihood solution of the system identification problem for the case of a linear time-invariant system. In that case, the global ML solution can be obtained in only one iteration of the algorithm. This may be different with the EM and gradient search methods that almost always utilize many iterations. The CVA estimate m t  may actually be an estimate of the state sequence for the system with parameters equal to the maximum likelihood estimates in the case of LTI systems and large sample size. This is different from the usual concept of first obtaining the ML parameter estimates and then estimating the states using a Kalman filter. Not only is the optimal state sequence for the ML parameters obtained in a single iteration, the optimal state order may also be determined in the process. In the usual ML approach, it can be desired or, in some alternatives, required to obtain the ML estimates for each choice of state order and then proceed to hypothesis testing to determine the optimal state order. 
         [0059]    In another exemplary embodiment, the convergence of the iterative algorithm for the case of LPV may be described. In this embodiment, a substantially similar approach may be taken for other forms of nonlinear difference equations. 
         [0060]    For any iterative algorithm, two issues may typically arise: (1) does the algorithm always converge, and (2) at what rate does it converge. In the computational examples considered, the iteration k on the estimated states {circumflex over (x)} t   [k]  can be very rapid, for example half a dozen steps. Thus it may be shown herein that the iterative algorithm can be closely related to the class of EM algorithms that can be shown to always converge, under an assumption on the LPV system stability. Also, the rate of convergence can be computed to be geometric. This latter result is unique since the EM algorithm typically makes rapid early progress but becomes quite slow in the end. The reason for the rapid terminal convergence of the LPV algorithm will be discussed in further detail. Issues of initialization, stability and convergence will be elaborated below. 
         [0061]    Additionally, the methods and systems described herein may be discussed in the context of the EM algorithm as there can be some parallelism between the two. To show the convergence of the LPV algorithm, the development in Gibson and Ninness (2005), denoted as GN below and incorporated by reference herein in its entirety (S. Gibson and B. Ninness, “Robust maximum-likelihood estimation of multivariable dynamic systems,”  Automatica , vol. 41, no. 5, pp. 1667-1682, 2005) will be discussed with various modifications made that are appropriate for the LPV algorithm. All equation numbers from Gibson and Ninness (2005) will include GN following the number in the paper GN, for example (23GN). 
         [0062]    In this exemplary embodiment, the replacements that can be made in the GN discussion to obtain the LPV algorithm may be as follows: replace the LTI state equations with the LPV state equations and, for the missing data, replace the state estimate from the Kalman smoother with the ‘memory’ vector m t  in the iterative algorithm. The consequence of this can be significant because for linear systems as in GN the iterative algorithm described herein can obtain the global ML parameter estimates in one step in large samples. On the other hand, for linear systems it may take the EM algorithm many iterations to obtain the ML solution. 
         [0063]    Replacing the LTI model with the LPV model replaces the state space model equation 11GN by the LPV equations (15) and (16). This can produce a number of modifications in the equations of Lemma 3.1 since u t  and (A, B, C, D) in GN is replaced by [u t   T (ρ t           x t ) T (ρ t           u t ) T ] T  and (A 0 ,[B 0 A ρ B ρ ],C 0 ,[B 0 C ρ D ρ ],) respectively. So the ‘data’ includes the vector ρ t           x t  where the state vector x t  is not available. 
         [0064]    To execute iteration k as shown in  504  of exemplary  FIG. 5 , a straight forward approach involving the EM algorithm could be used. The ‘missing data’ would include state vector x t  as the missing data. (See S. Gibson, A. Wills, and B. Ninness (2005), “Maximum likelihood parameter estimation of bilinear systems”, IEEE Trans. Automatic Control, Vol. 50, No. 10, pp. 1581-2005, the contents of which are hereby incorporated by reference in their entirety). Then we could proceed for the case of a bilinear system that involves a term u t           x t  that may be completely analogous to ρ t           x t  for the LPV algorithm. But such an EM approach can, on occasion, result in the typical slow convergence behavior of EM algorithms near the maximum. 
         [0065]    Therefore, instead the LPV algorithm may be used and can result in a rapid convergence. Thus, in this exemplary embodiment, instead of specifying the ‘missing data’ as the estimate of the Kalman smoother, the subspace approach can specify the CVA state estimate m t  or ‘memory’, as the missing data. The memory m t  is the estimate of the state vector obtained by a canonical variate analysis between the corrected future and the past obtained in exemplary step  606  of the iterative algorithm using the input and output vectors specified in  FIG. 5 . This may be similar to a Kalman filter state estimate at the global ML parameter estimates associated with the output and input data at iteration k rather than a Kalman smoother state estimate at the last estimated parameter value. One difference can occur because the CVA method expresses the likelihood function in terms of the corrected future conditioned on the past so that estimates of memory m t  may depend only on the output and input data and their distribution depends on the ML estimates associated with the output and input data used in iteration k rather than smoothed estimates of the state. The actual conditional likelihood function p θ (ξ t /Z t ) of (26GN) with ξ t   T =[x t+1   T y t   T ] and z t   T =[x t   T u t   T ] is what can be involved in all of the EM computations. This can be the same likelihood function involved in the exemplary step  608  of the CVA algorithm of estimating the parameters of the state space equation as in Lemma 3.3 of GN. A difference is that in the exemplary step  608  of the CVA algorithm the expectation can be with respect to the true global ML estimates associated with the output and input data at iteration k whereas the GN estimate is an expectation with respect to the parameter value obtained in the previous iteration. 
         [0066]    Further, the use of the LPV model and the choice of memory m t  as the missing data in the expectation step of the algorithm can have the following consequence in GN. The basic theory in section 2, The Expectation-Maximization (EM) Algorithm of GN, needs no modification. In Section 3 of GN, the missing data is taken to be the CVA state estimates {circumflex over (m)} t   [k]  based on the input and output quantities for iteration k in  504  of  FIG. 5 . So the x t  in equations (22GN) through (28GN) can be replaced by {circumflex over (m)} t   [k] . 
         [0067]    Thus, Lemma 3.1 of GN holds but also can achieve the global ML estimate associated with the input-output vectors of exemplary  FIG. 5  in one step. Lemma 3.2 of GN can be replaced by the iterative algorithm to obtain the memory estimates {circumflex over (m)} t   [k] . Lemma 3.3 of GN is the same result as obtained in the iterative algorithm. An additional step may be used to compute {circumflex over (x)} t   [k]  from the estimates {circumflex over (Θ)} [k]  and the linear time-varying state equations given by the LPV state equations. This step may be desired to obtain the state estimate {circumflex over (x)} t   [k]  for starting the next iteration k 1 . This step can further allow for the iterative algorithm to produce Q(θ,θ′)≧Q(θ′,θ′) with equality if and only {circumflex over (x)} t   [k] ={circumflex over (x)} t   [k+1] . 
         [0068]    Then, in principle, the memory {circumflex over (m)} t   [k]  could be used in place of the state estimate {circumflex over (x)} t   [k] . In fact, {circumflex over (m)} t   [k]  projected on the recursive structure of the state equations in equations (43GN) and (44GN) can produce the ML state estimates asymptotically and the corresponding optimal filtered state estimates {circumflex over (x)} t   [k] . Thus the use of {circumflex over (m)} t   [k]  instead of {circumflex over (x)} t   [k]  in the computation of ρ t           {circumflex over (x)} t   [k]  as part of the ‘input data’ can lead to essentially the same result except for some ‘noise’ in the results. But the computational noise can be avoided by the small additional computation of {circumflex over (x)} t   [k] . 
         [0069]    Also, in some exemplary embodiments, there may not be a need for a ‘robust’ improvement to the iterative algorithm described herein since it has been developed using primarily singular value decomposition computations to be robust and demonstrated as such for more than a decade. An exception is possibly the computation of the filtered state estimate {circumflex over (x)} t   [k]  that could be implemented using the square root methods of Bierman (G. J. Bierman,  Factorization Methods for Discrete Sequential Estimation , Academic Press (1977); republished by Dover, N.Y. (2006), the contents of which are hereby incorporated by reference in their entirety) if ill-conditioned LPV dynamic systems are to be solved to high precision. 
         [0070]    In still another exemplary embodiment, it may be demonstrated that the LPV system identification algorithm may converge at a geometric rate near the maximum likelihood solution. Here the result for a linear system can be developed. The same approach may work for an LPV system, but the expressions below may be time dependent and can be of greater complexity. 
         [0071]    Further, in order to simplify the derivation herein, the time invariant feedback from equations 17 and 18 can be considered with the substitution of notation (Ã, {tilde over (B)}, {tilde over (C)}, {tilde over (D)}, ũ t , u t ) by (A, B, C, D, u t , ũ t ). Thus, equation 17 and equation 18, with noise v t  in innovation form may be written as equations 32 and 33 below. 
         [0000]        x   t+1   =Ax   t   +Bu   t   +Kv   t   (Equation 32)
 
         [0000]        y   t   =Cx   t   +Du   t   +v   t   (Equation 33)
 
         [0072]    Thus, from the above, it may be seen that for measurements of outputs y t  and inputs u t =[ũ t   T (ρ t           x t ) T (ρ t           ũ u ) T ] T , the time-invariant matrices are (A,B,C,D)=(A 0 ,{B 0 A ρ B ρ ],C 0 [B 0 C ρ D ρ ]), respectively. Then, solving for v t  in equation 33 and substituting in equation 32 produces equation 34 below. 
         [0000]        x   t+1   =Ax   t   +Bu   t   +K ( y   t   −Cx   t   +Du   t )=( A−KC ) x   t +( B−KD ) u   t   +Ky   t   (Equation 34)
 
         [0073]    Next, through recursively substituting the right hand side of equation 34 for x t  can provide equation 35 below. 
         [0000]    
       
         
           
             
               
                 
                   
                     x 
                     t 
                   
                   = 
                   
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         ∞ 
                       
                        
                       
                         
                           
                             ( 
                             
                               A 
                               - 
                               KC 
                             
                             ) 
                           
                           
                             i 
                             - 
                             1 
                           
                         
                          
                         
                           [ 
                           
                             
                               
                                 ( 
                                 
                                   B 
                                   - 
                                   KD 
                                 
                                 ) 
                               
                                
                               
                                 u 
                                 
                                   t 
                                   - 
                                   i 
                                 
                               
                             
                             + 
                             
                               Ky 
                               
                                 t 
                                 - 
                                 i 
                               
                             
                           
                           ] 
                         
                       
                     
                     = 
                     
                       
                         Jp 
                         t 
                       
                        
                       
                         ( 
                         
                           
                             y 
                             t 
                           
                           , 
                           
                             [ 
                             
                               
                                 
                                   
                                     u 
                                     ~ 
                                   
                                   t 
                                 
                                  
                                 
                                   ( 
                                   
                                     
                                       ρ 
                                       t 
                                     
                                     ⊗ 
                                     
                                       x 
                                       t 
                                     
                                   
                                   ) 
                                 
                               
                               , 
                               
                                 ( 
                                 
                                   
                                     ρ 
                                     t 
                                   
                                   ⊗ 
                                   
                                     
                                       u 
                                       ~ 
                                     
                                     t 
                                   
                                 
                                 ) 
                               
                             
                             ] 
                           
                         
                         ) 
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     35 
                   
                   ) 
                 
               
             
           
         
       
     
         [0074]    In equation 35, J can contain the ARX coefficients and p t  can be the past output y t  and inputs u t =[ũ t ,(ρ t           x t ),(ρ t           ũ t )]. Here ũ t  can be the original inputs such that u t  can include the nonlinear Kronecker product terms. 
         [0075]    In a further exemplary embodiment, asymptotically for a large sample, J can be arbitrarily close to constant for a sufficiently large iteration k such that 
         [0000]    
       
         
           
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     
                       x 
                       t 
                       
                         [ 
                         k 
                         ] 
                       
                     
                   
                   = 
                   
                     
                       x 
                       t 
                       
                         [ 
                         
                           k 
                           + 
                           1 
                         
                         ] 
                       
                     
                     - 
                     
                       x 
                       t 
                       
                         [ 
                         k 
                         ] 
                       
                     
                   
                 
               
             
             
               
                 
                   = 
                   
                     
                       Jp 
                       t 
                     
                      
                     
                       [ 
                       
                         0 
                         , 
                         0 
                         , 
                         
                           
                             ( 
                             
                               
                                 ρ 
                                 r 
                               
                               ⊗ 
                               
                                 ( 
                                 
                                   
                                     x 
                                     t 
                                     
                                       [ 
                                       k 
                                       ] 
                                     
                                   
                                   - 
                                   
                                     x 
                                     t 
                                     
                                       [ 
                                       
                                         k 
                                         - 
                                         1 
                                       
                                       ] 
                                     
                                   
                                 
                                 ) 
                               
                             
                             ) 
                           
                            
                           0 
                         
                       
                       ] 
                     
                   
                 
               
             
             
               
                 
                   = 
                   
                     L 
                      
                     
                       [ 
                       
                         
                           
                             
                               
                                 
                                   ρ 
                                   
                                     t 
                                     - 
                                     1 
                                   
                                 
                                 ⊗ 
                                 Δ 
                               
                                
                               
                                   
                               
                                
                               
                                 x 
                                 
                                   t 
                                   - 
                                   1 
                                 
                                 
                                   [ 
                                   
                                     k 
                                     - 
                                     1 
                                   
                                   ] 
                                 
                               
                             
                           
                         
                         
                           
                             ⋮ 
                           
                         
                         
                           
                             
                               
                                 
                                   ρ 
                                   
                                     t 
                                     - 
                                     lag 
                                   
                                 
                                 ⊗ 
                                 Δ 
                               
                                
                               
                                   
                               
                                
                               
                                 x 
                                 
                                   t 
                                   - 
                                   lag 
                                 
                                 
                                   [ 
                                   
                                     k 
                                     - 
                                     1 
                                   
                                   ] 
                                 
                               
                             
                           
                         
                       
                       ] 
                     
                   
                 
               
             
             
               
                 
                   
                     = 
                     
                       
                         L 
                         t 
                       
                        
                       
                         [ 
                         
                           
                             
                               
                                 Δ 
                                  
                                 
                                     
                                 
                                  
                                 
                                   x 
                                   
                                     t 
                                     - 
                                     1 
                                   
                                   
                                     [ 
                                     
                                       k 
                                       - 
                                       1 
                                     
                                     ] 
                                   
                                 
                               
                             
                           
                           
                             
                               ⋮ 
                             
                           
                           
                             
                               
                                 Δ 
                                  
                                 
                                     
                                 
                                  
                                 
                                   x 
                                   
                                     t 
                                     - 
                                     lag 
                                   
                                   
                                     [ 
                                     
                                       k 
                                       - 
                                       1 
                                     
                                     ] 
                                   
                                 
                               
                             
                           
                         
                         ] 
                       
                     
                   
                   , 
                 
               
             
           
         
       
     
         [0000]    where L, can be time varying and can have the time varying scheduling parameters ρ t  combined with terms L. Also, if ρ t  for all t is bounded, L t  will be similarly bounded. 
         [0076]    Now, when writing the state sequence in block vector form as X 1:N   i =vec└x 1:N   i  . . . x 1   i ┘ where the vec operation can stack the columns of a matrix starting with left hand columns on top, the above result can imply that 
         [0000]    
       
         
           
             
               
                 [ 
                 
                   
                     
                       
                         Δ 
                          
                         
                             
                         
                          
                         
                           x 
                           N 
                           
                             [ 
                             k 
                             ] 
                           
                         
                       
                     
                   
                   
                     
                       ⋮ 
                     
                   
                   
                     
                       
                         Δ 
                          
                         
                             
                         
                          
                         
                           x 
                           
                             t 
                             - 
                             k 
                           
                           
                             [ 
                             k 
                             ] 
                           
                         
                       
                     
                   
                   
                     
                       ⋮ 
                     
                   
                 
                 ] 
               
               = 
               
                 
                   [ 
                   
                     
                       
                         0 
                       
                       
                         
                           L 
                           
                             N 
                             - 
                             1 
                           
                         
                       
                       
                         -&gt; 
                       
                       
                         -&gt; 
                       
                     
                     
                       
                         0 
                       
                       
                         ⋱ 
                       
                       
                         ⋯ 
                       
                       
                         ⋯ 
                       
                     
                     
                       
                         0 
                       
                       
                         0 
                       
                       
                         
                           L 
                           
                             N 
                             - 
                             k 
                           
                         
                       
                       
                         -&gt; 
                       
                     
                     
                       
                         0 
                       
                       
                         0 
                       
                       
                         0 
                       
                       
                         ⋱ 
                       
                     
                   
                   ] 
                 
                  
                 
                   [ 
                   
                     
                       
                         
                           Δ 
                            
                           
                               
                           
                            
                           
                             x 
                             
                               
                                 t 
                                  
                                 
                                     
                                 
                                  
                                 N 
                               
                               - 
                               1 
                             
                             
                               [ 
                               
                                 k 
                                 - 
                                 1 
                               
                               ] 
                             
                           
                         
                       
                     
                     
                       
                         ⋮ 
                       
                     
                     
                       
                         
                           Δ 
                            
                           
                               
                           
                            
                           
                             x 
                             
                               N 
                               - 
                               1 
                             
                             
                               [ 
                               
                                 k 
                                 - 
                                 1 
                               
                               ] 
                             
                           
                         
                       
                     
                     
                       
                         ⋮ 
                       
                     
                   
                   ] 
                 
               
             
             , 
           
         
       
     
         [0000]    where→can mean that L N−k  extends to the right. Using M to denote the upper triangular matrix can give the fundamental expression for the difference ΔX lag:N   i  between state sequences X lag:N     i     i  at successive iterations k and k−1 as equation 36 below. 
         [0000]      Δ X   lag+2:N   i   =MΔX   lag+1:N−1   i−1   (Equation 36)
 
         [0077]    From equation 36 it may then be seen that the terminal convergence rate of the iteration in the LPV case can be governed by M, in particular the largest singular value of M. The various blocks of M can thus be computed by 
         [0000]    
       
         
           
             
               
                 
                   ( 
                   
                     A 
                     - 
                     KC 
                   
                   ) 
                 
                 
                   i 
                   - 
                   1 
                 
               
                
               
                 
                   
                     ( 
                     
                       B 
                       - 
                       KD 
                     
                     ) 
                   
                   
                     ρ 
                     ⊗ 
                     x 
                   
                 
                  
                 
                   [ 
                   
                     
                       
                         
                           
                             
                               ρ 
                               
                                 N 
                                 - 
                                 1 
                               
                             
                              
                             
                               ( 
                               1 
                               ) 
                             
                           
                            
                           
                             I 
                             
                               dim 
                                
                               
                                   
                               
                                
                               x 
                             
                           
                         
                       
                     
                     
                       
                         ⋮ 
                       
                     
                     
                       
                         
                           
                             
                               ρ 
                               
                                 N 
                                 - 
                                 i 
                               
                             
                              
                             
                               ( 
                               
                                 dim 
                                  
                                 
                                     
                                 
                                  
                                 p 
                               
                               ) 
                             
                           
                            
                           
                             I 
                             
                               dim 
                                
                               
                                   
                               
                                
                               x 
                             
                           
                         
                       
                     
                   
                   ] 
                 
               
             
             , 
           
         
       
     
         [0000]    where the subscript ρ         x means to select the submatrix of B−KD with columns corresponding to the corresponding rows of ρ         x in ũ t . 
         [0078]    In some other exemplary embodiments, the convergence of the iterative linear subspace computation may be affected by the stability of the LPV difference equations and, more specifically, the stability of the LPV linear subspace system identification described herein. Because a set of time-invariant linear state space difference equations may be stable if and only if all of the eigenvalues of the state transition matrix are stable, for example the eigenvalues are less than 1. The LPV case is more complex, but for the purposes of this exemplary embodiment, the rate of growth or contraction per sample time can be given for each eigenvector component of the state vector x t  by the respective eigenvalues of the LPV state transition matrix from equation 9 and now shown as equation 37 below. 
         [0000]    
       
         
           
             
               
                 
                   
                     A 
                      
                     
                       ( 
                       
                         ρ 
                         t 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       A 
                       0 
                     
                     + 
                     
                       
                         ∑ 
                         
                           i 
                           = 
                           1 
                         
                         s 
                       
                        
                       
                         
                           
                             ρ 
                             t 
                           
                            
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           A 
                           i 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     37 
                   
                   ) 
                 
               
             
           
         
       
     
         [0079]    In equation 37, the matrices A=(A 0 A ρ )=(A 0 A 1  . . . A s ) can be assumed to be unknown constant matrices. Therefore, it is apparent that the transition matrix A(ρ t ) may be a linear combination [1;ρ t ] of the matrices A i  for 0≦i≦s. Therefore, for any choice of the matrices A i  for 0≦i≦s, there can be possible values of ρ t  that could produce unstable eigenvalues at particular sample times t. If or when this occurs only sporadically and/or for only a limited number of consecutive observation times, no problems or errors may arise. 
         [0080]    In some other exemplary embodiments, for example in the k-th iterative computation of the subspace algorithm, only estimated values of the state sequence {circumflex over (x)} t   [k]  and the matrices Â i   [k]  for 0≦i≦s may be used. Therefore, if large errors in the estimates of these quantities are possible or acceptable, then there can be a greater potential for unstable behavior. For example, there may be areas of application of more significant importance, such as including identification of aircraft wing flutter dynamics where the flutter dynamics may be marginally stable or even unstable with the vibration being stabilized by active control feedback from sensors to wing control surfaces. Then, in some other applications, it may be possible to guarantee that not any combination of scheduling parameters ρ t , values of matrices A i  and uncertainty could produce instabilities. Further to this, the stability of the transition matrix can provide a potential for issues and therefore further consideration could be desired. 
         [0081]    In some further exemplary embodiments, instabilities can produce periods where the predicted system response can rapidly grow very large. For example, when the eigenvalues are all bounded less than 1, then the predicted system response can be bounded, whereas if estimation errors are large, for example, one of the eigenvalues is equal to 2 for a period of time, then the predicted response may double approximately every sample during that time. Thus if 10 30 =(10 3 ) 10 ≅(2 10 ) 10 =2 100 , then in as few as 100 samples, 30 digits of precision could be lost in the computation which could then provide meaningless results. 
         [0082]    Therefore, per the above, there may be conditions under which there may be considerable loss of numerical accuracy that can be associated with periods where the LPV transition matrix is unstable, for example with extended intervals of time. Further, the difficulty can lie in that the algorithm initialization and sample size since at the optimal solution with a large sample, the algorithm is stable and convergent. If it was possible to compute with infinite precision, then problems with illconditioning could be avoided; however, with 15 or 30 decimal place accuracy, for example, some real data sets such as for the aircraft wing flutter, can benefit from further consideration. 
         [0083]    Therefore, some exemplary embodiments may deal with manners of correcting for or otherwise lessening any undesired effects that may result from algorithm instability. For example, if the state sequence {circumflex over (x)} t   [k]  is sufficiently close to the optimum as based upon the terminal convergence results described previously, the iterative algorithm may be stable provided it is assumed that the LPV system is stable. Therefore, in some examples, large initial errors in the estimate {circumflex over (x)} t  [1] can lead to an unstable computation. 
         [0084]    In other examples, such as during time intervals when the scheduling parameter values cause significant instabilities in A(ρ t ), some components of the ƒ t |q t , the future outputs ƒ t  corrected for the effects of future inputs q t , may become quite large. Therefore, in the computation of the covariance matrix of ƒ t |q t , such large values can cause considerable illconditioning and loss in numerical precision. 
         [0085]    In examples where the iterative algorithm and some other subspace methods permit the arbitrary editing of the times where the instabilities occur, outlier editing of unstable regions may be performed. For example, in the ARX covariance computation where the corrected future can be computed, the time intervals with significant instabilities can be determined and removed from the computation. 
         [0086]    In examples dealing with experimental design, if the trajectory of the operating point variables can be specified, then the scheduling parameters can be scheduled to enhance the system identification in several ways. An initial region that can avoid computational instabilities can be chosen to obtain sufficiently accurate initial estimates of the LPV parameters (A, B, C, D). This can then be used in other regions to initialize the state estimate of the algorithm with sufficient accuracy that computational instabilities will not be encountered. 
         [0087]    In the above examples, the removal of unstable outliers at each iteration can be the most general and robust procedure. As the estimated values of the state sequence {circumflex over (x)} t   [k]  and LPV parameters improve with more iterations, the number of outliers can be expected to decrease until there is rapid terminal convergence. A counter example to this expectation is when the beginning of the scheduling parameters ρ t  time history has little variation so that the LPV model for this part of the data is good for that portion of the data, but is a poor global model. Then, in the later part of the time history, there can be consideration variation in ρ t  such that unstable behavior may result. 
         [0088]    Additionally, in many potential exemplary applications of the methods and systems described herein, it can be expected that the proposed algorithm can perform much better than existing methods that presently are not feasible on industrial problems. Further, in many situations, it can be desired to design the experiment to obtain results of a desired fidelity for a specified global region of the operating space at as little cost in time and resources as possible. Because the iterative algorithm&#39;s linear subspace method is a maximum likelihood based procedure, designs can be developed for LTI system identification. Also, as it identifies a stochastic model with estimated disturbance models, including confidence bands on quantities such as dynamic frequency response functions, the required sample size and system input excitation can be developed with little prior information on the disturbance processes. 
         [0089]    In some further exemplary embodiments, the LPV methods and systems described herein may be extended to nonlinear systems. For example, it may be shown that a number of complex and nonlinear systems can be expressed in an approximate LPV form that can be sufficient for application of the LPV subspace system identification methods described herein. 
         [0090]    In one example, a general nonlinear, time varying, parameter varying dynamic system can be described by a system of nonlinear state equations, such as those shown in equations 38 and 39. 
         [0000]        x   t+1   =f ( x   t   ,u   t ,ρ t   ,v   t )  (Equation 38)
 
         [0000]        y   t   =h ( x   t   ,u   t ,ρ t   ,v   t )  (Equation 39)
 
         [0091]    In equations 38 and 39, x t  can be the state vector, u t  can be the input vector, y t  can be the output vector and v t  can be a white noise measurement vector. In some exemplary embodiments, to deal with ‘parameter varying’ systems, the ‘scheduling’ variables ρ t  that can be time-varying parameters can describe the present operating point of the system. Very general classes of functions ƒ(•) and h(•) can be represented by additive borel functions that need not be continuous. 
         [0092]    In a simplified manner, the case of functions admitting Taylor expansion as in Rugh, Section 6.3 (W. J. Rugh,  Nonlinear System Theory: The Volterra/Wiener Approach . Baltimore, Md.: Johns Hopkins Univ. Press, 1981, the contents of which are hereby incorporated by reference in their entirety), where ρ t  and v t  may be absent can provide the following, as shown in equations 40 and 41. 
         [0000]    
       
         
           
             
               
                 
                   
                     x 
                     
                       t 
                       + 
                       1 
                     
                   
                   = 
                   
                     
                       ∑ 
                       
                         i 
                         = 
                         0 
                       
                       I 
                     
                      
                     
                       
                         ∑ 
                         
                           j 
                           = 
                           0 
                         
                         J 
                       
                        
                       
                         
                           F 
                           ij 
                         
                          
                         
                           x 
                           t 
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           u 
                           t 
                           
                             ( 
                             j 
                             ) 
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     40 
                   
                   ) 
                 
               
             
             
               
                 
                   
                     y 
                     t 
                   
                   = 
                   
                     
                       ∑ 
                       
                         i 
                         = 
                         0 
                       
                       I 
                     
                      
                     
                       
                         ∑ 
                         
                           j 
                           = 
                           0 
                         
                         J 
                       
                        
                       
                         
                           H 
                           ij 
                         
                          
                         
                           x 
                           t 
                           
                             ( 
                             i 
                             ) 
                           
                         
                          
                         
                           u 
                           t 
                           
                             ( 
                             j 
                             ) 
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   
                     Equation 
                      
                     
                         
                     
                      
                     41 
                   
                   ) 
                 
               
             
           
         
       
     
         [0093]    In equations 39 and 40, the notation x t   (i)  can be defined recursively as x t   (i) =x t           x t   (i−1)  and similarly for u t   (j) . 
         [0094]    Thus, equations 40 and 41 may be polynomial expansions of the nonlinear functions ƒ(•) and h(•). Note that the nonlinear equations may involve nonlinear functions of relatively simple form such as the approximating polynomial equations that involve only sums of products that are readily computed for various purposes. However for empirical estimation of the coefficients in the presence of autocorrelated errors, the problem can become difficult for low dimensions of y, u, and x, even using subspace methods. For subspace methods, the matrix dimensions can grow exponentially with the dimension of the ‘past’ that can be used. This can occur in expanding equation 40 by repeated substitution into x t   [k]  on the right hand side of the state equation 40 with x t  on the left hand side of equation 40. Thus the entire right hand side of equation 40 with t replaced by t−1 can be raised to the power lagp, the order of the past typically selected as the estimated ARX model order. For a relatively low order past, and low dimensions of x t  and u t , the number of additive terms can increase exponentially. 
         [0095]    However, in a further exemplary embodiment and following Rugh the equations 39 and 40 can be converted through Carleman bilinearization to bilinear vector differential equations in the state variable as shown in equation 42: 
         [0000]        x   t             =└x   t   (1)   ;x   t   (2)   ; . . . x   t   (I) ┘;  (Equation 42)
 
         [0000]    and the input power and products variables as shown in equation 43. 
         [0000]        u   t             =└u   t   (1)   ;u   t   (2)   ; . . . u   t   (J) ┘;  (Equation 43)
 
         [0096]    In a further exemplary embodiment, equation 40, which expresses the state-affine form, can then be rewritten as equations 44 and 45, below. 
         [0000]        x   t             =A ( x   t                       u   t           )+ Bu   t             (Equation 44)
 
         [0000]        x   t             =C ( x   t                       u   t           )+ Du   t             (Equation 45)
 
         [0097]    Next, it may be assumed that the coefficient matrices (A, B, C, D) may be linear functions of scheduling parameters ρ t , denoted as (A(ρ t ),B(ρ t ),C(ρ t )D(ρ t )) and in state-affine form as in equations 9 through 12. The scheduling parameters ρ t  may be nonlinear functions of the operating point or other known or accurately measured variables. For example, since the inputs u t            are multiplicative and can be assumed to be known in real time or accurately measured, they can be absorbed into the scheduling parameters ρ t , thereby possibly decreasing their dimension. The bilinear equations can then become those shown in equations 46 and 47 below. 
         [0000]        x   t             =A (ρ t ) x   t             +B (ρ t ) u   t             (Equation 46)
 
         [0000]        x   t             =C (ρ t ) x   t             +D (ρ t ) u   t             (Equation 47)
 
         [0098]    Equations 46 and 47 are in explicitly LPV form. Therefore, for functions ƒ(x t ,u u ,ρ t ,v t ) and h(x t ,u u ,v t ) that may be sufficiently smooth and for which there may exist a well defined power series expansion in a neighborhood of the variable, there can exist an LPV approximation of the process. 
         [0099]    Thus, with the absorption of the inputs u t              into the scheduling parameter ρ   t , the equations may be linear time varying and, in some instances, may have a higher dimension ρ t . This can show the dual roles of inputs and scheduling parameters and how they may be interchangeable in a variety of manners and, for example, their difference may be their rate of variation with time. The knowledge of scheduling can therefore often be derived from the underlying physics, chemistry or other fundamental information. LPV models can therefore be considered, on occasion, as graybox models insofar as they may be able to incorporate considerable global information about the behavior of the process that can incorporate into the model how the process dynamics can change with operating point. 
         [0100]    The foregoing description and accompanying figures illustrate the principles, preferred embodiments and modes of operation of the invention. However, the invention should not be construed as being limited to the particular embodiments discussed above. Additional variations of the embodiments discussed above will be appreciated by those skilled in the art. 
         [0101]    Therefore, the above-described embodiments should be regarded as illustrative rather than restrictive. Accordingly, it should be appreciated that variations to those embodiments can be made by those skilled in the art without departing from the scope of the invention as defined by the following claims.