OPTIMAL PARAMETRIC SIGNAL PROCESSOR FOR LEAST SQUARES FINITE IMPULSE RESPONSE FILTERING

Abstract: An optimal parametric signal processor, which receives auto­ correlation and cross-correlation coefficients of a system under study, provides predictor and filter coefficients of the system in an optimal manner, and allows the use of any number of available parallel pro­ cessing units. The signal processor may be implemented in a fully parallel or fully sequential manner, or in a "parallel-partitioned" im­ plementation which provides the benefits of parallel processing, manage­ able hardware complexity, and optimal signal processing for a given number of available processors.

Description: CROSS-REFERENCE TO RELATED APPLICATIONS The present application is related to U.S. Patent Applications Serial No. 837,260, by Carayannis et al., filed March 7, 1986, and entitled OPTIMAL PARAMETRIC SIGNAL PROCESSOR, and Serial No. 904,382, by Carayannis et al., filed September 4, 1986, and entitled OPTIMAL PARAMETRIC SIGNAL PROCESSOR WITH LATTICE BASIC CELL. The subject matters of these U.S. Patent Applications have been published by WO 87/05421 and WO 87/05422, which in turn correspond to European Patent Applications 87 901 991.7 and 87 901 993.3, respectively. FIELD OF THE INVENTION The present invention relates to the field of signal processing, and in particular, parametric signal processing. BACKGROUND OF THE INVENTION Parametric signal processing is used in many areas, such as speech and image analysis, synthesis and recognition, neurophysics, geophysics, array processing, computerized tomography, communications and astronomy, to name but a few. One example of signal processing of particular importance is the linear prediction technique, which is used for speech analysis, synthesis and recognition, and for the processing of seismic signals, to enable the reconstruction of geophysical substrata. The linear prediction technique employs a specialized autocorrelation function. Another form of signal processing which finds a multitude of applications, is the determination of an optimal (in the least square sense) finite impulse response (FIR) filter. A signal processor employing such a technique works with the autocorrelation of the filter input signal and the cross-correlation between the input and the desired response signal, and may be used in many of the above-mentioned applications. Still another form of signal processing of particular importance is known in the art as "L-step ahead" prediction and filtering, for solving the "optimum lag" problem. This technique is especially useful in designing spiking and shaping filters. Signal processors which perform this function employ a specialized autocorrelation function which also takes into account a time lag associated with the system. Generally, as the order of the system under investigation increases, the complexity of the signal processing necessary to provide useful information also increases. For example, using the general Gaussian elimination procedure, a system of order p can be processed in "O(p³)" steps, indicating the number of steps as being "on the order of" p³, i.e., a function of p cubed. Thus, it will be appreciated that a system having order of p=100 requires on the order of one million processing steps to process the signal, a limitation of readily apparent significance, especially where real time processing is required. Signal processing techniques have been developed which have reduced the number of operations required to process a signal. One such method has been based on a technique developed by N. Levinson, which requires O(p²) sequential operations to process the signal. In particular, the "Levinson technique" requires O(2 p²) sequential operations in order to process the signal. An improved version of this technique, known as the "Levinson-Durbin" technique requires O(1 p²) sequential operations to process the signal. Neither of these schemes is suitable for parallel implementation. On the general subject of the Levinson and Levinson-Durbin techniques, see N. Levinson, "The Wiener RMS (Root-Mean-Square) Error Criterion in Filter Design and Prediction", J. Math Phys. , Vol. 25, pages 261-278, January 1947; and J. Durbin, "The Filtering of Time Series Models", Rev. Int. Statist. Inst., Vol. 28, pages 233-244, 1960. Although they represent an order of magnitude improvement over the Gaussian elimination technique, the Levinson and Levinson-Durbin techniques are too slow for many complex systems where real time processing is required. Another way of implementing the main recursion of the Levinson-Durbin technique, for the computation of what is widely known as "lattice coefficients", was developed by Schur in 1917, in order to establish a system stability criterion. See I. Schur, "Über Potenzreihen Die Im Innern Des Einheitskreises Beschränkt Sind", J. Reine Angewandte Mathematik, Vol. 147, 1917, pages 205-232. Lev-Ari and Kailath, of Stanford University, have developed a different approach, based on the Schur and Levinson techniques, which provides a triangular "ladder" structure for signal processing. The Lev-Ari and Kailath technique uses the signal, per se, as the input to the processor, rather than autocorrelation coefficients, and it is used in the signal modelling context. See H. Lev-Ari and T. Kailath, "Schur and Levinson Algorithms for Non-Stationary Processes", IEEE International Conference on Acoustics, Speech and Signal Processing , 1981, pages 860-864. In another modification to the Schur technique, Le Roux and C. Gueguen re-derived the Schur algorithm, giving emphasis to the finite word length implementation, using fixed point arithmetics. See Le Roux and Gueguen, "A Fixed Point Computation of Partial Correlation, Coefficients", IEEE Transactions on Acoustics, Speech, and Signal Processing , June 1977, pages 257-259. Finally, Kung and Hu, have developed a parallel scheme, based on the Schur technique, which uses a plurality of parallel processors, to process a signal, having order p, in O(p) operations, a significant improvement compared to the Levinson-Durbin technique. See Kung and Hu, "A Highly Concurrent Algorithm and Pipelined Architecture for Solving Toeplitz Systems", IEEE Transactions on Acoustics, Speech and Signal Processing , Vol. ASSP-31, No. 1, February 1983, pp. 66-76. However, the application of the Kung and Hu technique is severely limited insofar as it requires that the number of processors be equal to the order of the system to be solved. Thus, the Kung and Hu technique cannot process a signal produced by a system having an order greater than the number of parallel processors. System complexity is therefore a major limiting factor in using the Kung and Hu technique, insofar as many complex systems may have orders much higher than the number of parallel processors currently available in modern VLSI or other technology. OBJECTS AND SUMMARY OF THE INVENTION It is therefore an object of the present invention to overcome the difficulties associated with prior art signal processors and methods. It is another object of the present invention to provide an optimal parametric signal processor and processing method for least squares finite impulse response (LS-FIR) filtering. It is another object of the present invention to provide a signal processor and processing method, for LS-FIR filtering, which can be implemented using (i) a single processing unit to process a signal in a fully sequential manner, (ii) a plurality of processing units to process a signal in fully parallel manner, or (iii) a lesser plurality of processing units to process a signal in a "partitioned parallel" manner. It is another object of the present invention to provide an LS-FIR filter which also yields as a by-product a linear predictor. It is another object of the present invention to provide an LS-FIR signal processing structure having minimal hardware complexity. In accordance with a first aspect of the invention, a signal processor receives autocorrelation and cross-correlation coefficients from a system, and provides lattice predictor and filter coefficients of that system. The signal processor includes means for receiving a plurality of the autocorrelation and cross-correlation coefficients, means for multiplying a first pair of adjacent autocorrelation coefficients by a first lattice coefficient, resulting in first and second products, and for adding (i) to the first product, the one of the first pair of autocorrelation coefficients which is not involved in said first pruduct and (ii) the other of the first pair of coefficients to the second product, to yield a first pair of intermediate values, during a first time interval. Additionally, means are provided for multiplying one of the first pair of autocorrelation coefficients by a second lattice coefficient, resulting in a third product, and for adding a first cross-correlation coefficient to the third product to yield a third first intermediate value, during the first time interval. Divider circuitry is also provided for forming the quotient of a selected pair of autocorrelation coefficients to produce the first lattice coefficient and for forming the quotient of a selected autocorrelation coefficient and a selected cross-correlation coefficient to produce the second lattice coefficient. Further, the signal processor may include means for multiplying a second pair of adjacent autocorrelation coefficients by the first lattice coefficient resulting in respective fourth and fifth products, and for adding (i) one of the second pair of autocorrelation coefficients to the fourth product, and (ii) the other of the second pair of autocorrelation coefficients to the fifth product to yield a second pair of first intermediate values, during a second time interval. Also operative during the second time interval are means for multiplying one of the second pair of autocorrelation coefficients by the second lattice coefficient, resulting in a sixth product, and for adding a second cross-correlation coefficient to the sixth product to yield a sixth first intermediate value. The divider circuitry functions to form a pair of quotients of selected ones of the first intermediate variables, to provide third and fourth lattice coefficients, corresponding to the desired lattice predictor and filter coefficients. Operative during a third time interval are means for multiplying a selected two of the first intermediate values in the first and second pairs of intermediate values, by the third lattice coefficient, resulting in respective seventh and eighth products, and for adding (i) a first of the selected two intermediate values to the seventh product, and (ii) a second of the selected two intermediate values to the eighth product, to yield a pair of second intermediate values. Also operative during the third time interval are means for multiplying one of the first intermediate values by the fourth lattice coefficient to produce a ninth product, and for adding one of the third and sixth first intermediate values to the ninth product to yield a third second intermediate value. The signal processor may either comprise a plurality of parallel processing units, in which case the first and second time intervals occur substantially simultaneously, and proceed the third time interval, or may comprise a single processing unit, in which case the first time interval will precede the second time interval, which in turn will precede the third time interval. In accordance with another aspect of the invention, a signal processor may includeat least two parallel processing coefficient, resulting. Further, a storage and retrieval structure is provided for reapplying selected ones of the first intermediate values from at least two of the parallel processing units, and the lattice predictor and filter coefficients, to at least one of the parallel processing units, to produce a trio of second intermediate values in a similar manner. In accordance with still another aspect of the present invention, a signal processor receives autocorrelation and cross-correlation coefficients from a system, and provides lattice predictor and filter coefficients of that system. The signal processor includes means for receiving a plurality of autocorrelation and cross-correlation coefficients, means for multiplying a first autocorrelation coefficient by a first lattice coefficient, resulting in a first product, and for individually adding a first pair of autocorrelation coefficients, adjacent to the first autocorrelation coefficient, to the first product, to yield a first pair of first intermediate values, and means for multiplying the first autocorrelation coefficient by a second lattice coefficient, resulting in a second product, and for adding a cross-correlation coefficient to the second product to yield a third first intermediate value. A divider is provided for forming a pair of quotients of the first intermediate values, to thereby produce the lattice predictor and filter coefficients. Many other aspects of the present invention will become apparent to those skilled in the art, the above aspects being merely exemplary. BRIEF DESCRIPTION OF THE DRAWINGS The foregoing and other objects, aspects and embodiments of the present invention will be described in more detail below with reference to the following drawing figures, of which: FIG. 1 illustrates the "superlattice" processing structure, for the non-symmetrical case, in accordance with the inventions of copending applications Serial Nos. 837,260 and 904,382; FIG. 2 illustrates the "superlattice" processing structure for the symmetrical case, in accordance with the inventions of the copending applications; FIG. 3 illustrates the processing structure which can be used, along with the superlattice, to produce lattice filter coefficients in accordance with the present invention; FIG. 4 illustrates the "superlattice-superladder" processing structure for producing both lattice filter coefficients k c / m and lattice predictor coefficients k m , in accordance with the present invention; FIGS. 5a and 5b respectively illustrate the "ladder butterfly basic cell" (LBBC) and the "ladder lattice basic cell" (LLBC), in accordance with the present invention; FIG. 6 illustrates the signal processing structure which is produced through the repeated use of the LLBC of FIG. 5b, in accordance with the present invention; FIG. 7 illustrates the partitioned-parallel implementation of the superlattice-superladder using three LLBC's, for a system having order 7; FIG. 8 illustrates the signal flow through real and virtual processors which implement the arrangement of FIG. 7; FIG. 9 illustrates the processing functions of the LLBC's and double dividers of FIG. 8; and FIG. 10 illustrates the hardware implementation of the arrangement shown in FIGS. 7 and 8, in accordance with the present invention, showing three LLBC's and associated hardware. DETAILED DESCRIPTION OF THE INVENTION Since the present invention is based on the invention of the copending applications, Serial Nos. 837,260 and 904,382, a description of the relevant parts of those applications, as they relate to the present invention, will be made, with reference to FIGS. 1 and 2, herein. The Non-Symmetrical Case With reference to FIG. 1, there is shown a "superlattice" structure of multipliers, designated by triangles, and adders, designated by circles, arranged in a manner to process a signal in order to produce a linear predictor for a non-symmetrical system. This superlattice structure forms the basis for the LS-FIR processor of the present invention. As shown in the figure, a signal from a system having order P, such as a communications channel, for example, is applied to a well known digital autocorrelator 10, which produces autocorrelation coefficients r₋₅ through r₅. The autocorrelation coefficients are delivered to an input device 12, such as a digital register, or buffer memory, for application to the superlattice structure. With the exception of autocorrelation coefficients r₋₅, r₀ and r₅, each autocorrelation coefficient is applied to a pair of multipliers which function to multiply each coefficient by a pair of "lattice predictor coefficients" k n and k n *, k n being the "normal" lattice predictor coefficient, and k n * being the "adjoint" lattice predictor coefficient. The multipliers indicated by white triangles function to multiply the autocorrelation coefficients by the normal lattice predictor coefficient k n , while the multipliers indicated by the black triangles function to multiply the autocorrelation coefficients by the adjoint lattice predictor coefficients k n *. Production of the normal and adjoint lattice predictor coefficients will be described below. The two products produced by multiplying each autocorrelation coefficient by the normal and adjoint lattice predictor coefficients are added, in the adders indicated by the circles in the figure, to an adjacent pair of autocorrelation coefficients, to produce a set of first intermediate values ζ 1 / n, where n = -3,-2,-1, 0, 2, 3, 4, 5, and ξ 1 / m, where m = -5,-4,-3,-2, 0, 1, 2, 3. For example, the autocorrelation coefficient r₋₄, is multiplied by k₁ and k₁* in multipliers 14 and 16, respectively, and the products are added to the pair of autocorrelation coefficients r₋₃ and r₋₅, which are adjacent to coefficient r₋₄, in adders 18 and 20, respectively. Similarly, autocorrelation coefficient r₋₃, after multiplication by lattice predictor coefficients k₁ and k₁*, is individually added to the adjacent pair autocorrelation coefficients r₋₄ and r₋₂. The same process takes place for autocorrelation coefficients r₋₂ through r₄, to produce the set of first intermediate values, as shown. For the sake of continuity, the autocorrelation coefficients r₋₅ through r₅, are also designated as ζ o / n and ξ o / m, where n = -4 to 5 and m = -5 to 4. The lattice predictor coefficients are calculated as follows: The lattice predictor coefficients k₁ and k₁* are produced directly from the autocorrelation coefficients, while the second set of lattice predictor coefficients, k₂ and k₂*, are calculated from the first intermediate values. In a manner similar to that performed to generate the first intermediate values, selected pairs of adjacent first intermediate values, for example, ξ 1 / -4 and ζ 1 / -3 are multiplied by the normal and adjoint lattice predictor coefficients k₂ and k₂*, respectively, in multipliers 22 and 24. Two first intermediate values ζ 1 / -2 and ξ 1 / -5, adjacent to, and on either side of the selected pair, are added to the products produced by multipliers 22 and 24 in adders 26 and 28, respectively, to produce two second intermediate values ζ 2 / -2 and ξ 2 / -5. The remaining second intermediate values are generated in a similar manner, namely, by multiplying a selected pair of adjacent first intermediate values by the normal and adjoint lattice predictor coefficients k₂ and k₂*, and by adding to the products, the first intermediate values adjacent to, and on either side of, the selected pair. It will also be seen that, following this signal flow, the third intermediate values and final intermediate values are generated in a similar manner. The lattice predictor coefficients k i completely characterize the linear predictor and can be used instead of the direct predictor coefficients. In fact, they are preferred for storage, transmission and fast speech synthesis, since they have the considerable advantages of being ordered, bounded by unity and can readily be used for stability control, efficient quantization, and the like. Since r₀ corresponds to the energy of the signal, and will therefore have the greatest amplitude of any of the signals processed by the superlattice, all variables can be normalized with respect to r₀, thus facilitating the use of "fixed point" processing with its attendant advantages of precision, speed, and processing simplicity. The arrangement shown in FIG. 1 can produce lattice coefficients for a system of the type Ra = -d , where R has a Toeplitz structure. A detailed analysis of this technique is given by G. Carayannis et al., "A New Look on the Parallel Implementation of the Schur Algorithm for the Solution of Toeplitz Equations", IEEE International Conference on Acoustics, Speech and Signal Processing , March 26-29, 1985. Although the lattice predictor coefficients k i and k i * are usually preferred, the direct predictor coefficients a i , which are useful in spectral estimation, for example, can be derived from the lattice coefficients using the processing structure illustrated in FIG. 2 of the above-identified co-pending applications. The Symmetrical Case A special situation exists where the system to be analyzed can be characterized by Ra = -d , where R has a symmetrical Toeplitz structure, as in the case of auto-regressive linear production. In such cases, the superlattice structure of FIG. 1 is simplified to the symmetrical superlattice form shown in FIG. 2 herein, since r i =r -i ; k i =k i * and ζ m / i = ξ m / -i, for the symmetrical case. Thus, the two triangular lobes of FIG. 1 become identical, so that one of them can be omitted, allowing the elimination of half of the signal processing. The signal processing structure for the symmetrical case, shown in FIG. 2, provides linear prediction, or auto-regressive modelling, by calculating the lattice predictor coefficients, or in the symmetrical case, the "PARCOR" (partial correlation) predictor coefficients. It should initially be noted that with this signal processing structure (as well as that shown in FIG. 1) there is no redundancy. That is, each ζ (and ξ) appearing in the processor is produced only once. Additionally, only those signals needed for the production of lattice predictor coefficients, or PARCORs are involved. Thus, the signal processing structures shown in FIGS. 1 and 2 represent optimal processing schemes. In a manner similar to that shown for the non-symmetrical case of FIG. 1, a system signal is applied to a digital autocorrelator 10, which produces autocorrelation coefficients which characterize the symmetrical system, namely, r₀ through r₈. The coefficients are applied to an input device 30, such as a digital register or memory. Note that the signal processor of FIG. 2 receives a signal from a system having an order of 8, whereas the system in FIG. 1 receives a signal from a system having an order of 5. As with the signal processor of FIG. 1, the signal processor of FIG. 2 takes each autocorrelation coefficient, except the first and last, namely r₀ and r₈, and multiplies it by the first lattice predictor coefficient k₁, which is calculated from r₀ and r₁ (ζ⁰₀, ζ 0 / 1), according to the general formula k p = - ζ p-1 / p / ζf⁻¹. The product of each such multiplication is added, individually, to the adjacent two autocorrelation coefficients, to produce the first intermediate values ζ 1 / n, where n=0, 2 to 8 and-6 to-1. For example, autocorrelation coefficient r₁, designated as ζ 0 / 1 and ζ 0 / -1, for the sake of conformance with the intermediate variables, is multiplied by lattice predictor coefficient k₁, and autocorrelation coefficients r₀ and r₂ are added, individually, to the product, to produce a pair of first intermediate values ζ 1 / 0 and ζ 1 / 2, respectively. Similarly, the next two first intermediate values, namely ζ 1 / -1 and ζ 1 / 3 are produced by multiplying autocorrelation coefficient r₂ by the lattice predictor coefficient k₁, and adding, individually, the adjacent autocorrelation coefficients, namely, r₁ and r₃ to the products. The second intermediate values can be calculated from the first intermediate values in a similar manner. First, k₂ can be calculated from the ratio of ζ 1 / 2 and ζ 1 / 0 in accordance with the formula given above. Then, second intermediate values ζ 2 / 3 and ζ 2 / 0, for example, are calculated by multiplying the first intermediate values ζ 1 / -1 and ζ 1 / 2 by the lattice predictor coefficient k₂, and adding the adjacent first intermediate values ζ 1 / 3 and ζ 1 / 0 to the products, individually. The signal processing continues until the final values ζ 7 / 8 and ζ 7 / 0 are obtained, from which the lattice predictor coefficient k₈ can be calculated from the above formula. The signal processor illustrated in FIGS. 1 and 2 can be implemented as described in the above-cited co-pending applications. Optimal FIR Filtering The "superlattice" processing described above can readily be applied to FIR filtering, where there exists a linear system to be solved of the form: R c = - d where R is a Toeplitz autocorrelation matrix, d is a cross-correlation vector and c is the vector of the filter coefficients, as follows: For purposes of simplicity, only the symmetrical case is discussed. However, an extension of the symmetrical case to the non-symmetrical case will be apparent to those skilled in the art, in view of the disclosure herein. Since the Toeplitz autocorrelation matrix R is the same for both FIR filtering and the linear prediction cases, discussed in the above-cited copending applications, it will be appreciated that the linear prediction and FIR filtering processes are closely related. In fact, calcualtion of the optimal FIR filter gives, as a by-product, the optimal predictor, a m . Based on the optimal predictor, the FIR filter coefficients can be computed through the use of a Levinson type recursion, as follows: Let us define the following quantities: This leads to the following Schur type recursion for τ m / i which forms the basis of the present invention. FIG. 3 is an illustration of the processing structure which can be used to compute the values τ m / i. Specifically, the value of τ m / i is computed, in accordance with equation 12, above, by multiplying the value of ζ m-1 / m-i by k c / m in multiplier 32, and adding the result to τ m-1 / i in adder 34. An observation of the structure of FIG. 3 reveals that the values of τ m / i, having order m, can be computed from the values of τ m-1 / i and ζ m-1 / m-i having order m-1, the structure being "recursive" in nature. Also, recalling that in the case of the linear prediction processor illustrated in FIG. 2, the equivalent of equation 12 above, is: The similarity between equations 12 and 13 is an indication that the superlattice computations, for linear prediction processing, are necessary in order to compute the τ m / i quantities required for FIR processing. In equation 7: Consequently, the computation of k c / m+1, for an optimal FIR filter, needs the superlattice generally illustrated in FIG. 2 and a processing structure attached to the superlattice for recursively computing the quantities τ m / i. This structure will be called the "superladder" and is illustrated in bold lines superimposed on the superlattice, in FIG. 4. The entire structure, which can be used to produce the lattice filter coefficients k c / m and the lattice predictor coefficients k m , will be referred to as the "superlattice-superladder." In FIG. 4, a system signal, such as that from a communications channel, is applied to a digital correlator 35, of well known construction. The digital correlator 35 produces autocorrelation coefficients r₀-r₆ and cross-correlation coefficents d₁-d₇ and applies them to an input device 36, such as a digital register, or buffer memory. The autocorrelation coefficients r₀-r₆ are processed using the superlattice, as shown and described with reference to FIG. 2, to produce lattice predictor coefficients k₁-k₆, and the crosscorrelation coefficients d₁-d₇ are processed, along with the autocorrelation coefficients, to produce the lattice filter coefficients k c / 1-k c / 7 using the superlattice-superladder processing structure. As in the case of the processing structure of FIG. 2, the triangles illustrated in FIG. 4 represent multipliers and the circles represent adders. In FIG. 4, the multipliers indicated by white triangles function to multiply the respective quantities by the lattice predictor coefficients k m , while the multipliers indicated by the black triangles function to multiply the respective values by the lattice filter coefficients k c / m. Specifically, autocorrelation coefficient r₁ (also shown as ζ 0 / 1 and ζ 0 / -1 for the sake of continuity with the intermediate values) is multiplied in multiplier 38 by the first lattice filter coefficient k c / 1 which is calculated in accordance with the following general formula, similar to that for the lattice predictor coefficients: The product of r₁ and k c / 1 is added, in adder 40, to autocorrelation coefficient d₂ (also referred to as τ 0 / 2 for the sake of continuity with the intermediate values) to produce first intermediate value τ 1 / 2. Similarly, autocorrelation coefficient r₂ is multiplied by lattice filter coefficient k c / 1 in multiplier 42 and the result is added to cross-correlation coefficient d₃ in adder 44 to yield first intermediate value τ 1 / 3. The remaining auto and cross-correlation coefficients are processed by the superladder in a similar manner, as shown, to produce the remaining first intermediate values τ 1 / 4-τ 1 / 7. Of course, the superlattice, concurrently processes the autocorrelation coefficients r₀ - r₆ to produce first intermediate values ζ 1 / n, n=0, 2,-1, 3,-2, 4, -3, 5,-4, 6,-5 as described above with reference to FIG. 2. Continuing as shown in FIG. 4, first intermediate value ζ 1 / -1 produced by the superlattice-superladder, is multiplied, in multiplier 46, by lattice filter coefficient k c / 2, produced in accordance with equation 14, and the result is added to the first intermediate value τ 1 / 3 in adder 48 to yield a second intermediate value, τ 2 / 3. The processing involved in the production of the remaining values of τ will be apparent to those skilled in the art. It will also be appreciated that there is no redundancy in deriving the intermediate values, τ m / 1, in that each intermediate value of τ is derived only a single time, in a manner analogous to the non-redundant derivation of the intermediate values ζ m / i using the superlattice. Thus, the processing structure illustrated in FIG. 4 represents an optimal structure for deriving both lattice filter coefficients k c / m and lattice predictor coefficients k m . As in the case of the superlattice, the superlattice-superladder can be implemented (1) in a purely sequential, order recursive manner, (2) in a fully parallel manner, or (3) in a "partitioned" parallel manner. FIGS. 5a and 5b illustrate basic cells which can be used to implement the superlattice-superladder processing structure of FIG. 4, in any of the above ways. FIG. 5a illustrates a basic cell based on the "butterfly basic cell", or "BBC" structure as disclosed in the copending application Serial No. 837,260, and is hereinafter referred to as the "ladder butterfly basic cell" or "LBBC". The basic cell shown in FIG. 5b is based on the "lattice basic cell" or "LBC" structure disclosed in copending application Serial No. 904,382 and is hereinafter referred to as the "ladder lattice basic cell" or "LLBC". With reference to FIG. 5a, the LBBC receives seven generalized quantities a, b, c, d and h, corresponding to correlation coefficients or intermediate values, and k i and k c / i, corresponding to lattice predictor and filter coefficients, respectively. Based on these inputs, the LBBC produces three quantities, corresponding to intermediate or final values, e, g and j, as follows: With reference to FIG. 5b, the LLBC receives five generalized quantities a, b and h, corresponding to correlation coefficients or intermediate values, and k i and k c / i, corresponding to lattice predictor and filter coefficients, respectively. Based on these inputs, the LLBC produces three quantities, corresponding to intermediate or final values, e, g and j, as follows: It will appreciated that either the LBBC or LLBC could be used to implement the structure of FIG. 4, but for the sake of simplicity, only the LBBC will be treated in detail below. However, the implementation using the LBBC is a straightforward application of the BBC implementation disclosed in copending application Serial No. 837,260, and together with that disclosure and the discussion below, the LBBC implementation will be readily apparent to those skilled in the art. FIG. 6 illustrates the superlattice-superladder structure, for processing a signal from a system having order 7, when the LLBC of FIG. 5b is employed as the basic building block. Shown in dashed lines are extensions to the superladder and superlattice which result from the structure of the LLBC. The lower edge extensions, indicated by the dashed lines, function to produce intermediate values ζ 1 / 1 through ζ 6 / 6 and τ 1 / 1 through τ 6 / 6, each of which values is defined as zero, and the calculations therefor being unnecessary. The upper extensions to the processing structure are also unnecessary, and in fact, require the use of a suitably small "dummy" value for autocorrelation coefficient r₇ due to the difference between the FIR model order and the linear prediction order, as can be understood by observing equations 1 and 2, above. Thus, at the upper extension, only superladder basic cells exist. However, for the purposes of hardware homogeneity, the virtual extension of the superlattice is provided. The extension, fed by the dummy value for r₇, produces "don't care" values, indicated by an "X" beside the associated values. As demonstrated by FIG. 6, the entire superlattice-superladder of FIG. 4 can be implemented through the repeated use of the LLBC of FIG. 5b, seven of which are indicated by reference numerals 50, 52, 54, 56, 58, 60 and 62, which together produce a complete set of first intermediate values. The processing structure for producing the second intermediate through final values are also provided by the LLBC "building blocks", two of which are indicated by reference numerals 64 and 66. However, it will be appreciated that, because of the recursive nature of the present invention, the hardware which implements the LLBC's 50, 52, etc., can also implement the remaining LLBC's 64, 66, and so on. As mentioned above, implementation of the superlattice-superladder illustrated in FIG. 4, using the LLBC's or LBBC's, can be achieved in a fully parallel implementation, in an order-recursive implementation, or in a partioned parallel implementation. A partitioned parallel implementation of the superlattice-superladder using LLBC's will now be described herein since such implementation includes elements of both the fully parallel and order recursive implementations. Partitioned Parallel Implementation Using LLBC's With reference to FIG. 7, three LLBC's 50, 52 and 54 are illustrated within a superlattice-superladder structure for processing a signal from a system having order 7. Autocorrelation coefficients r₀ and r₁, and cross-correlation coefficient d₁, are applied to LLBC 50; autocorrelation coefficients r₁ and r₂, and cross-correlation coefficient d₂ are applied to LLBC 52, and autocorrelation coefficients r₂ and r₃, and cross-correlation coefficient d₃ are applied to LLBC 54, as shown. Also applied to each of the LLBC's 50, 52 and 54 are lattice predictor and filter coefficients k₁ and k c / 1, respectively, which are calculated from the values of r₀, r₁ and d₁ in accordance with the equations given above. Each of the LLBC's produces three outputs e, g and j in accordance with FIG. 5b and the generalized equations 18-20, above. The quantities g and j produced by LLBC 50 correspond to ζ 1 / 1 and τ 1 / 1, respectively, as shown in FIG. 6, both of which are zero and can be ignored. At this point, the quantity e output from LLBC 54 is stored for later use and the quantities g and j from LLBC 54 and the quantity e from LLBC 52 are fed back to one of the LLBC's, 54, for example, and quantity g and j from LLBC 52 and quantity e from LLBC 50 are fed back to another LLBC, 52, for example, to continue the processing of the superlattice-superladder to provide partition No. 1, as shown. In order to help illustrate the signal flow, LLBC 54′ represents LLBC 54 when the g and the j outputs from LLBC 54 and the e output from LLBC 52 are fed back to LLBC 54. Similarly, LLBC 52′ represents LLBC 52 when the g and j outputs from LLBC 52 and the e output from LLBC 50 are fed back to LLBC 52. The inputs to LLBC 52′ are also used to calculate the lattice predictor and filter coefficients k₂ and k c / 2 which are stored for later use, and also used as further inputs to LLBC's 54′ and 52′, and LLBC's 52′ and 54′ process new values of e, g, and j in accordance with equations 18-20. At this point, the quantity e from LLBC 54′ is stored, and the g and the j outputs from LLBC 54′, along with the e output from LLBC 52′, are fed back to one of the LLBC's, 54, for example, illustrated in FIG. 7 as 54″. The inputs to LLBC 54″ are also used to calculate the coefficients k₃ and k c / 3 which are stored and used in LLBC 54″. LLBC 54″ functions to process the inputs to produce a new set of e, g and j values; which values are used to produce new coefficients k₄ and k c / 4. These values are stored along with the e output of LLBC 54″ for later use. It will thus be appreciated that partition No. 1 is implemented using three LLBC's 50, 52 and 54, which function to cut through the superlattice-superladder as shown. After partition No. 1 has been processed, the autocorrelation coefficients r₃-r₆, and cross-correlation coefficients d₄-d₆ are applied to the LLBC's 50, 52 and 54, along with the stored values of k₁-k₄ and k c ₁-k c ₄ and the values of e output from LLBC 54 (54′ and 54″), to process the signal through partition No. 2, in a like manner. Finally, after the processing of partition No. 2, a single LLBC is used to implement partition No. 3, in order to finish the processing of the superlattice-superladder. Due to the edge extensions that exist along the upper part of the superlattice-superladder, in the case of FIG. 7, only superladder basic cells exist, the superlattice values being "don't cares". It will be appreciated that the parallel partitioned implementation of the superlattice-superladder involves both the parallel processing of three LLBC's within partition Nos. 1 and 2, and sequential signal processing insofar as partition No. 3 follows in time the processing of partition No. 2, which in turn follows the processing of partition No. 1. Thus, the group of LLBC's 50, 52 and 54 function to operate in parallel, to cut through the superlattice-superladder structure sequentially in three partitions. It should be noted that by using LLBC's to form the superlattice-superladder, the size of the bordering buffer (which stores the quantities e, from partition to partition) remains the same as compared to the use of the superlattice, without the superladder. FIG. 8 illustrates the signal flow through "real" and "virtual" processors organized to provide the partitioned parallel implementation of the superlattice-superladder. Three processors 51, 53 and 55 are provided, corresponding to LLBC's 50, 52 and 54 in FIG. 7, each implementing the functions of an LLBC, illustrated in FIG. 5b, and containing additional logic, registers, and the like. Also included are a plurality of double dividers 68 which function to produce the lattice predictor and lattice filter coefficients. FIG. 9 illustrates in detail the processing which is performed by a pair of processors, for example, 50 and 52, and the associated double divider 68, in accordance with the equations discussed above. Returning to FIG. 8, the signals produced by the real processors 51, 53 and 55 are fed back to the real processors in order to implement the processing of the superlattice-superladder, and in doing so perform the functions of the virtual processors as well. In other words, virtual processor 53′ does not exist in the location as shown, but is rather implemented by real processor 53 which receives at its inputs the prior outputs of the real processors. The existence of the virtual processors is simulated, in order to process an input signal in accordance with the superlattice-superladder structure of FIG. 7. At each processing iteration the e output produced by the upper processor 55 must be stored in the bordering buffer, as shown in FIG. 8 by dashed lines. As mentioned above, applying the superladder to the superlattice does not increase the size of the bordering buffer over that of the superlattice alone. It should be noted that while the lattice predictor coefficients k i are bounded by unity, and can be normalized with respect to r₀, no bounds have yet been found for the lattice filter coefficients k c / i. Consequently, larger word lengths are expected for the FIR computations and the logic used to handle these quantities should reflect the large word lengths. These lengths are problem dependent, and can be found experimentally as will be appreciated by those skilled in the art. Also, in contrast to the LBC's or BBC's described in the above cited copending applications, the LLBC's and LBBC's of the present invention each require three multiplications and three additions, as set forth in FIGS. 5a and 5b. Thus, the LLBC's and LBBC's may be realized using either three single-cycled processing elements, or a single three-cycled processing element, depending upon the requirements of speed and hardware complexity. FIG. 10 illustrates an example of a hardware implementation for providing the parallel-partitioned processing of the superlattice-superladder using three LLBC's. The parallel processors 51, 53 and 55 are shown as including the LLBC's 50, 52 and 54 of FIG.7, respectively, and associated logic. Each processor also includes an a, b, h register and an e, g, j register which function to individually store the values a, b, h and e, g, j associated with each basic cell (as illustrated in FIG. 5b) and a k, k c register wich stores the values of the lattice predictor and filter coefficients. Each of the a, b, h registers receives the appropriate auto and cross-correlation coefficients from the r/d buffer 70, via r/d bus 72. The r/d buffer 70 also directly provides the first three auto and cross correlation coefficients r₀, r₁ and d₁ to double divider and associated logic 74, which accordingly calculates the initial lattice predictor and filter coefficients k₁ and k c / 1. The outputs from double divider 74 and another double divider and associated logic 76 are applied to the k/k c buffer 78, via the k/k c bus 80. The k/k c buffer 78 provides each of the k/k c registers in each of the processors with the lattice coefficients via the k/k c bus 80. The outputs of the a, b, h register and the k/k c register in each processor are connected to their associated LLBC's, and the outputs of each LLBC are applied to its respective e, g, j register. The outputs of the e registers in the bottom and middle processors 51 and 53 are applied to the inputs of the a registers in the middle and top processors 53 and 55, respectively, while the output of the e register in the top processor 55 is applied to the bordering buffer 82 via the bordering buffer bus 84. The outputs of the e registers in the bottom and middle processors 51 and 53 are also applied to the double dividers 74 and 76 respectively. Double divider 74 also receives inputs from the g and j registers of the middle and bottom processors 51 and 53 and also from the bordering buffer 82, via the bordering buffer bus 84. Double divider 76 receives inputs from the g and j registers of the top processor 55. Finally, the outputs of the g and j registers in each of the processors are applied to the inputs of the b and h registers respectively, within each associated processor. The operation of the hardware shown in FIG. 10 to produce the superlattice-superladder processing structure illustrated in FIGS. 7 and 8 and will now be described: Phase 0 Initial Divisions (k₁/k c computation storage, transmission): The double (possibly two-cycled) divider 74 attached to the bottom processor 5I accept the first two autocorrelation coefficients and the first cross-correlation coefficient from the r/d-buffer 70 and produces k₁ and k c / 1. All other elements are idle. k₁ and k c / 1 are stored in the k/k c -buffer 78 and transmitted to the k and k c registers of each processor through the k/k c -bus 80. Phase 1 Initialization of Partition 1: The a, b, h registers of all processors are initialized through the r/d-bus 72 with the proper auto/cross-correlation coefficients. Phase 2 LLBC computations: The LLBC's of all processors compute intermediate values and store them in the e, g, j registers of each processor. Phase 3 k₂/k c / 2 computation-storage-transmission: The divider attached to the bottom processor computes k₂ from the e register of the bottom processor and the g register of the middle processor 53 and k c / 2 from the e register of the bottom processor and the j register of the middle processor. k₂ and k c / 2 are stored in the k/k-buffer 78 and transmitted to the k and k c registers of each processor through the k/k c bus 80. Phase 4 Initialization of the a, b, h registers of each processor, update of the bordering buffer: The following transfers take place: e of the bottom processor → a of the middle processor e of the middle processor → a of the top processor e of the top processor → bordering buffer g of the middle processor → b of the middle processor g of the top processor → b of the top processor j of the middle processor → h of the middle processor j of the top processor → h of the top processor Phase 5 LLBC computations with the bottom element idle: The LLBC's of the middle and top processors produce intermediate values which are stored in the corresponding e, g, j registers. Phase 6 k₃/k c / 3 computation-storage-transmission: The divider 76 attached to the middle processor 53 computes k₃, fed by the e register of processor 53 and the g register of the top processor 55, and k c / 3, fed by the e register of the middle processor and the j register of the top processor. k₃ and k c / 3 are stored in the k/k-buffer and transmitted to the k and k c registers of each processor through the k/k c -bus. Phase 7 Initialization of the a, b, h registers, update of the bordering buffer: The following transfers take place: e of the middle processor → a of the top processor e of the top processor → the bordering buffer g of the top processor → b of the top processor j of the top processor → h of the top processor Phase 8 Top LLBC computations with the bottom and middle processors idle: The top LLBC 54 computes intermediate values and stores them in its e, g, j registers. Phase 9 Bordering buffer update: The following transfer takes place: e of the top processor 55 → bordering buffer Phase 10 k₁/k c / 1 retransmission: k₁ and k c / 1, which have been stored in the k/k c -buffer are transmitted to the k and k c registers of all processors through the k/k c -bus. Phase 11 Initialization Partition 2: The a, b and h registers of all processors are initialized through the r/d-bus with the proper auto/cross-correlation coefficients. Phase 12 LLBC Computations: The LLBC's of all processors compute intermediate values and store them in the e, g and j registers of each processor. Phase 13 Initialization of the a, b and h registers, update of the bordering buffer and k₂/k c / 2 retransmission: The following transfers take place: The a register of the bottom processor is initialized from the bordering buffer. k₂ and k c / 2 are retransmitted to the k and k c registers of all processors. e of the bottom processor → a of the middle processor e of the middle processor → a of the top processor e of the top processor → bordering buffer g of the bottom processor → b of the bottom processor g of the middle processor → b of the middle processor g of the top processor → b of the top processor j of the bottom processor → h of the bottom processor j of the middle processor → h of the middle processor j of the top processor → h of the top processor The a register of the bottom processor must be initialized from the bordering buffer before the contents of the latter are destroyed by the storage of the newly computed contents of e register in the top processor. Phase 14 LLBC computations: The same as phase 12. Phase 15 Initialization of the a, b, h registers, update of the bordering buffer, k₃/k c / 3 retransmission. The same as phase 13, but k₃ and k c / 3 are retransmitted instead of k₂ and k c / 2. Phase 16 LLBC Computations: The same as phase 12. Phase 17 k₄/k c / 4 computation-storage-transmission: The divider attached to the bottom processor computes k₄ fed by the g register of the bottom processor and a quantity from the bordering buffer, and k c / 4 fed by the j register of the bottom processor and the same quantity from the bordering buffer. k₄ and k c / 4 are stored in the k/k c -buffer and transmitted to the k and k c registers of each processor through the k c / 4 bus. Phase 18 Initialization of the a, b, h registers, update of the Bordering Buffer: The same as phase 13, except the k₂/k c / 2 retransmission. Phase 19 LLBC Computations: The same as phase 12. Phase 20 k₅/k c / 5 computation-storage-transmission: The same as phase 3, but k₅ and k c / 5 are computed-stored-transmitted instead of k₂, k c / 2. Phase 21 Initialization of the a, b, h registers, update of the bordering buffer: The same as phase 4. Phase 22 LLBC computation with the bottom processor idle: The same as phase 5. Phase 23 k₆/k c / 6 computation-storage-transmission: The same as phase 6, but k₆ and k c / 6 are computed-stored-transmitted instead of k₃ and k c / 3. Phase 24 Initialization of the a, b, h registers, update of the bordering buffer: The same as phase 7. Phase 25 Top LLBC computations with the bottom and middle processors idle: The same as phase 8. Phase 26 Bordering buffer update: The same as phase 9. Phase 27 k₁/k c / 1 retransmission: The same as phase 10. Phase 28 Initialization of partition 3: The same as phase 11. The continuation through the third partition will be understood by those skilled in the art in view of the foregoing. The superlattice-superladder concept is suitable for efficient hardware implementation with commercially available processors. A small number of processors, e.g. three to six, may be used for many applications with very good results and a substantial increase in processing speed over that of prior art signal processors. It will thus be appreciated that the present invention allows the use of a feasible number of parallel processors to perform highly efficient LS-FIR signal processing. When so implemented, the parallel-partitioned implementation provides the benefits of parallel processing, manageable hardware complexity, and optimal signal processing for a given number of available processors.

Claims: 1. A signal process or which receives autocorrelation and cross-correlation coefficients (τ i , d j , i = [0 to p], and j = [1 to p] from a system, for providing lattice coefficients of said system, comprising: (a) means (70) receiving a plurality of said autocorrelation and cross-correlation coefficients: (b) means (50, 52, 54) multiplying a first pair of adjacent autocorrelation coefficient (τ i , τ i+1 ) by a first lattice coefficient (k j ), resulting in respective first pair and second products, and adding (i) to said first product the one of said first pair of autocorrelation coefficients which s not involved in said first product, and (ii) the other of said first pair of coefficients to said second product, to yield a first pair of first intermediate values, during a first time interval, (c) means multiplying one (τ i ) of said first pair of autocorrelation coefficients by a second lattice coefficient (k c / j), resulting in a third product, and adding a first cross-correlation coefficient (d i+1 ) to said third product to yield a third first intermediate value, during said first time interval; and (d) divider circuitry (74) forming the quotient of a selected pai of autocorrelation coefficients to produce said first lattice coefficient, and forming the quotient of a selected autocorrelation coefficient and a selected cross-correlation coefficient to produce said second lattice coefficient. 2. The signal processor of claim 1 further comprising: (a) means for multiplying a second pair of adjacent autocorrelation coefficients by said first lattice coefficient, resulting in respective fourth and fifth products, and for adding (i) one of said second pair of autocorrelation coefficients, to said fourth product, and (ii) the other of said second pair of autocorrelation coefficients to said fifth product, to yield a second pair of first intermediate values, during a second time interval; and (b) means for multiplying one of said second pair of autocorrelation coefficients by said second lattice coefficient, resulting in a sixth product, and for adding a second cross-correlation coefficient to said sixth product to yield a sixth first intermediate value, during said second time interval; wherein said divider circuitry forms a pair of quotients of selected ones of said first intermediate variables, to provide third and fourth lattice coefficients. 3. The signal processor of claim 2 further comprising: (a) means for multiplying a selected two of said first intermediate values in said first and second pairs thereof by said third lattice coefficient, resulting in respective seventh and eighth products, and for adding (i) a first of said selected two intermediate values to said seventh product, and (ii) a second of said selected two intermediate values to said eighth product, to yield a pair of second intermediate values, during a third time interval; and (b) means for multiplying one of said first intermediate values in said first and second pairs thereof by said fourth lattice coefficient to produce a ninth product, and for adding one of said third and sixth first intermediate values to said ninth product to yield a third second intermediate value, during said third time interval. 4. The signal processor of claim 3 wherein said processor means comprises a plularity of parallel processing units, and wherein said first and second time intervals occur substantially simultaneously, and precede said third time interval. 5. The signal processor of claim 3 wherein said processor means comprises a single processing unit, and wherein said first time interval precedes said second time interval, and said second time interval precedes said third time interval. 6. The signal processor of claim 3 wherein one of said first pair of adjacent autocorrelation coefficients is the same as one of said second pair of adjacent autocorrelation coefficients. 7. The signal processor of claim 3 wherein one of the selected two of the first intermediate values is taken from said first pair of first intermediate values and the other of said selected two of the first intermediate values is taken from said second pair of first intermediate values. 8. The signal processor of claim 3 wherein said one of said first intermediate values, multiplied by the fourth lattice coefficient, is one of said selected two first intermediate variables. 9. A signal processor comprising: at least two paralllel processing units (50, 52), each of which includes a processor according to claim 1; and a storage and retrieval structure for reapplying at least two of said trio of first intermediate values from one of said at least two parallel processing units, and for applying at least one of said trio of first intermediate values from a parallel processing unit adjacent to said one processing unit, to at least one of said parallel processing units, to (a) thereby multiply a pair of said first intermediate values by a third lattice coefficient to produce respective fourth and fifth products, and (b) thereby multiply one of said pair of first intermediate values by a fourth lattice coefficient to produce a sixth product, and to add one of said first intermediate values to said fourth product, a second of said first intermediate values to said fourth product, and a third of said first intermediate values to said sixth product, to yield a respective trio of second intermediate values. 10. The signal processor of claim 9, wherein said divider circuitry forms (i) the quotient of two autocorrelation coefficients, to produce said first lattice coefficient, (ii) the quotient of an autocorrelation coefficient and a cross-correlation coefficient, to produce said second lattice coefficient, and (iii) a pair of quotients of said first intermediate values to produce said third and fourth lattice coefficients. 11. A signal processor which receives autocorrelation coefficient and a cross-correlation coefficients from a system, for providing lattice coefficients of said system, comprising: (a) means for receiving a plurality of autocorrelation and cross-correlation coefficients; (b) means for multiplying a first autocorrelation coefficient by a first lattice coefficient, resulting in a first product, and for individually adding a first pair of autocorrelation coefficients, adjacent to said first autocorrelation coefficient, to said first product, to yield a first pair of first intermediate values, during a first time interval; (c) means for multiplying said autocorrelation coefficient by a second lattice coefficient, resulting in a second product, and for adding a cross-correlation coefficient to said second product to yield a third first intermediate value, during said first time period; and (d) divider circuitry for forming the quotient of a selected pair of autocorrelation coefficients to produce said first lattice coefficient, and for forming the quotient of a selected autocorrelation coefficient and a selected cross-correlation coefficient to produce said second lattice coefficient. 12. The signal processor of claim 11, wherein said divider circuitry forms a pair of quotients of said first intermediate variables to produce third and fourth lattice coefficients. 13. A method for providing lattice filter coefficients k c / 1-k c / p+1 system, having order P, comprising receiving, in a signal processor, autocorrelation coefficients r o -r p and cross-correlation coefficients d₁-d p+1 , corresponding to said system, receiving, in a plurality of parallel processing units (51, 53, 55), during a first time interval, less than all of said autocorrelation and cross-correlation coefficients, the number of processing units being less than the system order P, producing, in said plurality of processing units (51, 53, 55), a plurality of first intermediate values selectively re-applying ones of said first intermediate values to at least one of said parallel processing units, to produce a plurality of second intermediate values said first and second intermediate values being produced in succession within said first time interval; applying at least some of the remaining autocorrelation and cross-correlation coefficients, not previously applied to said parallel processing units, to at least one of said plurality of parallel processing units, to thereby produce additional first and second intermediate values during a second time interval, subsequent to said first time interval; and dividing autocorrelation coefficient r₁, by r 0 to produce k₁, dividing first intermediate value - ζ 1 / 2 by ζ 1 / 0 to produce K₂, dividing - d₁ by r 0 to produce K c / 1 and divinding - τ 1 / 2 by ζ 1 / 0 to produce K c / 2.

Inventors: CARAYANNIS, GEORGE, HALKIAS, CHRISTOS, KOUKOUTSIS, ELIAS, MANOLAKIS, DIMITRIS
Applicants: ADLER RESEARCH ASSOCIATES
Application year: 1988
Main classification: G06F15
IPC codes: H03H17, G06F17