DIGITAL FILTER HAVING HIGH ACCURACY AND EFFICIENCY

Abstract: Apparatus for and methods of operation of digital filters and certain other electronic digital signal processing devices are provided to improve the accuracy and efficiency of filtering. Particularly, the apparatus and method includes a digital filter with a long impulse response and lower latency, built by operating a numbr of small component filters (F1, F2, F3) in parallel and combining their outputs by addition, with each component filter operating with a different delay such that the net operation of the ensemble of said component filters is the same as a single filter with a longer impulse response, and the latency of the ensemble is equal to the shortest latency of the component filters. At least one group of the component filters is implemented using a Discrete Fourier Transform technique. A Fourier transform processor adapted to efficiently transform strings of real data is also described.

Description: DIGΓΓAL FILTER HAVING HIGH ACCURACY AND EFFICIENCY FIELD OF THE INVENTION The present invention relates to the art of electronic signal processing, and more particularly but not exclusively, to an electronic filtering environment wherein relatively high accuracy and efficiency is desired and a relatively short flow-through delay (termed "latency") is desired. DESCRIPTION OF THE PRIOR ART With reference to Fig. I, electronic filters are utilised to modify the characteristics of an incoming electronic signal so as to provide an output signal which is modified in some defined fashion. In the case of Fig. 1 a "notch" filter is illustrated wherein, in the frequency domain, frequencies in the spectrum of the incoming signal SI are attenuated in the Fi to F2 band so as to produce output signal S2. Such filters can be implemented from entirely analog components although, in more recent times, there is a pre erence, in many circumstances, to implement the filter in a digital fashion. Digital implementation can be by means of dedicated digital circuitry or by means of computers (micro processors) programmed to operate as a filter. Filters have many applications in the field of electronic modelling of real world conditions. For example. filters can be used to provide a model of the acoustic characteristics of rooms or hails. Filters are also used to model deficiencies in systems so as to apply appropriate correction factors for the purpose cf removing : cancelling; i per ections in signals caused by the deficiencies. Frequently it is desirable that such processing take place in "real time". Also, it is desirable that there is effectively no delay in filtering of a signal generated in a real/live environment so that the modelling/correcting steps performed by the filter are, to all intents and purposes, without any delay being perceptible to the end user. To achieve this the delay introduced by the filter F while it performs its filtering function must be reduced to a negligible figure. That is, the time when signal SI first presents to filter F and the time when the results of the filtering by filter F of the first incoming portion of signal SI become available at the output of the filter S2 must be almost the same. The delay between these two events is hereinafter referred to as the "latency" of the filter system. Where the filter F is implemented in a digital manner it may first be necessary to sample the incoming signal SI (via an analog to digital converter) then perform the filtering function and then convert the digital signal back to an analog signal (by means of a digital to analog converter) . The sampling process takes samples of the incoming signal at discrete time intervals t^. The time between each sample is usually the same. The sampling processing itself introduces finite delays into the system. Additionally, where the filter is implemented by one of the popular fast convolution techniques there is a delav introduced which, in very broad terms, is SUBSTITUTESHEET proportional to the accuracy (or length) of the filter. Mathematically, the filtering operation (that is, the step of imposing the filter characteristic upon the incoming signal SI so as to produce outgoing signal S2) is known as "convolution" in the time domain. The step of convolution in the time domain becomes a multiply operation in the frequency domain. That is, if the incoming signal SI is first sampled, then Fourier transformed into the frequency domain, the frequency response of the filter F is vector multiplied with the Fourier transform of the signal SI. The signal is then inverse Fourier transformed to produce a sampled (convolved) output (which can be converted back to analog form if required) . Figure 2 shows the way a convolver (also known as a Finite Impulse Response (FIR) filter) has its impulse response {a k } measured (for a convolver operating on a treatment of sampled data) . For a physical filter, a k is zero for all k<0. For a general input sequence {x k }, the filter's output {Y k } is defined as: A linear filter such as this has a measurable latency, d, defined as:- a d ≠0, and SUBSTITUTE SHEET In other words, a d is the first non-zero value in the output sequence. The latency d is never negative in a physical system. In a similar fashion, for a Finite Impulse Response Filter, we can determine which is the LAST non-zero value in the output sequence. This will give us the length of the impulse response. If we call the length /, then this means that a^.^ is the last non-zero value in the output sequence (see Figure 3) . Typical schemes for implementing FIR filters fall into two categories:- l. Time domain filters that compute each output sample as each new input sample arrives, thus allowing latencies as low as d=0 or d=l. Typical filter lengths (/) are short. 2. Fast convolution filters that compute a number of output samples in a block. Typical filter lengths (/) can be very long. The lowest achievable latency is usually related to the filter length, ∞l÷K ° ~~ K«l÷d (3) where K is a measure of the efficiency of the particular algorithm used. A typical value of K, for the commonly used fast convolution algorithms such as illustrated in Figs. 4 and 5, is 0.5. BRIEF DESCRIPTION OF THE INVENTION It is an object of at least a preferred embodiment of the , present invention to provide a method and apparatus for performing relatively long convolutions on digital sampled SUBSTITUTE SHEET c.ata so as to provide relatively higher efficiency for a given length than is ordinarily produced with other methods. In this speci ication it is assumed that the filter characteristics can be modelled as approximately linear so that the principles of superposition can be applied. Accordingly, in one broad form cf the invention there is provided a filter with a long impulse response and low latency, built by operating a number of smaller component filters in parallel and combining their outputs by addition, with each component filter operating with a different delay- such that the net operation of the ensemble of said component filters is the same as a single filter with a longer impulse response-, and the latency of the ensemble is equal to the shortest latency of the said component filters. Preferably the component filters are implemented in different ways, with some filters adapted to provide low latency, and other filters adapted to provide longer filter lengths, such that the ensemble filter provides both low latency and long impulse response characteristics. Preferably one or more of the component filters is implemented as a time-domain finite impulse response filter (built with multiply and add operations) and the remainder are implemented using a fast convolution method, such that the time-domain filter(s) provides the lowest latency portion of the ensemble impulse response, and the fast-convolution ilter(s) provide the longer filter components. Preferably the ast-convolution filters are built using t e Discrete Fourier Transform c s Fast Fourier Tra s OTT. SUBSTITUTE SHEET In an alternative preferred form the fast-convolution filters are built using the Modified Discrete Fourier Transform as described in this specification. Preferably a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation. In an alternative preferred form a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one inverse transform operation is performed for each group, so that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. In a further alternative preferred form a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation; and wherein a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using ε SUBSTITUTE SHEET " ■ ransform of the same length, and wherein onlv .one inverse transform operation is performed for each group, sc that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. In a further broad form of the invention there is provided a method for building a digital filter with a long impulse response and low latency, built by operating a number of smaller component filters in parallel and combining their outputs by addition, with each component filter operating with a different delay such that the net operation of the ensemble of said component filters is the same as a single filter with a longer impulse response, and the latency of the ensemble is equal to the shortest latency of the said component filters. Preferably the component filters are implemented in different ways, with some filters adapted to provide low latency, and other filters adapted to provide longer filter lengths, such that the ensemble filter provides both low latency and long impulse response characteristics. Preferably one or more of the component filters is implemented as a time-domain finite impulse response filter (built with multiply and add operations) and the remainder are implemented using a fast convolution method, such that the time-domain filter(s) provides the lowest latency portion ^r the ensemble impulse response, and the ast-convolution filter(s) provide the longer filter components. SUBSTITUTESHEET Preferably the ast-convolution filters are built using the Discrete Fourier Transform or the Fast Fourier Transform. Preferably the ast-convolution filters are built using the Modified Discrete Fourier Transform as described in this specification. Preferably a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation. In an alternative preferred form a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one inverse transform operation is performed for each group, so that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. In a further alternative preferred form a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform ooeration: wherein a σrouo cr σrouDS of more than one cf the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one inverse transform operation is performed for each group, so that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. In yet a further broad form of the invention there is provided a digital filter for filtering overlapped groupings of consecutive samples a, b, c, ά . . . . , said filter comprising a transform processor of length m, and N filter processors, each of length k, an adder adapted to sum the outputs as they are fed in parallel from said N filter processors, an inverse transform processor of length m: said consecutive samples a, b, c, d being fed in blocks of length m, each of said blocks being passed through said transform processor and then through each of said N filter processors with a delay of zero before being passed through a first filter processor of said N filter processors, a delay of k before being passed through a second filter processor and so on up to a delay of (N-l)k before being passed through the Nth filter processor; whereby a filter of effective length Nk is effected with a latency corresponding to that of a conventional filter of length k. In a further broad form of the invention there is provided a method of implementing a filter with a relatively high length/latency efficiency X; said method comprising transforming progressive, consecutive and overlapping SUBSTITUTE SHEET - 10- portions of input data into the frequency domain , t o produce corresponding transformed data, storing said corresponding t ransformed data, so as to effect passing said por t ions of ' transformed da t a through a transform processor consecu t ively ; reeding a firs t transformed portion through a first filter function processor ; then feeding said first transformed portion through an N-lth filter function processor whilst an N-lth transformed portion is being fed through said first filter function processor; and so on so t hat a continuously mov i ng N consecutive blocks of input data are t ransformed and passed through N filter function processors ; adding the output from said N filter function processors ; inverse transforming said output; performing a discard operation as necessary whereby consecutive portions of filtered ou t put data are produced from said progressive, consecutive and overlapping portions of input data. In a further broad form of the invention there is provided a method of implementing a filter with a rela t ively high length/latency efficiency K; sa id method comprising applying a mathematical transform to progressive , consecutive and overlapping portions of input data so as to produce corresponding transformed data; performing a mathematical operation on individual ones (i.e. two or more ) of said transformed data ; superposing (by addition ) the data resulting from said mathematical operations so as to produce resultant data ; applying an inverse mathema t ical t ransform to said resultant da t a so as to produce filtered ou t put data. SUBSTITUTE SHEET Preferably each said filter function processor is processing a filter whose Impulse Response is half the length of the transform processor. Preferably said transform processor is a Fast Fourier Transform Processor and said inverse transform processor is an inverse Fast Fourier Transform Processor and said filter function processor is effected by a multiply operation of transformed input data with an impulse response corresponding to a selected portion of a desired impulse response for the entire filter. Preferably said method is optimized whereby an approximately equal amount of processing time is spent on Fourier transformation as on filter function (multiply) operation. In a further broad form of the invention there is provided a method of implementing a filter with a relatively high length/latency efficiency X; said method comprising transforming progressive, consecutive and overlapping portions of input data into the frequency domain, performing a mathematical operation on individual ones of said transformed signals, superposing (by addition) the consecutive signals resulting from said mathematical operations, inverse transforming the resultant signal from the frequency domain back to the time domain and outputting said signal . Preferably said transform is a Fast Fourier Transform and said inverse transform is an Inverse Fast Fourier Transform. SUBSTITUTESHEET Preferably said mathematical operation is a vector multiply of the Fourier transformed input signal segment with the frequency response of the desired (time domain) filter characteristic. Preferably the underlying operation is an overlap and discard operation on successive, overlapping portions of input data. Alternately the underlying operation is an overlap and add operation on successive, overlapping portions of input dated. In a particular preferred form the Fourier transform of any given overlapping block of input samples is taken only once and reused as required. Preferably, the inverse Fourier transform of any given summed grouping of filtered data is performed only once. In a particular preferred form the above described method is utilised to implement at least some of the filter modules of a composite electrical filter; said composite electrical filter comprising a plurality of filter modules arranged to receive in parallel an incoming input signal for filtering; the output from each of said filter modules being summed to produce a composite filtered output signal; each of said filter modules adapted to have an impulse response that is a selected portion of the impulse response of the composite filter. It is preferable to minimise the overlap of the selected portions of impulse response, or to make them not overlap at all . SUBSTITUTESHEET Preferabiv the length of each of said filter modules is different with the characteristic of the shorter length filter modules adapted to process first (or earlier) portions of said impulse response and longer length filter modules adapted to process following (or later) portions of said impulse response. Preferably said longer length filter modules are adapted to filter progressively longer portions of said impulse response. In a particular preferred form, the shortest module of said plurality of filter modules is a time-domain (low latency) filter whilst additional ones of said filter modules are longer fast-convolution (longer latency) filters implemented using the Fast Fourier Transform method described above or other traditional fast convolution methods. It is an object of at least a further preferred embodiment of the present invention to provide a method and apparatus for performing relatively long convolutions on digital sampled data so as to provide relatively lower latency than is ordinarily incurred with other methods. It is assumed that the filter characteristics can be modelled as approximately linear so that the principles of superposition can be applied. Accordingly, in yet a further broad form of the invention, there is provided a composite electrical filter comprising a plurality of filter modules arranged to receive in parallel an incoming input signal for filtering; the cutout from each of said filter modules oeinα summed to SUBSTITUTESHEET produce a composite filtered output signal; each of said filter modules adapted to have an impulse response that is a selected portion of the impulse response of the composite filter. It is preferable to minimise the overlap of the selected portions of impulse response, or to make them not overlap at all. Preferably the length of each of said filter modules is different with the characteristic of the shorter length filter modules adapted to process first (or earlier) portions of said impulse response and longer length filter modules adapted to process following (or later) portions of said impulse response. Preferably said longer length filter modules are adapted to filter progressively longer portions of said impulse response. In a particular preferred form, the shortest module of said plurality of filter modules is a time-domain (low latency) filter whilst additional ones of said filter modules are longer fast-convolution (longer latency) filters. Preferably only the shortest of said filter modules is a time domain filter. In a further particular preferred form, where the number of said filter modules is N comprising filters F-: , F ...F jj filter module F^ is a filter with very low latency implemented with time domain techniques whilst ail other filter modules F± are implemented with fast convolution techniσues and these fast convolution filters SUBSTITUTE SHEET 7__ are composed of a sequence of filters each with longer filter length than its predecessor and hence each with longer latency, but still preserving the property that ά j +1 =d_-_-!■. whereby it is ensured that the composite filter F output formed by summing together the N component filter outputs has an impulse response without any "holes" in it. In a further broad form of the invention there is provided a method of filtering sampled data so as to achieve a relatively long length but short latency filtering of said data, said method comprising passing said data in parallel through a plurality of sub-filters and summing the output samples from all of said sub-filters to produce filtered sampled data; and wherein the Impulse Response of each of said sub-filters is a selected portion of the desired Impulse Response of the filter characteristic required to produce said filtered sampled data from said sampled data and wherein each said selected portion is selected for each of said sub- filters such that the output from all of said sub-filters, when summed, behaves as if filtered through a filter having said desired Impulse Response. In a particular implementation of the invention, there is provided a method and filter incorporating a fourier transform processor adapted to efficiently transform strings of real numbers: said processor operating according to the following method: 1. Take the input vector x(k) of length N, where each element of x(k) is real. SUBSTITUTE S HEET 2. Create the vector x* (/) , a complex vector of length N/2 by application of the following: 3. Compute the N/2 point DFT of x' (/) to give the N/2 complex result vector Z(p) : Embodiments of the invention will now be described with reference to the accompanying drawings wherein:- BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a generalised block diagram of a filter operation in the frequency domain, Fig. 2 defines the basic terminology used for a convolution filter, Fig. 3 defines the latency and length of the filter of Fig. 2, Fig. 4 illustrates in a diagrammatic flow chart form, a prior art method of processing sampled data by a Fast Fourier Transform approach, Fig. 5 further illustrates the approach of Fig. 4, Fig. 6,7,8 develop a method of filtering according to a generalised first embodiment of the invention whereby a relatively high efficiency factor K can be achieved as compared with the approach of Fig. 4, SUBSTITUTE SHEE 3T - ". 7 - Fig. 9 is a diagram of an embodiment of the invention implementing the method of Fig. 8 where the number of sub-filters is 6, Fig. 10 illustrates in block diagram form a summed filter a part of which can be implemented advantageously with the filter of Fig. 8, Fig. 11 is a block diagram of the summed filter of Fig. 10 incorporating sub-filters some of which implement the method of Fig. 8, Fig. 12 illustrates the manner of processing of an input signal by an example of the filter arrangement of Fig. 10 which utilised five filter portions, Fig. 13 illustrates the manner of selection of the filter characteristics of the filter of Fig. 12, Fig. 14 is a bloc diagram of an alternative implementation of the summed filter of Fig. 8, Fig. 15 illustrates a typical flow of a (prior art) fast convolution algorithm implementation suitable for filters F2 - F 5 of Fig. 12, Fig. 16 illustrates a DFT engine which forms the basis for an explanation of a fourier transform algorithm optimised to process real number strings, and SUBSTITUTESHEET Fig. 17 is a block diagram of a further embodiment of the invention wherein the summed filter of Fig. 10 is implemented utilizing a Modified Discrete Fourier Transform. DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION 1. High Efficiency Filter Figure 4 illustrates the time-flow of a typical fast- convolution algorithm. This is an overlap-discard algorithm implemented using the Fast Fourier Transform (FFT) . 2M words of input data that arrives during time segments a and b is processed fully during time segment c with a forward FFT, a vector multiply, and an inverse FFT. The resulting M words of output data are buffered, to be presented at the output during time segment d. The FFT and inverse FFT(IFFT) are only used to transform the data between the time-domain and frequency domain. The actual filter operation is executed in the vector multiply operation, which actually takes only a small fraction of the total compute time. So, the relevant parameters of the filter of Fig. 4 are:- Length = M, Latency = 2M, and, therefore X = 0.5 With reference to Figs. 6, 7 and 8, the rationale behind the method and apparatus according to at least one embodiment of the present invention is derived. Fig. 6 illustrates a filter of length ML where the filter characteristics of each of the component ilters Fl , SUBSTITUTESHEET PCT/AU93/00330 - -, Q _ F2 F n are separate, discrete, component portions of the desired filter characteristic for the en t ire filter assembly. The delays L, 2L.... (M-l) L are imposed as illustrated so as to recreate, following addition, an output y k equivalent to that achieved by passing inpu t samples x t hrough a filter having the filter characteristic from which the filter characteristic portions for filters Fl, F2 were derived. Fig. 7 is derived by implementing the filters Fl, F2 of Fig. 6 using the Fast Fourier Transfor algorithm of Fig. 5. With reference to Fig. 8, reorganisation of the filter of Fig. 7 allows the use of only one Fast Fourier Transform module 11 and one inverse Fast Fourier Transform module 12. It is implicit that the Fast Fourier Transform module is adapted to process a block of samples from input x k equal to twice the length of each of the filters Filter 1, Filter 2 , Filter 3 illustrated in Fig. 8. As previously stated the filter characteristic (impulse response ) of each consecutive filter Fl , F2 is taken from and corresponds to consecutive corresponding portions from the impulse response desired of the entire filter module. The time delay L before each Fast Fourier transformed block of data is passed through the next filter is equal to half the sample length originally processed by the Fas t Fourier Transform module. Figure 9 shows the computation of one block of output data, in a similar style to Figure 4, but using the improved -eng t h/la t ency efficiency method derived in Figs. - , , ~ and 8 SUBSTITUTE SHEET The method of Fig. S as used by Fig. 9 is summarised below. During time segment h. the input data that arrived during time segments f and g is FF 'd and the resulting block of Frequency Domain Input Data is stored for future use. We then compute the next block of Frequency Output Data, which is inverse FFT'd and presented as output during time segment i. The old way of computing fast-convolution simply took the latest block of Frequency Domain Input Data, and multiplied it by a vector that represents the desired filter response, to get the new Frequency Domain Output Data. The improved length/latency efficiency method uses a number of previous Frequency Domain Input Data blocks to compute the new Frequency Domain Output Data block, as shown in Figure 9. In this example, the blocks of filter data are called Filter A, Filter B, ..., Filter F. In this example, the filter implemented is 6 times as long as the filter implemented in Figure 4, but with no greater latency. By comparison with Fig. 4, the relevant parameters of the filter of Fig. 9 are: - Length = 6M, Latency = 2M, and, therefore X = 3 Fig. 8 summarises the logic behind the implementation of the embodiment of Fig. 9. Particularly, it will be noted that the progressive delays L, 2L, 3L, ...(M-l)L of Fig. 3 are achieved in Fig. 9 by the taking of delayed, overlapped groupings of consecutive samples a, b, c, d, ... SUB S TITUTESHEET - : - The above described filter arrangement can be used advantageously in a low-latency FIR filter arrangement such as illustrated in Fig. 10. Figure 10 shows an architecture for implementing an FIR filter by adding together N filters. If each filter is characterised as: Filter F^, latency d^, length 1^, then generally the N filters are chosen so that their latencies are ordered in ascending order, and furthermore ^i+l =d i +i i- This means that the first non-zero value in the impulse response of filter . comes immediately following the last non-zero value in the impulse response of filter F j _. Hence this summation of filters results in a single, longer filter with its impulse response being the sum of the impulse responses of the N component filters. The important property of this filter is the length/latency efficiency, X, which is higher than any of the component filter efficiencies. That is, the filter of Fig. 10 uses the technique of adding together several filters to form a new filter which is as long as the sum of the component filter lengths, and whose latency is as short as the latency of the lowest-latency component filter. Fig. 11 shows an implementation of the low-latency filter 10 of Fig. 10 wherein there are three filter modules Fl , F2 , F3. The first module Fl is a low-latency (d=0) time domain filter whilst filters F2 and F3 are implemented according to the embodiment described in respect of Figs. 8 and 2 . SUBSTITUTESHEET 2. A low-latency FIR filter As previously described. Fig. 10 shows an architecture for implementing an FIR filter by adding together N filters. If each filter is characterised as: Filter F__ , latency d j _ , length I_ , then generally the N filters are chosen so that their latencies are ordered in ascending order, and furthermore d^ +1 =d;+l^. This means that the first non¬ zero value in the impulse response of filter F^ +i , comes immediately following the last non-zero value in the impulse response of filter F^. Hence this summation of filters • results in a single, longer filter with its impulse response being the sum of the impulse responses of the N component filters . The important property of this filter is the length/latency efficiency, X, which is higher than any of the component filter efficiencies. That is, the filter of Figs. 10 and 12 uses the technique of adding together several filters to form a new filter which is as long as the sum of the component filter lengths, and whose latency is as short as the latency of the lowest-latency component filter. Particularly, the composite filter assembly of Fig. 12 utilises the technique of combining a first time-domain (low latency) filter with additional fast-convolution (longer latency) filters to maximise filter length while minimising latency. This technique is implemented by adding together N filters, Fι_ , F 2 , ■ ■ - ~~ j where Fι_ is a filter with very low latency, implemented with time-domain techniques, and the SUBSTITUTE SHEET other filters. *. , are each implemented with fast- convolution techniques. More specifically, the assembly adopts the technique whereby the N-l ast-convolution filters, Fi , are composed of a sequence of filters, each with longer filter length than its predecessor, and hence each with longer latency, but still preserving the property that This ensures that the filter, F, which is made by summing together the N component filters, has an impulse response without any "holes" in it. With particular reference to Fig. 12 the composite filter F comprises five filter portions Fl , F2 , F3 , F4 and F5. The impulse response a., of the composite filter F is illustrated at the top of Fig. 12 and has a total sample length of 1024 samples. Filter Fl has an impulse response comprising the first 64 samples of the impulse response a k . That is, the filter has a length of 64 samples. The filter as implemented has a low latency filter (such as is referenced in Motorola document APR 7/D in respect of the DSP 56000 series of Integrated Circuits). This filter has an effective latency of 0. The subsequent filters F2 , F3 , F4 , F5 are implemented using fast convolution digital techniques. Fig. 15 illustrates the basic algorithm for such techniques which comprises taking the fast Fourier transform of the incoming sampled data, multiplying the transformed data samples by the impulse response of the filter, converting the fast Fourier transformed data samples back to the time doma V use cf an SUBSTITUTESHEET inverse fast Fourier transform and then outputting the data. An overlap/discard method is used whereby only a portion cf the output data is utilised. The length and latency of the additional filters F2 , F3. F4 , F5 is selected according to the rule illustrated diagrammatically in Fig. 13, whereby each filter portion has a latency equal to the sum of the length and the latency of the immediately preceding filter portion. In this case the end result is a filter having a total length of 1024 samples and a latency of 0. Fig. 14 illustrates a variation of the filter of Fig. 3 wherein delay is introduced after the filter algorithm is applied in the frequency domain. 3. Optimized Real String Handling With reference to Fig. 16, a common method of frequency analysis is via the Discrete Fourier Transform (hereafter referred to as the DFT) , which can be implemented efficiently in electronic apparatus using the Fast Fourier Transform algorithm (hereafter referred to as the FFT) . The DFT is formulated to operate efficiently when its input data and output data are both complex (having a real and imaginary component). When the data input to the DFT is real, the output data from the operation will contain some redundancy, indicating that some cf the processing that led -co this output data was unnecessary. In this embodiment what is described is a new transform for operating on real numbers in the digital environment, that has many of the same applications as the DFT, but SUBSTITUTE SHEET without the inefficiencies of the DFT for operation on real numbers. For the purposes of this document, the algorithm described herein will be named the Modified Discrete Fourier Transform (MDFT) . The DFT is computed according to the equation below: If the input data x(k) is real (ie. it has no imaginary component) , the output data X(n) has the following properties: X(0)e« X eSt (2) X(n) = [X(N-n)Y for 0<n< Where the * operator is used to signify complex conjugation. This means that the imaginary part of X(O) , the imaginary part of X(N/2) and all {X(n) :N/2<n<N} are redundant. The process of extracting only the necessary information out of the DFT output is therefore not trivial. An alternative transform is shown below: -2ιy*(n*i) Y(ή) - ∑ x(k)e N (3) This is like a standard DFT except that the output vector Y(n) represents the signal's frequency components at different frequencies to the DFT. The output vector Y(n) has redundancies (just as the DFT output X(n) has), except that SUBSTITUTE SHEE " the redundant part of the data is more clearly extracted from Y(n) that from X(n) . The redundancy in Y(n) that results when x(k) is real can be expressed as follows: Y(n) = [Y(N-l-ή]' (4) This implies that the second half of this vector Y(n) is simply the complex conjugate of the first half, so that only the first half of the output vector is required to contain all of the information, when x(k) is real. An alternative view of the above equation is that all of the odd elements of the vector are simply the complex conjugate of the even elements: F(l) = [K(N-2)]- 7(N-3) = [Y(2)Y r(N-D = [Y )γ This means that we only need to compute the even elements of Y(n) to obtain all of the required information from the modified DFT of the real signal x(k) . We can name the array Z(p) the array that contains the even elements from Y(n), as follows: Zip) = Y(2p) for 0≤p<ϊ (6) Based on our previous equation for Y(n), we get: Zip) = Y(2p) = ∑ (*)e N (7) *-o which after some manipulation becomes : 2 -mjk -litjpk Zip) = ∑ [xik) -jx(k^)]e N e «» (8) *-o SUBSTITUTE SHEET if we create an N/2 length complex vector from the N length real vector: x'il) = [x(t) -jx(l + - \e N for O ≤l<N/2 (9) then we can see that: Zip) = DFT (m) [x' ' Q] (10) This means that we have computed the vector Z(p) by using a DFT of length N/2. We say that Z(p)=MDFT[x(k) ] (where MDFT indicates the Modified Discrete Fourier Transform operator) . The procedure to follow for computing Z(p) is then as follows: 1. Take the input vector x(k) of length N, where each element of x(k) is real. 2. Create the vector x' (/) , a complex vector of length N/2 by the method of equation (9) above. 3. Compute the N/2 point DFT of x' (/) to give the N/2 complex result vector Z(p) . The MDFT has many properties that make it useful in similar applications to the DFT. Firstly, it can be used to perform linear convolution in the same way as the DFT. Secondly, it has an inverse transform that looks very similar to the forward transform: x'(k) = IDFT m [Zip)] (11) where IDFT indicates the N/2 point Inverse Discrete Fourier SUBSTITUTE SHEET Transf σr . The algorithm can be implemented in an electronic apparatus supplied with a set of N real numbers and producing N/2 complex output numbers, representing the MDFT of the input data. This apparatus uses digital arithmetic elements to perform each of the arithmetic operations as described in the preceding text . Another embodiment of the present invention is a pair of apparatus, the first of which computes an MDFT as -iescribed in the previous paragraph, and the second of which computes an inverse MDFT, using the arithmetic procedures described previously in this document. 3y passing overlapped blocks of data from a continuous stream of input data through the MDFT computer, then multiplying the Z(p) coefficients by appropriate filter coefficients, then passing the resulting data through the Inverse MDFT computer, and recombining segments of output data appropriately, a modified Fast Convolution processor can be built. The above described a modification to the DFT that makes it more useful in a number of applications particularly but not limited to the real time filter applications previously described. All cf these extensions to the DFT can also be applied to the FFT algorithm and other fast implementations of the DFT. Example 1 Fig. 17 illustrates an implementation of the summed filter cf Fig. 11 wherein the Modified Discrete Fourier Transform (MDFT. described immediately above is applied for SUBSTITUTESHEET the purposes of transforming the data stream into the frequency domain and the corresponding Inverse Modified Discrete Fourier Transform (IMDFT) is applied following application of the filter algorithm and prior to discard for conversion from the frequency domain. In filter F2 cf Fig. 17. the MDFT takes 64 real words of input and produces 32 complex words of output. The IMDFT takes 32 complex words of input and produces 64 real words of output . In filter F3 of Fig. 17 the MDFT takes 256 real words of input and produces 128 complex words of output. The IMDFT takes 128 complex words of input and produces 256 real words of output. The filter of Fig. 17 is implemented using a Motorola DSP 56001 processor inconorating software (bootable from ROM or from another host computer) to implement the algorithm. The delay elements are implemented using a bank of external memory chips comprising three MCM 6206 memory chips. Data input and output between the analog and digit.il domains is effected by an ADC and DAC chip, the Crystal CS 4216, communicating via the svncrhonous serial communication port of the DSP 56001. INDUSTRIAL APPLICABILITY Embodiments cf the invention may be applied to digital filters implemented in software, hardware or a combination of both for applications such as audio filtering or electronic modelling of acoustic system characteristics. The method is croadlv applicable in the field cf signal processing and can be used to advantage, for example, in: adaptive filtering; audio reverberation processing; adaptive echo cancellation- spatial processing; virtual reality audio: correlation, radar; radar pulse compression; deconvolution; seismic analysis; telecommunications; pattern recognition; robotics; 3D acoustic modelling; audio post production (including oralisation, auto reverberant matching) ; audio equalisation; compression; sonar; ultrasonics; secure communication systems; digital audio broadcast, acoustic analysis; surveillance; noise cancellation; echo cancellation. The above describes only some embodiments of the present invention and modifications obvious to those skilled in the art can be made thereto without departing from the scope and spirit of the present invention. SUBSTITUTESHEET

Claims: CLAIMS 1. A digital filter with a long impulse response and low latency, built by operating a number of smaller component filters in parallel and combining their outputs by addition, with each component filter operating with a different delay such that the net operation of the ensemble of said component filters is the same as a single filter with a longer impulse response, and the latency of the ensemble is equal to the shortest latency of the said component filters. 2. The filter of claim 1 wherein the component filters are implemented in different ways, with some filters adapted to provide low latency, and other filters adapted to provide longer filter lengths, such that the ensemble filter provides both low latency and long impulse response characteristics. 3. The filter of claim 1 wherein one or more of the component filters is implemented as a time-domain finite impulse response filter (built with multiply and add operations) and the remainder are implemented using a fast convolution method, such that the time-domain filter(s) provides the lowest latency portion of the ensemble impulse response, and the fast-convolution filter(s) provide the longer filter components. 4. The filter of claim 3 wherein the fast-convolution filters are built using the Discrete Fourier Transform or the Fast Fourier Transform. 5. The filter of claim 3 wherein the fast-convolution filters are built using the Modified Discrete Fourier Transform as claimed in claim 33. SUBSTITUTESHEET ", . The filter of claim 1 wherein ε. group or groups c:f '.lor than ns cf the component filters are implemented using fast convolution techniques with the component filters in each croup using a transform cf the same length, and wherein only one transform operation is performed for each group, co that tne component filters in each group share the transformed output from the respective transform operation. 7. The filter of claim 1 wherein a group or groups of more than one of the component filters are implemented using fast convolution techni rues with the component filters in each group using a transform of the same length, and wherein only one inverse transform operation is performed for each group, so that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. 3 . The filter of claim 1 wherein a group or groups cf more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation; and wherein a group cr groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform c ~ the same length, -ind wherein only one inverse trans orm operation is performed for each group, so that the output from the SUBSTITUTESHEET ■:omponent filters in each group is summed before being passed to the respective inverse transform operation. I . A method for building a digital filter with a long impulse response and low latency, built by operating a number of smaller component filters in parallel and combining their outputs by addition, with each component filter operating with a different delay such that the net operation of the ensemble of said component filters is the same as a single filter with a longer impulse response, and the latency cf the ensemble is equal to the shortest latency of the said component filters. 10. The method of claim 9 wherein the component filters are implemented in different ways, with some filters adapted to provide low latency, and other filters adapted to provide longer filter lengths, such that the ensemble filter provides both low latency and long impulse response characteristics. I. The method of claim 9 wherein one or more of the component filters is implemented as a time-domain finite impulse response filter (built with multiply and add operations) and the remainder are implemented using a fast convolution method, such that the time-domain filter(s) provides the lowest latency portion of the ensemble impulse response, and the fast-convolution filter(s) provide the longer filter components. 12. The method cf claim 11 wherein the fast-convolution filters are built using the Discrete Fourier Transform or the Fast Fourier Transform. SUB S TITUTESHEET 13. The method of claim 11 wherein the fast-convolution filters are built using the Modified Discrete Fourier Transform as claimed in claim 33. 14. The method cf claim 9 wherein a group or groups cf more than one of the component filters are implemented using fast convolution technigues with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation. 15. The method of claim 9 wherein a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one inverse transform operation is performed for each group, so that the output from the component filters in each group is summed before being passed to the respective inverse transform operation. 16. The method of claim 9 wherein a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transform of the same length, and wherein only one transform operation is performed for each group, so that the component filters in each group share the transformed output from the respective transform operation; wherein a group or groups of more than one of the component filters are implemented using fast convolution techniques with the component filters in each group using a transfcrm cf the same SUBSTITUTE SHEET length, and wherein only one inverse transform operation is performed for each group. 0 that the output from the component filters in each group is summed before being passed ' to the respective inverse transform operation. 17. A digital filter for filtering delayed, overlapped groupings of consecutive samples a, b. c. d said filter comprising a transform processor of length m, and N filter processors, each of length k, an adder adapted to sum fir.-. outputs as they are fed in parallel from said N filter processors, an inverse transform processor of length m: said consecutive samples a, b, c, d, being fed in blocks of length m, each of said blocks being passed through said transform processor and then through each of said N filter processors with a delay of zero before being passed through a first filter processor of said N filter processors, a delay of k before being passed through a second filter processor and so on up to a delay of (N-l)k before being passed through the Nth filter processor; whereby a filter of effective length Nk is effected with a latency corresponding to that of a conventional filter of length k. 18. The filter of claim 17 wherein said transform processor is a form of Fourier Transform Processor and said inverse transform processor is a form of inverse Fourier Transform Processor and said filter function processor is effected by a multiply operation of transformed input data with frequency response corresponding to a selected portion of a desired impulse response for the entire filter. SUB S TITUTESHEET 13. A method of implementing a filter with a relatively high length/'latency efficiency K; said method comprising transforming progressive, consecutive and overlapping portions of input data into the freσuency domain, performing a mathematical operation on individual ones of said transformed signals, superposing (by addition) the consecutive signals resulting from said mathematical operations, inverse transforming the resultant signal from the frequency domain back to the time domain and outputting said signal. 20. A method of implementing a filter with a relatively high length/latency efficiency X; said method comprising applying a mathematical transform to progressive, consecutive and overlapping portions of input data so as to produce corresponding transformed data; performing a mathematical operation on individual ones (i.e. two or more) of said transformed data; superposing (by addition) the data resulting from said mathematical operations so as to produce resultant data; applying an inverse mathematical transform to said resultant data so as to produce filtered output data. 21. The method of claim 20 wherein said transform is a form of Fourier Transform and said inverse transform is a form of inverse Fourier Transform and said mathematical operation is a vector multiply cf the Fourier transformed input signal segment with the frequency responses of segments of the desired (time domain) filter characteristic. 22. The method of claim 21 wherein the underlying operation is an overlap operation on successive, overlapping portions SUBSTITUTESHEET of input data and a discard or add operation on succession overlapping blocks of output data (commonly referred to as a overlap/save or overlap/add method ) . 23. The method of claim 20 wherein said method is utilised to implement at least some of the filter modules of a composite electrical filter; said composite electrical filter comprising a plurality of filter modules arranged to receive in parallel an incoming input signal for filtering ; the output from each of said filter modules being summed to produce a composite filtered output signal ; each of said filter modules adapted to have an impulse response that is a selected portion of the impulse response of the composite filter. ". The method of daim 23 including the step of m n mising the overiap of the selected portions of impulse response, or to make them not overlap at all. 25. The method of claim 24 wherein the length of each of said filter modules is different with the characteristic of the shorter length filter modules adapted to process first ( or earlier ) portions of said impulse response and longer length filter modules adapted to process following ( or later ) portions of said impulse response. 26. The method of claim 25 wherein the shortest module of said plurality of filter modules is a time-domain ( low latency ) filter whilst additional ones of said filter modules are longer fast-convolution (longer latency ) filters. 27. A composite electrical filter comprising a plurality of filter modules arranged to receive in parallel an incoming SUBSTITUTE SHEET input signal for filtering; the output from each cf said filter modules being summed to produce a composite filtered output signal; each of said filter modules adapted to have an impulse response that is a selected portion of the impulse response of the composite filter. 28. The filter of claim 27 adapted to minimise the overlap of the selected portions of impulse response, or to make them not overlap at all. 29. The filter of claim 28 wherein the length of each of said filter modules is different with the characteristic of the shorter length filter modules adapted to process first (or earlier) portions of said impulse response and longer length filter modules adapted to process following (or later) portions of said impulse response. 30. The filter of claim 29 wherein the shortest module of said plurality of filter modules is a time-domain (low latency) filter whilst additional ones of said filter modules are longer fast-convolution (longer latency) filters. 31. The filter of claim 27 where the number of said filter modules is N comprising filters F , F 2 ...Fj,j and wherein filter module F^ is a filter with very low latency implemented with time domain techniques whilst all other filter modules F ^ are implemented with fast convolution techniques and these fast convolution filters F^ are composed of a sequence of filters each with longer filter length than its predecessor and hence each with longer latency, but still preserving the property that d i+l =d i +1 i whereby it is ensured that the composite SUBSTITUTESHEET filter F output formed by summing together the N component filter outputs has an impulse response without any "holes" in it. 32. A method of filtering sampled data so as to achieve a relatively long length but short latency filtering of said data, said method comprising passing said data in parallel through a plurality of sub-filters and summing the output samples from all of said sub-filters to produce filtered sampled data; and wherein the Impulse Response of each of said sub-filters is a selected portion of the desired Impulse Response of the filter characteristic required to produce said filtered sampled data from said sampled data and wherein each said selected portion is selected for each of said sub-filters such that the output from all of said sub-filters, when summed, behaves as if filtered through a filter having said desired Impulse Response. 33. A fourier transform processor adapted to efficiently transform strings of real numbers; said processor operating according to the following method: 1. Take the input vector x(k) of length N, where each element of x(k) is real. 2. Create the vector x' (/) , a complex vector of length N/2 by application of the following: x'if) = [x(/)-;x(/+ -)]e N for 0≤/<N/2 (9) 3. Compute the Ν/2 point DFT of x 1 (/) to give the N/2 complex result vector Z(p): Zip) = DFT^ il)} (10) SUBSTITUTE SHEET

Inventors: MCGRATH DAVID STANLEY, MCGRATH, DAVID, STANLEY
Applicants: LAKE DSP PTY LTD, MCGRATH DAVID STANLEY, LAKE DSP PTY. LIMITED
Application year: 1993
Main classification: H03H17
IPC codes: G06F17, H03H17