Talk:Wiener filter

message: The article lacks a derivation of the different Wiener filters. --Fredrik Orderud 16:24, 8 May 2005 (UTC)
thread_title:  Lack of derivation 

message: Hi there. I would like to contribute to this article, specially talking about the discrete time case, solutions, and the LMS and RLS algorithms... But I'm kinda confused, because the way the filter is introduced is different from what I'm used to (what is a good thing, actually).
I believe this article needs some structural changes, but I don't want to simply start changing the place of things and piss off who wrote the current stuff.
I can't say how I think the whole structure of the article should be, because I'm still trying to understand what is there :)  .   I just would like a place to write specifically about the discrete-time case, with a cross-correlation matrix. Also, I think we should talk about the equalisation case, where the noise is the signal trough a channel, and filtering the noise means finding an inverse filter to the channel!... A hot topic, IMHO. -- NIC1138 05:19, 6 December 2005 (UTC)
thread_title:  discrete time 

message: In this article what does the capital S stand for?
:It is the Laplace transform of small s(t). --Memming 18:30, 2 July 2006 (UTC)
replies: text: I think S of both types gets a little overused here.  In any case diving right into S with double subscripts requires a little explanation (by contrast, R gets defined quite well).  As it stands now, the whole solution section is very unclear because of this notation.  —Preceding unsigned comment added by 128.30.6.11 (talk) 17:22, 26 October 2007 (UTC)

text: It is not the Laplace transform of small s(t). It stands for spectral density in the s-domain, which is the Laplace transform of correlation functions for stochastic signals. In this case, S_{x,s} is the Laplace transform of R_{x,s}, and S_x is the Laplace transform of R_x.--Yangli2 (talk) 21:58, 10 February 2008 (UTC)
replies: text: It seems to me that this article overuses the symbols S and s.  How many different meanings can this one article assign to one symbol?  It uses s to mean both the signal to be estimated, as in s(t), and to represent the complex angular frequency in the Laplace domain, as in G(s).  Then, as if that's not confusing enough, the article has S(s) to represent the power spectral density as a function of the complex angular frequency, not to be confused with the Laplace transform of the original signal s(t).  For anyone who is new to the topic, surely this article is extremely confusing. 71.233.125.212 (talk) 03:42, 27 June 2008 (UTC)
replies: text: There might be something wrong in the usage of S in the 'Causal Solution' section. I'll have to look into it when I have more time. Yangli2 (talk) 23:01, 6 May 2009 (UTC)
thread_title:  What is S? 

message: To avoid making errors in this page and according to my present understanding, I prefer to talk here before doing any modification.
The author wrote :
Taking the expected value of the squared error results in
:E(e^2) = R_s(0) - 2\int_{-\infty}^{\infty}{g(\tau)R_{x\,s}(\tau + \alpha)\,d\tau} + \int_{-\infty}^{\infty}{\int_{-\infty}^{\infty}{g(\tau)g(\theta)R_x(\tau - \theta)\,d\tau}\,d\theta}
where
* \,\!R_s is the autocorrelation function of s(t)
* \,\!R_x is the autocorrelation function of x(t)
* R_{x\,s} is the cross-correlation function of x(t) and s(t)
but according to Brown and Hwang  (page 164), shouldn't it be?
Taking the expected value of the squared error results in
:E(e^2) = R_s(0) - 2\int_{-\infty}^{\infty}{g(\tau)R_{s+n\,s}(\tau + \alpha)\,d\tau} + \int_{-\infty}^{\infty}{\int_{-\infty}^{\infty}{g(\tau)g(\theta)R_{s+n}(\tau - \theta)\,d\tau}\,d\theta}
where
* \,\!R_s is the autocorrelation function of s(t)
* \,\!R_{s+n} is the autocorrelation function of s(t)+n(t) 
* R_{s+n\,s} is the cross-correlation function of s(t)+n(t) and s(t)
s(t)+n(t)  doesn't equal x(t)
* [1]: Brown, Robert Grover and Patrick Y.C. Hwang (1996) Introduction to Random Signals and Applied Kalman Filtering.  3 ed.  New York: John Wiley & Sons.  
Touriste (usurped) 14:14, 25 July 2007 (UTC)
replies: text: Hmmm! You may have a valid point here. Encyclops 00:30, 27 July 2007 (UTC)
thread_title:  Isn't there an error in the expected value ? 

message: For most applications, the assumption of uncorrelated signal and noise is reasonable because the source of the noise (e.g. sensor noise or quantization noise) do not depend upon the signal itself.
Not true - quantization noise is a notable example of noise that does depend on the signal.
--Spitschan (talk) 23:27, 6 June 2009 (UTC)
replies: text:  If it's not true (and I agree with you there), then why is it still in the article? I'm removing it. -- Jalanpalmer (talk) 22:22, 6 March 2010 (UTC)
thread_title:  Uncorrelated noise 

message: The two astronaut photos look the same to me.  The image files are different sizes, so they do appear to be different images.  I wonder whether these two photos are the best example of using a Wiener filter against an image.Billsmithaustin (talk) 15:56, 15 August 2013 (UTC)
replies: text: They are also not suitable illustrations of the theory given which is for the one-dimensional Wiener filter whereas the photos are for a two-dimensional filter.JFB80 (talk) 21:11, 15 August 2013 (UTC)
replies: text: Later: I have deleted the photos for these reasons. They are out of place here.JFB80 (talk) 20:34, 13 September 2014 (UTC)
thread_title:  astronaut photos look the same 

message: The Wiener filter presented in this article looks very different than the version I learned (and much more complicated too). Perhaps it's just a difference in formalism? Here's a sketch of the presentation I'm used to (for Gaussian distributed numbers).
Consider a vector of observations d = s+n being a sum of signal s\leftarrow \mathcal{N} 0,S) and noise n\leftarrow \mathcal{N}(0,N) (that is, s has covariance S, and n has covariance N). We wish to recover a maximum-likelihood estimate of the signal given the data. P(s|d)=P(d|s)P(s)/P(d) \propto e^{-\frac12(d-s)^TN^{-1}(d-s)} e^{-\frac12s^TS^{-1}s}. By completing the square for s we see that P(s|d) \sim \mathcal{N}((S^{-1}+N^{-1})^{-1}N^{-1}d,(S^{-1}+N^{-1})^{-1}). So our maximum likelihood estimate of s is \hat s = (S^{-1}+N^{-1})^{-1}N^{-1}d, and the factor in front of d is the Wiener filter. It tends to 1 for signal-dominated modes and to S/N for noise-dominated modes. I've also made an example of applying this filter. Amaurea (talk) 17:56, 3 October 2014 (UTC)
replies: text: Your version is not the Wiener filter but just standard maximum likelihood theory. The characteristic properties of the Wiener filter are that it acts only on past observations and that it uses the spectra of signal and noise. Your example is inappropriate too and is also 2-dimensional whereas the article only gives theory for the usual 1-dimensional case. Why don't you write your own article on your method? JFB80 (talk) 05:50, 4 October 2014 (UTC)
replies: text: It is not "my version". I didn't invent it. It is just standard maximum likelihood theory, but that doesn't mean it's not a Wiener filter. To be more specific it is called a Generalized Wiener Filter. It's used so many places in my field that it's hard to choose which reference to give, but see for example this article (and the many references within). Processing 2D images is a very common use of Wiener filters, and an example is even given in the current version of the article (though not a very impressive example). So I don't agree that only the historical 1-D version of the filter is appropriate. "The article only gives theory for the usual 1-dimensional case" is not an argument for not discussing the generalized case. Also, what do you mean by "your own article"? I can't write my own article because one can't own Wikipedia articles. But I can start a new article, on generalized Wiener filters, if you think that would be clearer. Amaurea (talk) 13:54, 4 October 2014 (UTC)
replies: text: I looked up your reference and see that tbe term 'generalized Wiener filter' is commonly used but I still think it is an incorrect name for the method as it has no connection with what Wiener did. Maybe someone used the term and then everyone else copied it without checking what the Wiener filter actually was. That happens. Yes I did mean to suggest that you should start a new article on the method which also connects with maximum likelihood and Bayesian methods. It would be clearer that way. JFB80 (talk) 19:10, 4 October 2014 (UTC)
replies: text: Voila. Amaurea (talk) 16:16, 5 October 2014 (UTC)
replies: text:  Ok That's fine. There has been work on Wiener filters for both limited interval of observation and for two dimensions which followed the thinking of the usual Wiener filter. (I dont have the references to hand just now). You use a different method and make no reference to previous work. JFB80 (talk) 05:31, 6 October 2014 (UTC)
replies: text:  I do reference previous work: The Pratt article from 1972. Would you mind briefly clarifying what you mean by the "thinking of the usual Wiener filter", and how the method I wrote about doesn't follow that? Is it the interpretation of one of the data axes as time that is the issue? I'm also curious about those other two-dimensional methods. Amaurea (talk) 15:56, 19 October 2014 (UTC)
thread_title:  Linear algebra formulation? 

message: The links associated with two photos lead back to a NASA image is significantly higher quantity. Has noise been added for the purpose of this article, and if so is this appropriate? I'd suggest that something like the examples from the Gimp refocus plugin would be more appropriate this the history of the images is known, provided that the author was prepared to make them available. MarkMLl (talk) 13:06, 29 May 2015 (UTC)
replies: text: I think this is a much better example of wiener filtering of an image. The improvement is actually visible, and the assumptions about the statistical properties of the signal and noise are made explicit. Amaurea (talk) 15:41, 29 May 2015 (UTC)
thread_title:  Astronaut photos 

message: Current discussion is very unclear.  — Preceding unsigned comment added by Zhermes (talk • contribs) 18:08, 21 August 2016 (UTC)
replies: text:  In Wikipedia spectrum is variously called power spectrum, spectral density, power spectral density.JFB80 (talk) 03:39, 22 August 2016 (UTC)
thread_title:  Sections 2 and 3 Need better explanations of variables 

message: Undefined terms and symbols; verbose jargon filled prose; no insight, intuition, or understanding. The biggest problem is that these low quality articles rank highly in Google search results. This article is the first hit when I Google "Wiener Filter". This kind of crap should not be presented as the best the human race has to offer on the subject.
Is there some way we can mark this article as low quality and therefore also discourage search engines from linking to it?  — Preceding unsigned comment added by 73.15.52.144 (talk) 16:15, 21 June 2018 (UTC)
thread_title:  Low Quality Wikipedia Math Articles Should Not Appear in Google Search Results 

message: I think the current section about "Relationship to the Least Squares Filter" is missing.
A more accurate derivation and relation is given at How Is the Formula for the Wiener Deconvolution Derived?
--Royi A (talk) 11:48, 25 August 2018 (UTC)
thread_title:  Relationship to the Least Squares Filter