OK So uh You can fill those out uh after actually so So I got uh these results from uh Stephane Also um I think that uh um we might hear later today about other results I think s that uh there were some other very good results that gonna wanna compare to But r our results from other other places yeah I sorry I didn't Um I got this from you Yeah and then I sent a note to Sunil about the cuz he has been running some other systems other than the the ICSI OGI one So um I wan wanna wanna see what that is But uh you know so see what it is comparatively later But M yeah it looks like um You know most of the time even I mean even though true that the overall number for Danish we didn't improve it If you look at it individually what it really says is that um uh Looks like out of the six cases between the different kinds of uh matching conditions out of the six cases basically um a couple where it stays about the same uh three where it gets better and one where it gets worse Yeah Uh go ahead Y Actually uh um for the Danish still some kind of mystery because um um when we use the straight features we are not able to get these nice number with the ICSI OGI one I mean We don't have this we have eight yeah Uh so uh probably something wrong with the features that we get from OGI Uh and Sunil is working on on trying to Oh check and everything have a little time on that and actually so Hmm We have a little bit of time on that actually Yeah We have a day or so so When when when do you folks leave Uh Sunday Sunday So So uh Yeah until Saturday midnight or something we have W we we have time yeah Well that would be good be good Yeah Yeah Uh and you know i u when whenever anybody figures it out they should also for sure email Hynek because Hynek will be over there telling people what we did so he should know Mmm Good Yeah OK So um So hold off on that a little bit I mean even with these results as they are really not that bad But but uh um And it looks like the overall result as they are now even without you know any any bugs being fixed is that uh on the the other tasks we had this average of uh forty uh nine percent or so improvement And here we have somewhat better than that than the Danish and somewhat worse than that on the German but I mean it sounds like uh one way or another the methods that doing can reduce the error rate from from mel ceptrum down by you know a fourth of them to uh a half of them Somewhere in there depending on the exact case So So good I mean I think that uh one of the things that Hynek was talking about was understanding what was in the other really good proposals and and trying to see if what should ultimately be proposed is some uh combination of things Um if uh Cuz things that they are doing there that we certainly are not doing And things that doing that not doing And and they all seem like good things Yeah Mmm yeah So So much how much better was the best system than ours Well we don't know yet Mmm Uh I mean first place still this thing to to work out and second place second thing is that the only results that we have so far from before were really development set results Oh OK So I think in this community of interest not like everything is being pinned on the evaluation set But um for the development set our best result was a little bit short of fifty percent And the best result of any system was about where these numbers are the uh relative uh reduction in uh word error rate Oh OK And um the other systems were uh somewhat lower than that There was actually there was much less of a huge range than there was in Aurora one In Aurora one there were there were systems that ba basically didn't improve things Hmm And here the the worst system still reduced the error rate by percent or something Oh development set So so you know sort of everybody is doing things between well roughly a third of the errors and half the errors being eliminated uh and varying on different test sets and so forth So I think Um probably a good time to look at really going on and seeing if a a way to combine the best ideas while at the same time not blowing up the amount of uh resources used cuz critical for this this test Do we know anything about who was it that had the lowest on the dev set Um uh the uh the there were two systems that were put forth by a combination of of uh French Telecom and Alcatel And um they they differed in some respects but they e em one was called the French Telecom Alcatel System the other was called the Alcatel French Telecom System uh which is the biggest difference I think But but some other differences too Uh and and uh they both did very well you know So um my impression is they also did very well on on the the uh evaluation set but um I I we haven't seen you haven't seen any final results for that yeah And they used the main thing that that they used was spectral subtraction Or There is a couple pieces to it a spectral subtraction style piece it was basically you know Wiener filtering And then then there was some p some modification of the cepstral parameters where they actually something close to cepstral mean subtraction But uh the way the mean is adapted um signal dependent uh So basically the mean is adapted during speech and not during silence Yeah But very close to to cepstral mean subtraction But some people have done exactly that sort of thing of of and the I mean not To to look in speech only to try to m to Yeah measure these things during yeah speech p not that uncommon But i it it so it looks like they did some some uh reasonable things uh and not things that we did precisely We did unreasonable things which because we like to try strange things and and uh and our things worked too Hmm And so um uh possible that some combination of these different things that were done would be the best thing to do But the only caveat to that is that being real conscious of how much memory and how much CPU using because these uh