Meeting transcript:
speaker: B
text: OK
speaker: B
text: So
speaker: B
text: uh today we 're looking at a number of uh things we 're trying
speaker: B
text: and uh fortunately for listeners to this uh we lost some of it 's visual
speaker: B
text: but um got tables in front of us .
speaker: B
text: Um what is <disfmarker> what does combo mean ?
speaker: C
text: So combo is um a system where we have these features that go through a network
speaker: C
text: and then this same string of features but low - pass filtered with the low - pass filter used in the MSG features .
speaker: C
text: And so these low - pass filtered goes through M eh <disfmarker> another MLP
speaker: C
text: and then the linear output of these two MLP 's are combined just by adding the values and then there is this KLT .
speaker: C
text: Um the output is used as uh features as well .
speaker: B
text: Um so let me try to restate this and see if I have it right .
speaker: B
text: There is uh <disfmarker> there is the features uh there 's the OGI features and then um those features um go through a contextual <disfmarker> uh
speaker: B
text: l l let 's take this bottom arr one pointed to by the bottom arrow .
speaker: B
text: Um those features go through a contextualized KLT .
speaker: C
text: Yeah .
speaker: B
text: Then these features also uh get um low - pass filtered
speaker: C
text: Yeah
speaker: C
text: so
speaker: C
text: yeah I could perhaps draw this on the blackboard
speaker: B
text: Sure .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: C
text: Yeah .
speaker: D
text: The graph ,
speaker: D
text: yeah another one .
speaker: B
text: Yeah , that 's good .
speaker: C
text: So we have these features from OGI that goes through the three paths .
speaker: B
text: So
speaker: B
text: Yeah .
speaker: B
text: Three , OK .
speaker: C
text: The first is a KLT using several frames of the features .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: C
text: The second path is uh MLP also using nine frames <disfmarker> several frames of features
speaker: B
text: Yeah .
speaker: B
text: Uh - huh .
speaker: C
text: The third path is this low - pass filter .
speaker: B
text: Uh - huh .
speaker: C
text: Uh , MLP
speaker: B
text: Aha !
speaker: B
text: aha !
speaker: C
text: Adding the outputs just like in the second propose the <disfmarker> the proposal from <disfmarker> for the first evaluation .
speaker: B
text: Yeah ?
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: C
text: And then the KLT and then the two together again .
speaker: B
text: No , the KLT .
speaker: B
text: And those two together .
speaker: D
text: Two HTK .
speaker: B
text: That 's it .
speaker: C
text: Um . So this is <disfmarker>
speaker: B
text: OK so that 's <disfmarker> that 's this bottom one .
speaker: C
text: yeah
speaker: B
text: And so uh and then the <disfmarker> the <disfmarker> the one at the top <disfmarker>
speaker: B
text: and I presume these things that uh are in yellow are in yellow because overall they 're the best ?
speaker: C
text: Yeah
speaker: C
text: that 's the reason , yeah .
speaker: B
text: Oh let 's focus on them then
speaker: B
text: so what 's the block diagram for the one above it ?
speaker: C
text: For the f the f first yellow line you mean ?
speaker: B
text: Yeah .
speaker: C
text: Yeah
speaker: C
text: so it 's uh basically s the same except that we don't have this uh low - pass filtering so we have only two streams .
speaker: D
text: Step .
speaker: C
text: Well .
speaker: C
text: There 's <disfmarker> there 's no low <disfmarker> low - pass processing used as additional feature stream .
speaker: B
text: Mm - hmm .
speaker: B
text: Mm - hmm .
speaker: C
text: Um
speaker: B
text: Do you e um they mentioned <disfmarker> made some <disfmarker> uh when I was on the phone with Sunil they <disfmarker> they mentioned some weighting scheme that was used to evaluate all of these numbers .
speaker: C
text: Yeah .
speaker: C
text: Uh actually the way things seems to
speaker: C
text: um well it 's uh forty percent for TI - digit , sixty for all the SpeechDat - Cars ,
speaker: C
text: well all these languages .
speaker: C
text: Ehm the well match is forty , medium thirty five and high mismatch twenty - five .
speaker: C
text: Yeah .
speaker: B
text: Um and we don't have the TI - digits part yet ?
speaker: C
text: Uh , no .
speaker: B
text: OK .
speaker: C
text: But yeah .
speaker: C
text: Generally what you observe with TI - digits is that the result are very close whatever the <disfmarker> the system .
speaker: B
text: OK .
speaker: B
text: And so have you put all these numbers together into a single number representing that ?
speaker: C
text: Yeah .
speaker: B
text: I mean not <disfmarker>
speaker: C
text: Uh not yet .
speaker: C
text: No .
speaker: B
text: OK so that should be pretty easy to do and that would be good <disfmarker>
speaker: C
text: Mmm yeah , yeah .
speaker: B
text: then we could compare the two and say what was better .
speaker: C
text: Mmm .
speaker: C
text: Yeah .
speaker: B
text: Um and how does this compare to the numbers <disfmarker>
speaker: B
text: oh so OGI two is just the top <disfmarker> top row ?
speaker: D
text: Yeah .
speaker: C
text: So yeah to <disfmarker>
speaker: C
text: actually OGI two is the <disfmarker> the baseline with the OGI features
speaker: C
text: but this is not exactly the result that they have because they 've <disfmarker> they 're still made some changes in the features
speaker: B
text: OK .
speaker: C
text: and <disfmarker> well but uh actually our results are better than their results .
speaker: C
text: Um I don't know by how much because they did not send us the new results
speaker: B
text: OK .
speaker: C
text: Uh
speaker: B
text: Uh OK so the one <disfmarker> one place where it looks like we 're messing things up a bit is in the highly mismatched Italian .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: B
text: An
speaker: C
text: Yeah
speaker: C
text: there is something funny happening here because <disfmarker>
speaker: C
text: yeah .
speaker: B
text: Yeah .
speaker: C
text: But there are thirty - six and then sometimes we are <disfmarker> we are <disfmarker> we are around forty - two and
speaker: B
text: Now up
speaker: C
text: but
speaker: B
text: Uh so one of the ideas that you had mentioned last time was having a <disfmarker> a second um silence detection .
speaker: C
text: Yeah .
speaker: C
text: So there are some results here
speaker: D
text: For the Italian .
speaker: C
text: uh so the third and the fifth line of the table
speaker: D
text: For this one .
speaker: B
text: So filt is what that is ?
speaker: C
text: Filt , yeah
speaker: D
text: Yeah .
speaker: C
text: Um yeah so it seems f for the <disfmarker> the well match and mismatched condition
speaker: C
text: it 's uh it brings something .
speaker: C
text: Uh but uh actually apparently there are <disfmarker> there 's no room left for any silence detector at the server side because of the delay .
speaker: C
text: Uh well
speaker: B
text: Oh we can't do it .
speaker: B
text: Oh OK .
speaker: C
text: No .
speaker: D
text: For that <disfmarker> for that we <disfmarker>
speaker: B
text: Oh .
speaker: C
text: Uh
speaker: B
text: Too bad .
speaker: B
text: Good idea , but can't do it .
speaker: C
text: Yeah .
speaker: B
text: OK .
speaker: C
text: Except I don't know because they <disfmarker> I think they are still working well .
speaker: B
text: Uh - huh .
speaker: C
text: Uh t two days ago they were still working on this trying to reduce the delay of the silence detector
speaker: C
text: so but
speaker: C
text: yeah
speaker: C
text: if we had time perhaps we could try to find uh some kind of compromise between the delay that 's on the handset and on the server side .
speaker: C
text: Perhaps try to reduce the delay on the handset
speaker: C
text: and <disfmarker>
speaker: C
text: but well hmm For the moment they have this large delay on the <disfmarker> the feature computation and so we don't
speaker: B
text: OK .
speaker: B
text: So
speaker: B
text: Alright so for now at least that 's not there
speaker: B
text: you have some results with low - pass filter cepstrum
speaker: B
text: doesn't have a huge effect but it <disfmarker> but it looks like it you know maybe could help in a couple places .
speaker: C
text: I th
speaker: C
text: Yeah .
speaker: B
text: Uh little bit .
speaker: B
text: Um and um um
speaker: B
text: Yeah
speaker: B
text: and uh let 's see
speaker: B
text: What else did we have in there ?
speaker: B
text: Uh I guess it makes a l um at this point this is
speaker: B
text: I <disfmarker> I guess I should probably look at these others a little bit
speaker: B
text: uh And you <disfmarker> you yellowed these out
speaker: B
text: uh but uh uh
speaker: B
text: Oh I see yeah that <disfmarker> that one you can't use because of the delay .
speaker: B
text: Those look pretty good .
speaker: B
text: Um let 's see that one
speaker: B
text: Well even the <disfmarker> just the <disfmarker> the second row doesn't look that bad right ?
speaker: B
text: That 's just uh
speaker: C
text: Yep .
speaker: B
text: yeah ?
speaker: B
text: And <disfmarker> and that looks like an interesting one too .
speaker: D
text: Mmm yeah .
speaker: B
text: Uh
speaker: C
text: Actually the <disfmarker> yeah the second line is uh pretty much like the first line in yellow
speaker: C
text: except that we don't have this KLT on the first <disfmarker> on the left part of the diagram .
speaker: C
text: We just have the features as they are .
speaker: B
text: Mm - hmm .
speaker: C
text: Um
speaker: B
text: Yeah .
speaker: B
text: Yeah so when we do this weighted measure we should compare the two cuz it might even come out better .
speaker: C
text: Mm - hmm .
speaker: B
text: And it 's <disfmarker> it 's <disfmarker> it 's a little <disfmarker> slightly simpler .
speaker: C
text: Yeah .
speaker: B
text: So <disfmarker> so there 's <disfmarker> so I <disfmarker> I would put that one also as a <disfmarker> as a maybe .
speaker: B
text: Uh and it <disfmarker>
speaker: B
text: yeah and it 's actually <vocalsound> does <disfmarker> does significantly better on the uh uh highly mismatched Italian ,
speaker: B
text: so s
speaker: B
text: and little worse on the mis on the MM case ,
speaker: B
text: but
speaker: B
text: uh Well yeah it 's worse than a few things
speaker: C
text: Mm - hmm .
speaker: B
text: so uh let 's see how that c that c c see how that comes out on their <disfmarker> their measure
speaker: B
text: and <disfmarker> are <disfmarker> are we running this uh for TI - digits
speaker: B
text: or uh
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: B
text: Now is TI di <disfmarker> is is that part of the result that they get for the uh development <disfmarker> th the results that they 're supposed to get at the end of <disfmarker> end of the month , the TI - digits are there also ?
speaker: C
text: Yeah .
speaker: C
text: It 's included , yeah .
speaker: B
text: Oh OK .
speaker: B
text: OK .
speaker: B
text: And see what else there is here .
speaker: B
text: Um Oh I see <disfmarker>
speaker: B
text: the one <disfmarker> I was looking down here at the <disfmarker> the o the row below the lower yellowed one .
speaker: C
text: Mm - hmm ?
speaker: B
text: Uh that 's uh that 's with the reduced uh KLT size <disfmarker> reduced dimensionality .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: B
text: What happens there is it 's around the same
speaker: B
text: and so you could reduce the dimension as you were saying before a bit perhaps .
speaker: C
text: Yeah , it 's <disfmarker> it 's significantly worse well but <disfmarker> Mm - hmm .
speaker: B
text: It 's significantly worse <disfmarker>
speaker: B
text: it 's <disfmarker> it 's uh it 's <disfmarker> it 's mostly worse .
speaker: C
text: Exc - except for the HM
speaker: D
text: For many a mismatch it 's worse .
speaker: C
text: but
speaker: B
text: Yeah .
speaker: B
text: But it is little .
speaker: B
text: I mean not <disfmarker> not by a huge amount ,
speaker: B
text: I don't know .
speaker: B
text: What are <disfmarker> what are the sizes of any of these sets ,
speaker: B
text: I <disfmarker> I 'm <disfmarker> I 'm sure you told me before , but I 've forgotten .
speaker: B
text: So <disfmarker> you know how many words are in uh one of these test sets ?
speaker: C
text: Uh
speaker: D
text: I don't remember .
speaker: C
text: Um it 's <disfmarker> it depends <disfmarker> well <disfmarker> the well matched is generally larger than the other sets
speaker: B
text: About ?
speaker: C
text: and I think it 's around two thousand or three thousand words perhaps , at least .
speaker: D
text: Ye
speaker: D
text: But words <disfmarker> well word <disfmarker> I don't know .
speaker: C
text: Hmm ?
speaker: C
text: The words , yeah .
speaker: D
text: Sentences .
speaker: C
text: S sentences .
speaker: C
text: Some sets have five hundred sentences ,
speaker: C
text: so .
speaker: D
text: Yeah .
speaker: C
text: Mmm .
speaker: B
text: So the <disfmarker> so the sets <disfmarker> so the test sets are between five hundred and two thousand sentences , let 's say
speaker: B
text: and each sentence on the average has four or five digits
speaker: B
text: or is it <disfmarker> most of them longer or
speaker: D
text: Yeah
speaker: D
text: for the Italian even seven digits y more or less
speaker: C
text: Yeah .
speaker: C
text: It <disfmarker> it d
speaker: D
text: but sometime the sentence have only one digit
speaker: C
text: Seven digits .
speaker: D
text: and sometime uh like uh the number of uh credit cards , something like that .
speaker: B
text: Mm - hmm .
speaker: B
text: Right , so between one and sixteen .
speaker: B
text: See the <disfmarker> I mean the reason I 'm asking is <disfmarker> is <disfmarker> is we have all these small differences and I don't know how seriously to take them , right ?
speaker: C
text: Mm - hmm ?
speaker: B
text: So uh i if <disfmarker> if you had uh just you know <disfmarker> to give an example , if you had uh um if you had a thousand words then uh a <disfmarker> a tenth of a percent would just be one word ,
speaker: C
text: Yeah .
speaker: B
text: right ?
speaker: B
text: So <disfmarker> so it wouldn't mean anything .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: B
text: Oh
speaker: B
text: um so um yeah it be kind of <disfmarker> I 'd kind of like to know what the sizes of these test sets were actually .
speaker: D
text: The size that we have ?
speaker: C
text: Yeah .
speaker: C
text: We could <disfmarker> we could run <disfmarker> run some kind of significance tests
speaker: B
text: Yeah since these <disfmarker>
speaker: B
text: well also just to know the numbers ,
speaker: C
text: or
speaker: D
text: Yeah .
speaker: B
text: right .
speaker: B
text: So these <disfmarker> these are word error rates
speaker: C
text: Yeah .
speaker: B
text: so this is on how many words .
speaker: C
text: Yep .
speaker: D
text: Yeah we have the result that the output of the HTK
speaker: B
text: Yeah .
speaker: D
text: The number of <disfmarker> of sentences , no it 's the number isn't .
speaker: C
text: Yeah sure <disfmarker> sure .
speaker: C
text: Yeah sure .
speaker: B
text: Yeah
speaker: C
text: Yeah .
speaker: B
text: so anyway if you could just mail out what those numbers are and then <disfmarker> then <disfmarker> that <disfmarker> that be great .
speaker: D
text: Yeah .
speaker: B
text: Um <vocalsound> what else is there here ?
speaker: B
text: Um see the second <disfmarker> second from the bottom it says SIL ,
speaker: B
text: but this is some different kind of silence or thing or <disfmarker>
speaker: B
text: what was that ?
speaker: C
text: Uh
speaker: D
text: It the <disfmarker> the output silence of the MLP .
speaker: C
text: Oh yeah
speaker: C
text: I see .
speaker: D
text: It 's only one small experiment to know what happened .
speaker: D
text: To apply also to in include also the <disfmarker> the silence of the MLP we have the fifty - six form and the silence to pick up the silence and we include those .
speaker: B
text: Yes .
speaker: B
text: Uh - huh , uh - huh .
speaker: B
text: The silence plus the KLT output ?
speaker: B
text: Oh so you 're only using the silence .
speaker: C
text: Yeah .
speaker: D
text: Yeah , because when we apply the KLT
speaker: C
text: No they 're <disfmarker> I think there is this silence in addition to the um KLT outputs
speaker: B
text: No .
speaker: D
text: in addition , yes .
speaker: D
text: In addition t
speaker: C
text: it is because we <disfmarker> we <disfmarker> we just keep uh we don't keep all the dimensions after the KLT
speaker: C
text: and <disfmarker> yeah .
speaker: D
text: and we not s we are not sure if we pick <disfmarker> we have the silence .
speaker: C
text: So we try to add the silence also in addition to the <disfmarker> these twenty - eight dimensions .
speaker: B
text: I see .
speaker: B
text: OK .
speaker: B
text: And what <disfmarker> and what 's OGI forty - five ?
speaker: C
text: Uh it 's o it 's OGI two ,
speaker: B
text: The bottom one there ?
speaker: C
text: it 's <disfmarker> so the <disfmarker> th it 's the features from the first line
speaker: D
text: It 's in fact OGI two .
speaker: C
text: and <disfmarker> yeah .
speaker: B
text: S
speaker: B
text: Right , but I mean what 's the <disfmarker> what does the last row mean ?
speaker: C
text: So it 's uh basically this but without the KLT on the <disfmarker> from the left path .
speaker: B
text: I thought that was the one <disfmarker> I thought that was the second row .
speaker: B
text: So what 's the difference between the second
speaker: C
text: Uh the second line you don't have this combo stuff so you just
speaker: B
text: Oh .
speaker: C
text: uh
speaker: B
text: So this is like the second line but with <disfmarker> with the combo stuff .
speaker: C
text: Yeah .
speaker: D
text: And with the <disfmarker> all the output of the combo .
speaker: C
text: Yeah .
speaker: B
text: OK .
speaker: B
text: Yeah .
speaker: C
text: Yeah .
speaker: D
text: Uh
speaker: B
text: OK , so <disfmarker>
speaker: B
text: alright
speaker: B
text: so it looks to me <disfmarker> I guess the same <disfmarker>
speaker: B
text: given that we have to take the filt ones out of the <disfmarker> the running because of this delay problem <disfmarker> so it looks to me like the ones you said I agree are <disfmarker> are the ones to look at
speaker: C
text: Mm - hmm .
speaker: B
text: but I just would add the <disfmarker> the <disfmarker> the second row one
speaker: C
text: Yeah .
speaker: B
text: and then um if we can um
speaker: C
text: Mmm .
speaker: B
text: oh yeah also when <disfmarker> when they 're using this weighting scheme of forty , thirty - five , twenty - five is that on the percentages or on the raw errors ?
speaker: B
text: I guess it 's probably on the percentages right ?
speaker: C
text: Uh <vocalsound> I guess , yeah .
speaker: B
text: Yeah OK .
speaker: C
text: I guess , yeah .
speaker: C
text: Mmm .
speaker: B
text: Alright .
speaker: C
text: It 's not clear here .
speaker: B
text: OK .
speaker: B
text: Maybe <disfmarker> maybe they 'll argue about it .
speaker: B
text: Um OK
speaker: B
text: so if we can know what <disfmarker> how many words are in each
speaker: B
text: and then um Dave uh Dave promised to get us something tomorrow which will be there as far as they 've gotten <vocalsound> Friday
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: B
text: and then we 'll operate with that
speaker: B
text: and uh how long did it
speaker: B
text: I guess if we 're not doing all these things <disfmarker> if we 're only doing um
speaker: B
text: um I guess since this is development data it 's legitimate to do more than one ,
speaker: B
text: right ?
speaker: B
text: I mean ordinarily if <disfmarker> in final test data you don't want to do several and <disfmarker> and take the best
speaker: C
text: Yeah .
speaker: C
text: Mmm .
speaker: B
text: that 's <disfmarker> that 's <disfmarker> that 's not proper
speaker: B
text: but if this is development data we could still look at a couple .
speaker: C
text: Yeah .
speaker: C
text: We can <disfmarker>
speaker: C
text: yeah .
speaker: C
text: Sure .
speaker: C
text: But we have to decide <disfmarker>
speaker: C
text: I mean we have to fix the system on this d on this data , to choose the best
speaker: B
text: Yeah .
speaker: B
text: I
speaker: C
text: and these
speaker: B
text: Right .
speaker: B
text: But the question is when <disfmarker> when do we fix the system ,
speaker: C
text: But we could
speaker: B
text: do we fix the system uh tomorrow or do we fix the system on Tuesday ?
speaker: C
text: it d
speaker: C
text: I think we fixed on Tuesday , yeah .
speaker: B
text: I <disfmarker> Yeah , OK except that we do have to write it up .
speaker: C
text: Yeah .
speaker: C
text: Mm - hmm .
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: B
text: Also , so
speaker: C
text: Yeah .
speaker: B
text: Um
speaker: C
text: Uh yeah well .
speaker: C
text: Well basically it 's this with perhaps some kind of printing and some <disfmarker> some other @ @ .
speaker: B
text: Right
speaker: B
text: so maybe what we do is we <disfmarker> we <disfmarker> we uh as soon as we get the data from them we start the training and so forth
speaker: C
text: Yeah but
speaker: C
text: Mm - hmm .
speaker: B
text: but we start the write - up right away because as you say there <disfmarker> there 's only minor differences between these .
speaker: C
text: I think you <disfmarker> we could <disfmarker> we could start soon , yeah .
speaker: B
text: Yeah .
speaker: C
text: Write up something .
speaker: B
text: Yeah , and <disfmarker> and I <disfmarker> I would <disfmarker> you know , I would <disfmarker> I 'd kind of like to see it
speaker: C
text: Um yeah .
speaker: C
text: Mm - hmm .
speaker: B
text: maybe I can <disfmarker> I can edit it a bit
speaker: B
text: uh sure .
speaker: B
text: The <disfmarker> my <disfmarker> what in this si i in this situation is my forte which is English .
speaker: C
text: Yeah .
speaker: B
text: Uh so
speaker: C
text: Mmm .
speaker: B
text: uh H yeah .
speaker: B
text: Have y have you seen alt d do they have a format for how they want the system descriptions or anything ?
speaker: C
text: Uh not really .
speaker: B
text: OK .
speaker: C
text: Um There is the format of the table which is <vocalsound> quite impressive .
speaker: B
text: Yeah ?
speaker: B
text: Uh I see .
speaker: B
text: Yes , for those who are listening to this and not looking at it uh it 's not really that impressive , it 's just tiny .
speaker: B
text: It 's all these little categories set a , set b , set c , multi - condition , clean .
speaker: B
text: Uh No mitigation .
speaker: B
text: Wow .
speaker: B
text: Do you know what no <disfmarker> what no mitigation means here ?
speaker: C
text: Um it should be the the problem with the error <disfmarker> channel error
speaker: B
text: Oh that 's probably the <disfmarker>
speaker: C
text: or
speaker: B
text: this is probably channel error stuff
speaker: C
text: well , you <disfmarker>
speaker: C
text: Yeah .
speaker: B
text: huh ?
speaker: B
text: Oh this is i right , it says right above here channel <disfmarker> channel error resilience ,
speaker: C
text: Yeah .
speaker: B
text: yeah .
speaker: B
text: So recognition performance is just the top part , actually .
speaker: B
text: Uh and they have <disfmarker> yes , split between seen databases and non - seen so basically between development and <disfmarker> and evaluation .
speaker: C
text: Yeah .
speaker: B
text: And <vocalsound> so <disfmarker>
speaker: B
text: right ,
speaker: B
text: it 's presumed there 's all sorts of tuning that 's gone on on the see what they call seen databases
speaker: B
text: and there won't be tuning for the uh unseen .
speaker: B
text: Multi - condition <disfmarker> multi - condition .
speaker: B
text: So they have <disfmarker> looks like they have
speaker: C
text: Mm - hmm .
speaker: B
text: uh uh
speaker: B
text: so they splitting up between the TI - digits and everything else , I see .
speaker: B
text: So the everything else is the SpeechDat - Car , that 's the multi multilingual
speaker: C
text: Yeah , so it 's not divided between languages you mean or <disfmarker>
speaker: B
text: Well , it is .
speaker: C
text: it just
speaker: B
text: It is ,
speaker: B
text: but there 's also <disfmarker> there 's these tables over here for the <disfmarker> for the TI - digits and these tables over here for the car data
speaker: C
text: Oh yeah .
speaker: B
text: which is <disfmarker> which is I guess all the multilingual stuff
speaker: B
text: and then uh there 's <disfmarker> they also split up between multi - condition and clean only .
speaker: C
text: Yeah .
speaker: C
text: For TI - digits .
speaker: B
text: Yes .
speaker: C
text: Yeah , actually yeah .
speaker: C
text: For the TI - digits they want to train on clean and on noisy
speaker: B
text: Yeah .
speaker: C
text: and <disfmarker> yeah .
speaker: B
text: So we 're doing that also , I guess .
speaker: C
text: Uh yeah .
speaker: C
text: But uh we actually <disfmarker>
speaker: C
text: do we have the features ?
speaker: C
text: Yeah .
speaker: C
text: For the clean TI - digits but we did not test it yet .
speaker: C
text: Uh the clean training stuff .
speaker: B
text: OK .
speaker: C
text: Mmm .
speaker: B
text: Well anyway , sounds like there 'll be a lot to do just to <vocalsound> work with our partners to fill out the tables <vocalsound> over the next uh next few days
speaker: C
text: Mm - hmm .
speaker: D
text: Yes .
speaker: B
text: I guess they have to send it out <disfmarker>
speaker: B
text: let 's see the thirty - first is uh uh Wednesday
speaker: B
text: and I think the <disfmarker> it has to be there by some hour uh European time on Wednesday
speaker: C
text: Hmm - hmm .
speaker: B
text: so <vocalsound> I think basically
speaker: D
text: We lost time uh Wednesday maybe because <vocalsound> that the difference in the time may be <disfmarker> is a long different of the time .
speaker: B
text: E excuse me ?
speaker: D
text: Maybe the Thursday the twelfth of the night of the Thurs - thirty - one is <disfmarker> is not valid in Europe .
speaker: C
text: Yeah .
speaker: D
text: We don't know is happening .
speaker: B
text: Yes , so I mean <disfmarker> I think we have to actually get it done Tuesday
speaker: D
text: Tuesday .
speaker: C
text: Yeah , well .
speaker: B
text: right
speaker: B
text: because I <disfmarker> I think
speaker: C
text: Except if <disfmarker> if it 's the thirty - one at midnight
speaker: B
text: uh Uh
speaker: C
text: or I don't know <disfmarker>
speaker: C
text: we can <vocalsound> still do some work on Wednesday morning .
speaker: B
text: yeah well .
speaker: C
text: Yeah , well .
speaker: B
text: W i is but is <disfmarker> is it midni I thought it was actually something like five PM on <disfmarker>
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: C
text: Mm - hmm .
speaker: B
text: was like <disfmarker> I thought it was five PM or something ,
speaker: B
text: I didn't think it was midnight .
speaker: B
text: I thought they said they wanted everything by
speaker: D
text: Yeah , five PM .
speaker: B
text: well , so five PM their time is <disfmarker> is <disfmarker>
speaker: D
text: Not five PM , three PM .
speaker: B
text: if
speaker: B
text: three PM .
speaker: D
text: Three PM .
speaker: B
text: Alright , that 's six in the morning here .
speaker: C
text: It 's d
speaker: D
text: Uh no
speaker: C
text: no .
speaker: D
text: three <disfmarker> three A - three PM ?
speaker: C
text: No , we are wondering about the <disfmarker> the <disfmarker> the hour that we have to
speaker: C
text: eh I don't know if it 's three PM <disfmarker> it 's
speaker: D
text: Oh yeah , yeah , yeah , yeah .
speaker: D
text: Three PM here is in Europe midnight .
speaker: C
text: Yeah , it 's <disfmarker> it 's midnight but
speaker: B
text: Yes , yes , but I didn't think it was midnight that it was due ,
speaker: D
text: Oh OK .
speaker: B
text: I thought it was due at some hour during the day like five PM or something .
speaker: D
text: Mm - hmm . Mm - hmm ,
speaker: D
text: maybe .
speaker: B
text: In which case
speaker: B
text: so I <disfmarker> I <disfmarker> uh well we should look
speaker: B
text: but my assumption is that we basically have to be done Tuesday .
speaker: B
text: Um so then next Thursday we can sort of have a little aftermath
speaker: D
text: Yeah .
speaker: B
text: but then <disfmarker> then we 'll actually have the new data which is the German and the Danish
speaker: C
text: Yeah .
speaker: B
text: but that really will be much less work because uh the system will be fixed
speaker: C
text: Yeah .
speaker: B
text: so all we 'll do is take whatever <vocalsound> they have and <disfmarker> and uh and run it through the process .
speaker: C
text: Yeah .
speaker: C
text: Mm - hmm .
speaker: B
text: Uh we won't be changing the training on anything
speaker: B
text: so there 'll be no new training , there 'll just be new HTK runs ,
speaker: B
text: so that 's means in some sense we can kind of relax from this after <disfmarker> after Tuesday
speaker: B
text: and <disfmarker> and uh maybe next meeting we can start talking a little bit about where we want to go from here uh in terms of uh the research .
speaker: C
text: Mm - hmm .
speaker: B
text: Um you know what things uh did you think of when you were uh doing this process that uh you just didn't really have time to adequately work on
speaker: B
text: uh uh so
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: B
text: What ?
speaker: A
text: Oh , Stephane always has these great ideas
speaker: A
text: and <disfmarker>
speaker: A
text: oh , but uh we don't have time .
speaker: C
text: Sure .
speaker: B
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: Yeah .
speaker: C
text: I 'm not sure these are great ideas .
speaker: B
text: But they 're ideas .
speaker: B
text: Yeah ?
speaker: B
text: Oh , that was good .
speaker: C
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: And <disfmarker> and uh also it 's still true that uh I think it 's true that <disfmarker> that we <disfmarker> we at least got fairly consistent i improved results by running uh the uh neural net transformation in parallel with the features
speaker: C
text: But
speaker: B
text: rather than uh in sequence which was <disfmarker> was your suggestion and that <disfmarker> that <disfmarker> that seems to have been borne out .
speaker: C
text: Mm - hmm .
speaker: C
text: Mm - hmm .
speaker: B
text: The fact that none of these are <disfmarker> are <disfmarker> you know , enormous is <disfmarker> is <disfmarker> is not too surprising <disfmarker>
speaker: B
text: most improvements aren't enormous
speaker: B
text: and <vocalsound> uh
speaker: C
text: Yeah .
speaker: B
text: some of them are
speaker: B
text: but uh I mean you have something really really wrong <vocalsound> and you fix it <vocalsound> you can get big and really enormous improvements
speaker: C
text: Mm - hmm .
speaker: B
text: but <vocalsound> uh <vocalsound> um Cuz our best improvements over the years that we 've gotten from finding bugs ,
speaker: B
text: but
speaker: B
text: Anyway
speaker: B
text: OK
speaker: B
text: well I <disfmarker> I think <disfmarker> I see where we are and everybody knows what they 're doing and is there <disfmarker> is there anything else we should talk about
speaker: B
text: or <disfmarker> or <disfmarker> are we done ?
speaker: C
text: Mm - hmm .
speaker: C
text: I think it 's OK
speaker: C
text: um . We
speaker: C
text: so basically we will <disfmarker> I think we 'll try to <disfmarker> to focus on these three architectures
speaker: C
text: and <disfmarker> and perhaps I was thinking also a fourth one with just <disfmarker> just a single KLT
speaker: C
text: because we did not really test that <disfmarker>
speaker: C
text: removing all these KLT 's and putting one single KLT at the end .
speaker: B
text: Uh - huh .
speaker: B
text: Yeah , I mean that would be pretty low maintenance to try it .
speaker: C
text: Yeah .
speaker: B
text: Uh if you can fit it in .
speaker: C
text: Mm - hmm .
speaker: B
text: Oh I have <disfmarker> yeah I do have one other piece of information which uh I should tell people outside of this group too
speaker: B
text: uh I don't know if we 're gonna need it uh but uh Jeff up at the uh University of Washington has uh gotten a hold of a uh uh some kind of server farm of uh of ten uh uh multiprocessor uh IBM machines RS six thousands
speaker: C
text: Mm - hmm .
speaker: B
text: and <disfmarker> and uh so I think each one is four processors or something or <disfmarker> I don't know , eight hundred megahertz or something
speaker: B
text: and there 's four processors in a box and there 's ten boxes and there 's some kind of ti
speaker: B
text: so if <disfmarker> you know he 's got a lot of processing power
speaker: B
text: and um
speaker: B
text: we 'd have to schedule it
speaker: B
text: but if we have some big jobs and we wanna <disfmarker> wanna <disfmarker> wanna run them he 's <disfmarker> he 's offering it .
speaker: C
text: Mm - hmm .
speaker: B
text: So .
speaker: B
text: It 's uh
speaker: B
text: when he was here eh uh he <disfmarker> he used i not only every machine here but every machine on campus as far as I could tell ,
speaker: B
text: so <disfmarker>
speaker: B
text: so in some ways he just got his payback ,
speaker: B
text: but uh again I <disfmarker> I don't know if we 'll end up with <disfmarker> if we 're gonna be CPU limited on anything that we 're doing in this group
speaker: C
text: Mm - hmm .
speaker: B
text: but <disfmarker> but if <disfmarker> if we are that 's an offer .
speaker: B
text: OK
speaker: B
text: well uh you guys doing great stuff so that 's <disfmarker> that <disfmarker> that 's really neat
speaker: B
text: and uh
speaker: B
text: we 'll uh uh g don't think we need to uh
speaker: B
text: um Oh well the other thing I guess that I will say is that uh the digits that we 're gonna record momentarily is starting to get <disfmarker> are starting to get into a pretty good size collection
speaker: B
text: and um in addition to the SpeechDat stuff we will have those to work with really pretty soon now
speaker: B
text: so that 's <disfmarker> that 's another source of data .
speaker: B
text: Um which is s under somewhat better control and that we can <disfmarker> we can make measurements of the room
speaker: B
text: the <disfmarker> uh that <disfmarker> you know if we feel there 's other measurements we don't have that we 'd like to have we can make them
speaker: B
text: and
speaker: B
text: uh Dave and I were just talking about that a little while ago
speaker: C
text: Mm - hmm .
speaker: B
text: so uh that 's another <disfmarker> another possibility for this <disfmarker> this kind of work .
speaker: B
text: K , uh if nobody has anything else maybe we should go around do <disfmarker> do our digits <disfmarker> do our digits duty .
speaker: B
text: OK .
speaker: B
text: OK I 'll start .
speaker: B
text: Uh , let me say that again .
speaker: B
text: OK . I guess we 're done .

Meeting summary:
text: The ICSI Meeting Recorder Group at Berkeley are approaching an important milestone on their project.
text: They discussed most recent results, finalized plans to continue and discussed the work required and timing needed for completion of this stage of the project.
text: Mn007 and fn002 Need to find a way of combining result figures into one easily comparable way of judging performance.
text: They were also asked to mail round numbers detailing the size of their test-sets, so that group members can assess the seriousness of figures such as word error rates.
text: There are now just 4 architectures that will be carried forward for testing.
text: Though the final system is not due to be fixed, until Tuesday, writing it up must begin sooner.
text: Anything written must go through me013 for editing.
text: Discussion on future work once this stage is out of the way will be held at the next meeting.
text: While using a second silence detection system it was found that while providing some improvement, it added too great a delay on the server side of the system.
text: The experiment team have been narrowing down their experiments, coming close to fixing their system.
text: Partner OGI have been using a weighting scheme, but the ICSI group do not yet have all the parts to run a similar system.
text: They have been able to come close to the OGI results, but since OGI have changed something they do differ, though for the better.
text: So far, testing on Italian is the worst performing condition.
text: With regards to the digits the group have been recording during meetings, the collection of data is growing, and will soon be a workable size.