Grad C: OK . Um , for the training corpus corpus , um , we have , um , the the d digits {nonvocalsound} from the various languages . Um , English Spanish um , French What else do we have ?
PhD G: And the Finnish .
Grad C: Finnish .
PhD A: Where did th where did that come from ?
PhD E: And Italian .
PhD A: Digits ?
PhD E: Uh , no , Italian no . Italian no .
PhD A: Oh .
Grad C: Oh . Italian .
PhD E: I Italian yes . Italian ?
Professor F: Italian .
PhD A: Is that Was that distributed with Aurora , or ?
Grad C: One L or two L 's ?
PhD A: Where did that ?
Professor F: The newer one .
PhD G: So English , uh , Finnish and Italian are Aurora .
Professor F: Yeah .
PhD G: And Spanish and French is something that we can use in addition to Aurora . Uh , well .
Professor F: Yeah , so Carmen brought the Spanish , and Stephane brought the French .
Grad C: OK . And , um , oh yeah , and Professor F: Is it French French or Belgian French ? There 's a PhD G: It 's , uh , French French .
Grad C: French French .
PhD E: Like Mexican Spain and Spain .
Professor F: Yeah .
PhD B: Or Swiss .
PhD E: I think that is more important ,
PhD B: Swiss - German .
PhD E: Mexican Spain . Because more people Professor F: Yeah . Yeah , probably so .
PhD E: Yeah .
Professor F: Yeah . Yeah , Herve always insists that Belgian is i is absolutely pure French , has nothing to do with but he says those those those Parisians talk funny .
PhD G: Yeah , yeah , yeah . They have an accent .
Professor F: Yeah they they do , yeah . Yeah . But then he likes Belgian fries too , so . OK .
Grad C: And then we have , uh , um , broader broader corpus , um , like TIMIT . TIMIT so far ,
PhD E: And Spanish too .
Grad C: right ? Spanish Oh , Spanish stories ?
PhD E: Albayzin is the name .
PhD A: What about TI - digits ?
Grad C: Um , TI - digits uh all these Aurora f d data p data is from is derived from TI - digits .
PhD A: Uh - huh . Oh . Oh OK .
Grad C: Um , basically , they they corrupted it with , uh , different kinds of noises at different SNR levels .
PhD A: Ah . I see .
Grad C: Yeah .
Professor F: y And I think Stephane was saying there 's there 's some broader s material in the French also ?
PhD G: Yeah , we cou we could use Grad C: OK .
PhD G: Yeah . The French data .
PhD E: Spanish stories ?
Grad C: No .
PhD E: No .
Grad C: Sp - Not Spanish stories ?
PhD E: No . No . Albayz
Professor F: Spanish Grad C: Spanish something .
PhD E: Yeah .
Grad C: OK .
PhD B: Did the Aurora people actually corrupt it themselves , or just specify the signal and the signal - t
Grad C: They they corrupted it , um , themselves ,
PhD B: OK .
Grad C: but they also included the the noise files for us , right ? Or PhD G: Yeah .
Grad C: so we can go ahead and corrupt other things .
Professor F: I 'm just curious , Carmen I mean , I couldn't tell if you were joking or i Is it is it Mexican Spanish ,
PhD E: No no no no .
Professor F: or is it PhD E: No no no no .
Professor F: Oh , no , no . It 's it 's Spanish from Spain , Spanish .
PhD E: Spanish from Spain .
Professor F: Yeah , OK .
Grad C: From Spain .
Professor F: Alright . Spanish from Spain . Yeah , we 're really covered there now . OK .
Grad C: OK .
Professor F: And the French from France .
PhD G: Yeah , the No , the French is f yeah , from , uh , Paris ,
Grad C: Oh , from Paris , OK .
Professor F: Yeah .
Grad C: And TIMIT 's from lots of different places .
PhD G: OK .
Professor F: From TI . From i It 's from Texas . So may maybe it 's PhD B: From the deep South .
Professor F: So - s so it 's not really from the US either .
Grad C: Yeah .
Professor F: Is that ? OK .
Grad C: Yeah . OK . And , um , with within the training corporas um , we 're , uh , thinking about , um , training with noise . So , incorporating the same kinds of noises that , um , Aurora is in incorporating in their , um in their training corpus . Um , I don't think we we 're given the , uh the unseen noise conditions , though , right ?
Professor F: I think what they were saying was that , um , for this next test there 's gonna be some of the cases where they have the same type of noise as you were given before hand and some cases where you 're not .
Grad C: Like Mm - hmm . OK .
PhD G: Mm - hmm .
Professor F: So , presumably , that 'll be part of the topic of analysis of the the test results , is how well you do when it 's matching noise and how well you do where it 's not .
Grad C: Right .
Professor F: I think that 's right .
Grad C: So , I guess we can't train on on the the unseen noise conditions .
Professor F: Well , not if it 's not seen ,
Grad C: Right . If Not if it 's unseen .
Professor F: yeah .
Grad C: Yeah .
Professor F: OK . I mean , i i i i it does seem to me that a lot of times when you train with something that 's at least a little bit noisy it can it can help you out in other kinds of noise even if it 's not matching just because there 's some more variance that you 've built into things . But , but , uh ,
PhD G: Mm - hmm .
Professor F: uh , exactly how well it will work will depend on how near it is to what you had ahead of time . So . OK , so that 's your training corpus ,
PhD G: Mm - hmm .
Professor F: and then your testing corpus ?
Grad C: Um , the testing corporas are , um , just , um , the same ones as Aurora testing . And , that includes , um , the English Spa - um , Italian . Finnish .
PhD E: Finnish .
Grad C: Uh , we ' r we 're gonna get German , right ? Ge - {comment} At the final test will have German .
Professor F: Well , so , yeah , the final test , on a guess , is supposed to be German and Danish ,
PhD G: Uh , yeah .
Professor F: right ?
Grad C: Right .
PhD G: The s yeah , the Spanish , perhaps ,
Grad C: Spanish . Oh yeah , we can we can test on s Spanish .
PhD G: we will have . Yeah . But the the Aurora Spanish , I mean .
Grad C: Oh yeah . Mm - hmm .
Professor F: Oh , there 's a there 's Spanish testing in the Aurora ?
PhD G: Uh , not yet , but , uh , yeah , uh , e
PhD E: Yeah , it 's preparing .
PhD G: pre they are preparing it ,
PhD E: They are preparing .
PhD G: and , well , according to Hynek it will be we will have this at the end of November , or Um .
Professor F: OK , so , uh , something like seven things in each , uh each column .
PhD G: Yeah Professor F: So that 's , uh , three hundred and forty - three , uh , different systems that are going to be developed . There 's three of you .
Grad C: Yeah . One hundred each , about .
Professor F: Uh , so that 's hundred and  hundred and fourteen each .
Grad D: What a what about noise conditions ?
Professor F: What ?
Grad D: w Don't we need to put in the column for noise conditions ?
Professor F: Are you just trying to be difficult ?
Grad D: No , I just don't understand .
Grad C: Well , th uh , when when I put these testings on there , I 'm assumi
Professor F: I 'm just kidding . Yeah .
Grad C: There - there 's three three tests . Um , type - A , type - B , and type - C . And they 're all they 're all gonna be test tested , um , with one training of the HTK system . Um , there 's a script that tests all three different types of noise conditions . Test - A is like a matched noise . Test - B is a is a slightly mismatched . And test - C is a , um , mismatched channel .
Grad D: And do we do all our training on clean data ?
Grad C: Um , no , no ,
PhD E: Also , we can clean that .
Grad C: we 're we 're gonna be , um , training on the noise files that we do have .
PhD G: No .
Professor F: So , um Yeah , so I guess the question is how long does it take to do a a training ? I mean , it 's not totally crazy t I mean , these are a lot of these are built - in things and we know we have programs that compute PLP , we have MSG , we have JRA you know , a lot of these things will just kind of happen , won't take uh a huge amount of development , it 's just trying it out . So , we actually can do quite a few experiments .
Grad C: Mm - hmm .
Professor F: But how how long does it take , do we think , for one of these {comment} trainings ?
Grad C: That 's a good question .
PhD A: What about combinations of things ?
Professor F: Oh yeah , that 's right . I mean , cuz , so , for instance , I think the major advantage of MSG Grad C: Oh !
Professor F: Yeah ,
Grad C: Och !
Professor F: good point . A major advantage of MSG , I see , th that we 've seen in the past is combined with PLP .
PhD E: Yeah .
Professor F: Um .
Grad C: Now , this is turning into a four - dimensional cube ?
PhD A: Well , you just select multiple things on the one dimension .
PhD B: Or you just add it to the features .
PhD E: No .
Grad C: Just PhD E: Here .
Grad C: Oh , yeah . OK .
Professor F: Yeah , so , I mean , you don't wanna , uh Let 's see , seven choose two would   be , uh , twenty - one different combinations . Um .
PhD B: It 's not a complete set of combinations , though ,
Professor F: Probably PhD B: right ? It 's not a complete set of combinations , though ,
Professor F: What ?
PhD B: right ?
Grad C: No .
Professor F: Yeah , I hope not . Yeah , there 's Grad C: That would be Professor F: Uh , yeah , so PLP and MSG I think we definitely wanna try cuz we 've had a lot of good experience with putting those together .
PhD E: Mm - hmm .
Professor F: Um . Yeah .
PhD A: When you do that , you 're increasing the size of the inputs to the net . Do you have to reduce the hidden layer , or something ?
Professor F: Well , so I mean , so i it doesn't increase the number of trainings .
PhD A: No , no , I 'm I 'm just wondering about number of parameters in the net . Do you have to worry about keeping that the same , or ?
Professor F: Uh , I don't think so .
PhD B: There 's a computation limit , though , isn't there ?
Professor F: Yeah , I mean , it 's just more compu Excuse me ?
PhD B: Isn't there like a limit on the computation load , or d latency , or something like that for Aurora task ?
Professor F: Oh yeah , we haven't talked about any of that at all , have we ?
Grad C: No .
Professor F: Yeah , so , there 's not really a limit . What it is is that there 's there 's , uh it 's just penalty , you know ? That that if you 're using , uh , a megabyte , then they 'll say that 's very nice , but , of course , it will never go on a cheap cell phone .
PhD B: OK .
Professor F: Um . And , u uh , I think the computation isn't so much of a problem . I think it 's more the memory . Uh , and , expensive cell phones , exa expensive hand - helds , and so forth , are gonna have lots of memory . So it 's just that , uh , these people see the the cheap cell phones as being still the biggest market , so .
PhD B: Mm - hmm .
Professor F: Um . But , yeah , I was just realizing that , actually , it doesn't explode out , um It 's not really two to the seventh . But it 's but but i i it doesn't really explode out the number of trainings cuz these were all trained individually . Right ? So , uh , if you have all of these nets trained some place , then , uh , you can combine their outputs and do the KL transformation and so forth
Grad C: Mm - hmm .
Professor F: and and , uh So , what it it blows out is the number of uh testings . And , you know and the number of times you do that last part . But that last part , I think , is so has gotta be pretty quick , so . Uh . Right ? I mean , it 's just running the data through Grad C: Oh .
PhD A: But wh what about a net that 's trained on multiple languages , though ?
Professor F: Well , you gotta do the KL transformation ,
PhD G: Eight y
Professor F: but PhD A: Is that just separate nets for each language then combined , or is that actually one net trained on ?
PhD E: Necessary to put in .
Professor F: Good question .
PhD G: Uh , probably one net . Well . Uh .
Professor F: One would think one net ,
PhD G: So .
Professor F: but we 've I don't think we 've tested that . Right ?
PhD G: So , in the broader training corpus we can we can use , uh , the three , or , a combination of of two two languages .
PhD E: Database three .
PhD A: In one net . Mm - hmm .