Meeting transcript:
speaker: A
text: OK . We seem to be recording .
speaker: G
text: Alright !
speaker: G
text: We 're not crashing .
speaker: A
text: So , sorry about not <disfmarker>
speaker: D
text: Number four .
speaker: A
text: not pre - doing everything .
speaker: A
text: The lunch went a little later than I was expecting ,
speaker: A
text: Chuck .
speaker: E
text: Hmm ?
speaker: G
text: OK .
speaker: B
text: Chuck was telling too many jokes , or something ?
speaker: E
text: Yeah .
speaker: A
text: Yep .
speaker: A
text: Pretty much .
speaker: G
text: OK . <vocalsound> Does anybody have an agenda ?
speaker: A
text: No .
speaker: F
text: Well , I 'm <disfmarker> I sent a couple of items . They 're <disfmarker> they 're sort of practical .
speaker: G
text: I thought <pause> somebody had .
speaker: F
text: I don't know if you 're <disfmarker>
speaker: G
text: Yeah , that 's right .
speaker: F
text: if <disfmarker> if that 's too practical for what we 're <pause> focused on .
speaker: G
text: Yeah , we only want th useless things .
speaker: A
text: I mean , we don't want anything too practical .
speaker: G
text: Yeah .
speaker: A
text: Yeah , that would be <disfmarker>
speaker: G
text: No , why don't we talk about practical things ?
speaker: F
text: OK .
speaker: G
text: Sure .
speaker: F
text: Well , um , I can <pause> give you an update on the <pause> transcription effort .
speaker: G
text: Great .
speaker: F
text: Uh , maybe <nonvocalsound> raise the issue of microphone , uh , um procedures
speaker: F
text: with reference to the <pause> cleanliness of the recordings .
speaker: G
text: OK , transcription , uh , microphone issues <disfmarker>
speaker: F
text: And then maybe <nonvocalsound> ask , th uh , these guys .
speaker: F
text: The <disfmarker> we have great <disfmarker> great , uh , p steps forward in terms of the nonspeech - speech pre - segmenting of the signal .
speaker: G
text: OK .
speaker: A
text: Well , we have steps forward .
speaker: F
text: Well , it 's a <disfmarker> it 's a big improvement .
speaker: C
text: Yeah .
speaker: G
text: Yes .
speaker: C
text: I would prefer this .
speaker: G
text: Yeah , well .
speaker: G
text: OK .
speaker: G
text: Uh <disfmarker>
speaker: D
text: We talk about the <disfmarker> <vocalsound> the results of
speaker: G
text: You have some <disfmarker>
speaker: G
text: Yeah .
speaker: G
text: OK .
speaker: A
text: I have a little bit of IRAM stuff
speaker: D
text: use <disfmarker>
speaker: A
text: but <pause> I 'm not sure if that 's of general interest or not .
speaker: G
text: Uh , bigram ?
speaker: A
text: IRAM .
speaker: G
text: IRAM .
speaker: D
text: IRAM .
speaker: G
text: Well , m maybe .
speaker: A
text: IRAM , bigram ,
speaker: D
text: Bi - Bigram .
speaker: G
text: Yeah , let 's <disfmarker> let 's see where we are at three - thirty .
speaker: A
text: you know .
speaker: B
text: Hmm .
speaker: G
text: Um <disfmarker>
speaker: B
text: Since , uh <disfmarker> since I have to leave as usual at three - thirty , can we do the interesting stuff first ?
speaker: F
text: I beg your pardon ?
speaker: G
text: Well <disfmarker>
speaker: C
text: Which is <disfmarker> ?
speaker: F
text: I beg your pardon ?
speaker: A
text: What 's the interesting stuff ?
speaker: G
text: Yeah . Th - now you get to tell us what 's the interesting part .
speaker: D
text: Yeah .
speaker: E
text: Please specify .
speaker: G
text: But <disfmarker>
speaker: C
text: Yeah .
speaker: B
text: Well , uh , I guess the work that 's been <pause> done on segmentation would be most <disfmarker>
speaker: F
text: I think that would be a good thing to start with .
speaker: B
text: Yeah .
speaker: G
text: OK .
speaker: G
text: Um , and , um , <vocalsound> the other thing , uh ,
speaker: G
text: which I 'll just say very briefly that maybe relates to that a little bit ,
speaker: G
text: which is that , um ,
speaker: G
text: uh , one of the suggestions that came up in a brief meeting I had the other day when I was in Spain
speaker: G
text: with , uh , Manolo Pardo and <vocalsound> Javier , uh , Ferreiros , who was <pause> here before ,
speaker: G
text: was , um , why not start with what they had before but add in the non - silence boundaries .
speaker: G
text: So , in what Javier did before when they were doing , um <disfmarker>
speaker: G
text: h he was looking for , uh , speaker change <pause> points .
speaker: D
text: Mm - hmm .
speaker: G
text: Um .
speaker: G
text: As a simplification , he originally did this only using <pause> silence as , uh , a <pause> putative , uh , speaker change point .
speaker: C
text: Yeah .
speaker: G
text: And , uh , he did not , say , look at points where you were changing broad sp uh , phonetic class , for instance .
speaker: G
text: And for Broadcast News , that was fine .
speaker: G
text: Here obviously it 's not .
speaker: D
text: Yeah .
speaker: G
text: And , um , so one of the things that they were pushing in d in discussing with me is , um ,
speaker: G
text: w why are you spending so much time , uh , on the , uh , feature issue ,
speaker: G
text: uh , when perhaps if you sort of deal with what you were using before
speaker: D
text: Uh - huh .
speaker: G
text: and then just broadened it a bit , instead of just ta using silence as putative change point also <disfmarker> ?
speaker: G
text: So then you 've got <disfmarker> you already have the super - structure with Gaussians and H - you know , simple H M Ms and so forth .
speaker: D
text: Nnn , yeah .
speaker: G
text: And you <disfmarker> you might <disfmarker>
speaker: G
text: So there was a <disfmarker> there was a little bit of a <disfmarker> a <disfmarker> a <disfmarker> a difference of opinion
speaker: G
text: because I <disfmarker> I thought that it was <disfmarker> it 's interesting to look at what features are useful .
speaker: D
text: Yeah .
speaker: G
text: But , uh , on the other hand I saw that the <disfmarker> they had a good point
speaker: G
text: that , uh , if we had something that worked for many cases before , maybe starting from there a little bit <disfmarker>
speaker: G
text: Because ultimately we 're gonna end up <vocalsound> with some s su kind of structure like that ,
speaker: D
text: Yeah .
speaker: G
text: where you have some kind of simple HMM
speaker: G
text: and you 're testing the hypothesis that , <vocalsound> uh , there is a change .
speaker: D
text: Yeah .
speaker: G
text: So <disfmarker>
speaker: G
text: so anyway , I just <disfmarker> reporting that .
speaker: G
text: But , uh , uh <disfmarker>
speaker: D
text: OK .
speaker: G
text: So . Yeah , why don't we do the speech - nonspeech discussion ?
speaker: F
text: Yeah .
speaker: F
text: Do <disfmarker> I <disfmarker> I hear <disfmarker> you <disfmarker> you didn't <disfmarker>
speaker: C
text: Speech - nonspeech ?
speaker: F
text: Uh - huh .
speaker: C
text: OK .
speaker: F
text: Yeah .
speaker: C
text: Um , so , uh , what we basically did so far was using the mixed file to <disfmarker> to detect s speech or nonspeech <pause> portions in that .
speaker: G
text: Mm - hmm .
speaker: C
text: And what I did so far is I just used our old Munich system ,
speaker: C
text: which is an HMM - ba based system with Gaussian mixtures for s speech and nonspeech .
speaker: C
text: And it was a system which used only one Gaussian for silence and one Gaussian for speech .
speaker: C
text: And now I added , uh , multi - mixture possibility for <disfmarker> <vocalsound> for speech and nonspeech .
speaker: G
text: Mm - hmm .
speaker: G
text: Mm - hmm .
speaker: C
text: And I did some training on <disfmarker> on one dialogue , which was transcribed by <disfmarker>
speaker: C
text: Yeah . We <disfmarker> we did a nons s speech - nonspeech transcription .
speaker: D
text: Jose .
speaker: C
text: Adam , Dave , and I , we did ,
speaker: C
text: for that dialogue
speaker: C
text: and I trained it on that .
speaker: C
text: And I did some pre - segmentations for <disfmarker> for Jane .
speaker: C
text: And I 'm not sure how good they are or what <disfmarker> what the transcribers say .
speaker: C
text: They <disfmarker> they can use it
speaker: C
text: or <disfmarker> ?
speaker: F
text: Uh , they <disfmarker> they think it 's a terrific improvement .
speaker: F
text: And , um , it real it just makes a <disfmarker> a world of difference .
speaker: G
text: Hmm .
speaker: F
text: And , um , y you also did some something in addition
speaker: F
text: which was , um , for those in which there <nonvocalsound> was , uh , quiet speakers in the mix .
speaker: C
text: Yeah .
speaker: C
text: Uh , yeah .
speaker: C
text: That <disfmarker> that was one <disfmarker> one <disfmarker> one thing ,
speaker: C
text: uh , why I added more mixtures for <disfmarker> for the speech .
speaker: C
text: So I saw that there were loud <disfmarker> loudly speaking speakers and quietly speaking speakers .
speaker: G
text: Mm - hmm .
speaker: C
text: And so I did two mixtures , one for the loud speakers and one for the quiet speakers .
speaker: A
text: And did you hand - label who was loud and who was quiet ,
speaker: C
text: I did that for <disfmarker> for five minutes of one dialogue
speaker: A
text: or did you just <disfmarker> ?
speaker: A
text: Right .
speaker: C
text: and that was enough to <disfmarker> to train the system .
speaker: D
text: Yeah .
speaker: B
text: W What <disfmarker> ?
speaker: C
text: And so it <disfmarker> it adapts , uh , on <disfmarker> while running .
speaker: C
text: So .
speaker: B
text: What kind of , uh , front - end processing did you do ?
speaker: C
text: Hopefully .
speaker: D
text: OK .
speaker: C
text: It 's just our <disfmarker> our old Munich , uh , loudness - based spectrum
speaker: C
text: on mel scale twenty <disfmarker> twenty critical bands and then loudness .
speaker: B
text: Mm - hmm .
speaker: C
text: And four additional features , which is energy , loudness , modified loudness , and zero crossing rate .
speaker: C
text: So it 's twenty - four <disfmarker> twenty - four features .
speaker: G
text: Mm - hmm .
speaker: B
text: Mmm .
speaker: F
text: And you also provided me with several different versions ,
speaker: F
text: which I compared .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: F
text: And so you change <nonvocalsound> parameters .
speaker: F
text: What <disfmarker>
speaker: F
text: do you wanna say something about the parameters <nonvocalsound> that you change ?
speaker: C
text: Yeah .
speaker: C
text: You can specify <vocalsound> the minimum length of speech or <disfmarker> and silence portions which you want .
speaker: C
text: And so I did some <disfmarker> some modifications in those parameters ,
speaker: C
text: basically changing the minimum <disfmarker> minimum <pause> length for s for silence
speaker: C
text: to have , er
speaker: C
text: to have , um <disfmarker>
speaker: C
text: yeah <disfmarker>
speaker: C
text: to have more or less , uh , silence portions in inserted .
speaker: C
text: So .
speaker: A
text: Right . So this would work well for , uh , pauses and utterance boundaries and things like that .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: A
text: But for overlap I imagine that doesn't work at all ,
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: A
text: that you 'll have plenty of s sections that are <disfmarker>
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: C
text: That 's it .
speaker: F
text: Mm - hmm , mm - hmm .
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: F
text: That 's true .
speaker: G
text: Um <disfmarker>
speaker: F
text: But <nonvocalsound> it <disfmarker> it saves so much time <disfmarker> the <disfmarker> the <nonvocalsound> transcribers
speaker: A
text: But <disfmarker>
speaker: A
text: Yep .
speaker: F
text: just enormous , enormous savings .
speaker: G
text: That 's great .
speaker: F
text: Fantastic .
speaker: G
text: Um , just qu one quickly , uh , still on the features .
speaker: G
text: So <vocalsound> you have these twenty - four features .
speaker: C
text: Yeah .
speaker: G
text: Uh , a lot of them are spectral features .
speaker: G
text: Is there a <disfmarker> a transformation , uh , like principal components transformation or something ?
speaker: C
text: No .
speaker: C
text: No . W w we <disfmarker> originally we did that
speaker: A
text: Yeah . It was IS two .
speaker: G
text: Just <disfmarker>
speaker: C
text: but we saw , uh ,
speaker: C
text: when we used it , uh , f for our close - talking microphone , which <disfmarker>
speaker: C
text: yeah , for our <disfmarker> for our recognizer in Munich <disfmarker>
speaker: C
text: we saw that w it 's <disfmarker> it 's not <disfmarker> it 's not so necessary .
speaker: C
text: It <disfmarker> it works as well f with <disfmarker> with <disfmarker> without , uh , a LDA or something .
speaker: G
text: OK .
speaker: G
text: OK . No , I was j <pause> curious .
speaker: C
text: Yeah .
speaker: G
text: Yeah , I don't think it 's a big deal for this application ,
speaker: F
text: Mm - hmm .
speaker: G
text: but <disfmarker> but <disfmarker> Yeah , it 's a <disfmarker>
speaker: C
text: Yeah .
speaker: D
text: Right .
speaker: F
text: Mm - hmm .
speaker: F
text: OK . But then there 's another thing that also Thilo 's involved with ,
speaker: F
text: which is , um <disfmarker>
speaker: F
text: OK , and <disfmarker> and also Da - Dave Gelbart .
speaker: F
text: So there 's this <disfmarker> this problem of <disfmarker>
speaker: F
text: and w and <disfmarker> so we had this meeting .
speaker: F
text: Th - the <nonvocalsound> <disfmarker> also Adam , before the <disfmarker> the <disfmarker> before you went away .
speaker: F
text: Uh we , um <disfmarker> regarding the representation <nonvocalsound> of overlaps ,
speaker: F
text: because at present , <nonvocalsound> <vocalsound> um , because <nonvocalsound> of the limitations of <vocalsound> th the interface we 're using ,
speaker: F
text: overlaps are , uh , not being <nonvocalsound> encoded by <nonvocalsound> the transcribers in as complete <nonvocalsound> and , uh , detailed a way as it might be ,
speaker: F
text: and as might be desired <disfmarker> I think would be desired in the corpus ultimately .
speaker: G
text: Mm - hmm .
speaker: F
text: So we don't have start and end points <nonvocalsound> at each point where there 's an overlap .
speaker: F
text: We just have the <disfmarker> the <nonvocalsound> overlaps <nonvocalsound> encoded in a simple bin .
speaker: F
text: Well , OK . So <nonvocalsound> @ @ the limits of the <nonvocalsound> over of <disfmarker> of the interface are <vocalsound> such that we were <disfmarker> at this meeting we were entertaining how we might either expand <nonvocalsound> the <disfmarker> the <vocalsound> interface or find other tools which already <pause> do what would be useful .
speaker: F
text: Because what would ultimately be , um , ideal in my <disfmarker> my view
speaker: F
text: and I think <disfmarker> I mean , I had the sense that it was consensus ,
speaker: F
text: is that , um , a thorough - going musical score notation would be <nonvocalsound> the best way to go .
speaker: F
text: Because <nonvocalsound> you can have multiple channels ,
speaker: F
text: there 's a single time - line ,
speaker: F
text: it 's very clear , flexible , and all those nice things .
speaker: G
text: Mm - hmm .
speaker: F
text: OK . So , um ,
speaker: F
text: um , I spoke <disfmarker> I had a meeting with Dave Gelbart on <disfmarker> on <disfmarker> and he had , uh , excellent ideas on how <pause> the interface could be <pause> modified to <disfmarker> to do this kind of representation .
speaker: F
text: But , um , he <disfmarker> in the meantime you were checking into the existence of already , um , existing interfaces which might already have these properties .
speaker: F
text: So , do you wanna say something about that ?
speaker: C
text: Yes .
speaker: C
text: Um , I <vocalsound> talked with , uh , Munich guys from <disfmarker> from Ludwi - Ludwig Maximilians University , who do a lot of transcribing and transliterations .
speaker: G
text: Mm - hmm .
speaker: C
text: And they basically said they have <disfmarker> they have , uh , a tool they developed <pause> themselves
speaker: C
text: and they can't give away , uh , f it 's too error - prone ,
speaker: C
text: and had <disfmarker> it 's not supported ,
speaker: C
text: a a a and <disfmarker>
speaker: G
text: Yeah .
speaker: C
text: But , um ,
speaker: C
text: Susanne Bur - Burger , who is at se CMU , he wa who was formally at <disfmarker> in Munich and w and is now at <disfmarker> with CMU ,
speaker: C
text: she said she has something
speaker: C
text: which she uses to do eight channels , uh , trans transliterations ,
speaker: C
text: eight channels simultaneously ,
speaker: G
text: Excuse me .
speaker: C
text: but it 's running under Windows .
speaker: F
text: Under Windows .
speaker: F
text: Mm - hmm .
speaker: C
text: So I 'm not sure if <disfmarker> if <disfmarker> if we can use it .
speaker: F
text: Mm - hmm .
speaker: C
text: She said she would give it to us .
speaker: C
text: It wouldn't be a problem .
speaker: C
text: And I 've got some <disfmarker> some kind of manual <pause> down in my office .
speaker: A
text: Well , maybe we should get it
speaker: A
text: and if it 's good enough we 'll arrange Windows machines to be available .
speaker: C
text: Yeah .
speaker: F
text: Mm - hmm . We could <disfmarker> uh , potentially <nonvocalsound> so .
speaker: A
text: So .
speaker: F
text: I also wanted to be sure <disfmarker>
speaker: F
text: I mean , I 've <disfmarker> I 've seen the <disfmarker>
speaker: F
text: this <disfmarker> this is called Praat , PRAAT , <nonvocalsound> which I guess means spee speech in Dutch or something .
speaker: A
text: Yep .
speaker: C
text: Yeah , but then I 'm not sure <pause> that 's the right thing for us .
speaker: F
text: But <disfmarker>
speaker: G
text: Yeah .
speaker: F
text: In terms <nonvocalsound> of it being <nonvocalsound> Windows <nonvocalsound> versus <disfmarker>
speaker: F
text: But I 'm just wondering , is <disfmarker> ?
speaker: A
text: No , no . Praat isn't <disfmarker> Praat 's multi - platform .
speaker: C
text: No . No , Praat <disfmarker>
speaker: C
text: Yeah . Yeah .
speaker: F
text: Oh ! I see .
speaker: C
text: Yeah .
speaker: F
text: Oh , I see .
speaker: F
text: So Praat may not be <disfmarker>
speaker: C
text: That 's not Praat .
speaker: C
text: It 's called " trans transedit " <pause> I think .
speaker: F
text: It 's a different one .
speaker: F
text: I see .
speaker: C
text: The <disfmarker> the , uh <disfmarker> the tool from <disfmarker> from Susanne .
speaker: F
text: Oh , I see .
speaker: F
text: OK . OK . Alright .
speaker: G
text: The other thing , uh , to keep in mind ,
speaker: G
text: uh <disfmarker> I mean ,
speaker: G
text: we 've been very concerned to get all this rolling
speaker: G
text: so that we would actually have data ,
speaker: F
text: Mmm , yeah .
speaker: G
text: but , um , I think our outside sponsor is actually gonna kick in
speaker: F
text: Mm - hmm .
speaker: G
text: and ultimately that path will be smoothed out .
speaker: G
text: So I don't know if we have a long - term need to do lots and lots of transcribing .
speaker: G
text: I think we had a very quick need to get something out
speaker: G
text: and we 'd like to be able to do some later
speaker: G
text: because just it 's inter it 's interesting .
speaker: G
text: But as far a you know , uh , with <disfmarker> with any luck we 'll be able to wind down the larger project .
speaker: A
text: Oh .
speaker: B
text: But you s
speaker: A
text: What our decision was is that <pause> we 'll go ahead with what we have with a not very fine time scale on the overlaps .
speaker: C
text: Yeah .
speaker: G
text: Right .
speaker: G
text: Yeah .
speaker: A
text: And <disfmarker> and do what we can later <pause> to clean that up if we need to .
speaker: F
text: Mm - hmm .
speaker: G
text: Right .
speaker: F
text: And <disfmarker> and I was just thinking that , um , <vocalsound> if it were possible to bring that in , like , <vocalsound> you know , this week ,
speaker: G
text: Uh - huh .
speaker: F
text: then <nonvocalsound> when they 're encoding the overlaps <nonvocalsound> it would be nice for them to be able to specify when <disfmarker> you know , the start points and end points of overlaps .
speaker: G
text: Yeah .
speaker: F
text: uh Th - they 're <nonvocalsound> making really quick progress .
speaker: G
text: That 's great .
speaker: F
text: And , um , so my <disfmarker> my goal was <disfmarker> w m my charge was to get eleven hours by the end of the month .
speaker: F
text: And it 'll be <disfmarker> I 'm <disfmarker> I 'm <disfmarker> I 'm clear that we 'll be able to do that .
speaker: G
text: That 's great .
speaker: G
text: Yeah .
speaker: A
text: And did you , uh , forward Morgan Brian 's <pause> thing ?
speaker: F
text: I sent <nonvocalsound> it to ,
speaker: F
text: um <disfmarker>
speaker: F
text: who did I send that to ?
speaker: F
text: I sent it to a list
speaker: F
text: and I thought <nonvocalsound> I sent it to <nonvocalsound> the <nonvocalsound> <disfmarker> e to the local list .
speaker: E
text: Meeting Recorder .
speaker: A
text: Oh , you did ?
speaker: F
text: You saw that ?
speaker: A
text: OK . So you probably did get that .
speaker: F
text: So Brian did tell <nonvocalsound> me that <nonvocalsound> in fact what you said , that , <nonvocalsound> uh <disfmarker> that <nonvocalsound> our <disfmarker>
speaker: F
text: that they are <pause> making progress
speaker: F
text: and that he 's going <disfmarker> that <nonvocalsound> they 're <nonvocalsound> going <disfmarker> he 's gonna check the f the output of the first transcription
speaker: F
text: and <disfmarker>
speaker: G
text: I mean , basically it 's <disfmarker> it 's all the difference in the world .
speaker: F
text: and <disfmarker>
speaker: G
text: I mean , basically he 's <disfmarker> he 's on it now .
speaker: A
text: Yeah .
speaker: F
text: Oh , that 's <disfmarker>
speaker: G
text: So <disfmarker> so <disfmarker> so this is <disfmarker> so i it 'll happen .
speaker: F
text: this is a new development .
speaker: F
text: OK .
speaker: F
text: Super .
speaker: F
text: Super .
speaker: F
text: OK . Great .
speaker: G
text: Yeah . I mean , basically it 's just saying that one of our <disfmarker> one of our best people is on it ,
speaker: G
text: you know , who just doesn't happen to be here anymore .
speaker: F
text: Yeah .
speaker: G
text: Someone else pays him .
speaker: G
text: So <disfmarker>
speaker: F
text: Isn't that great ?
speaker: B
text: But about the need for transcription ,
speaker: B
text: I mean , don't we <disfmarker> didn't we previously <vocalsound> decide that the <pause> IBM <pause> transcripts would have to be <pause> checked anyway and possibly augmented ?
speaker: G
text: So . <vocalsound> Yeah .
speaker: F
text: Yes . That 's true .
speaker: B
text: So , I think having a good tool is worth something no matter what .
speaker: F
text: Mm - hmm .
speaker: G
text: Yeah .
speaker: G
text: S OK . That 's <disfmarker> that 's a good point .
speaker: A
text: Yeah , and Dave Gelbart did volunteer ,
speaker: F
text: Good .
speaker: A
text: and since he 's not here , I 'll repeat it <disfmarker>
speaker: A
text: to at least modify Transcriber ,
speaker: A
text: which , if we don't have something else that works , I think that 's a pretty good way of going .
speaker: C
text: Mmm .
speaker: F
text: Mm - hmm .
speaker: A
text: And we discussed on some methods to do it .
speaker: A
text: My approach originally ,
speaker: A
text: and I 've already hacked on it a little bit <disfmarker>
speaker: A
text: it was too slow because I was trying to display all the waveforms .
speaker: A
text: But he pointed out that you don't really have to .
speaker: F
text: Mm - hmm .
speaker: G
text: Mm - hmm .
speaker: A
text: I think that 's a good point .
speaker: G
text: Hmm .
speaker: A
text: That if you just display the mix waveform and then have a user interface for editing the different channels , that 's perfectly sufficient .
speaker: F
text: Yeah , exactly .
speaker: F
text: And just keep those <nonvocalsound> things separate .
speaker: F
text: And <disfmarker> and , um , Dan Ellis 's hack already allows them to be <nonvocalsound> able to display <vocalsound> different <nonvocalsound> waveforms to clarify overlaps and things ,
speaker: F
text: so that 's already <disfmarker>
speaker: A
text: No . They can only display one ,
speaker: A
text: but they can listen to different ones .
speaker: F
text: Oh , yes , but <disfmarker>
speaker: F
text: Well , <vocalsound> uh , yes , but <nonvocalsound> what I mean is <pause> that , uh , from the transcriber 's <nonvocalsound> perspective , uh , those <nonvocalsound> two functions are separate .
speaker: F
text: And Dan Ellis 's hack handles the , <vocalsound> um , choice <nonvocalsound> <disfmarker> the ability to choose different waveforms <vocalsound> from moment to moment .
speaker: A
text: But only to listen to ,
speaker: A
text: not to look at .
speaker: C
text: Yeah .
speaker: F
text: Um <disfmarker>
speaker: A
text: The waveform you 're looking at doesn't change .
speaker: C
text: Yeah .
speaker: F
text: That 's true .
speaker: F
text: Yeah ,
speaker: F
text: but <nonvocalsound> that 's <disfmarker> that 's OK ,
speaker: A
text: Yeah .
speaker: F
text: cuz they 're <disfmarker> they 're ,
speaker: F
text: you know , they 're focused on the ear anyway .
speaker: A
text: Right .
speaker: G
text: Hmm .
speaker: F
text: And then <disfmarker> and then
speaker: F
text: the hack to <vocalsound> preserve the overlaps <nonvocalsound> better would be one which creates different output files for each channel ,
speaker: F
text: which then <nonvocalsound> would also serve Liz 's request <pause> of having ,
speaker: A
text: Right .
speaker: F
text: you know , a single channel ,
speaker: F
text: separable , uh , cleanly , easily separable ,
speaker: G
text: Mm - hmm .
speaker: F
text: uh , transcript tied to a single channel , uh , audio .
speaker: G
text: Mm - hmm .
speaker: G
text: Have , uh , folks from NIST been in contact with you ?
speaker: F
text: Not directly .
speaker: F
text: I 'm trying to think if <disfmarker> if I could have gotten it over a list .
speaker: G
text: OK .
speaker: F
text: I don't <disfmarker> I don't think so .
speaker: G
text: OK . Well , holidays may have interrupted things ,
speaker: G
text: cuz in <disfmarker> in <disfmarker> in <disfmarker>
speaker: G
text: They <vocalsound> seem to want to <pause> get absolutely clear on standards for <disfmarker> transcription standards and so forth with <disfmarker> with us .
speaker: F
text: Oh ! This was from before December .
speaker: G
text: Right . Because they 're <disfmarker> they 're presumably going to start recording next month .
speaker: F
text: Yeah .
speaker: F
text: OK . OK .
speaker: G
text: So .
speaker: A
text: Oh , we should definitely get with them then ,
speaker: A
text: and
speaker: A
text: agree upon a format .
speaker: A
text: Though I don't remember email on that .
speaker: A
text: So was I not in the loop on that ?
speaker: G
text: Um . Yeah , I don't think I mailed anybody .
speaker: G
text: I just think I told them to contact Jane <disfmarker> that , uh , if they had a <disfmarker>
speaker: A
text: Oh , OK .
speaker: F
text: That 's right .
speaker: G
text: if , uh <disfmarker> that <disfmarker> that , uh , as the point person on it .
speaker: G
text: But <disfmarker>
speaker: A
text: Yeah , I think that 's right .
speaker: A
text: Just , uh <disfmarker>
speaker: G
text: So , yeah . Maybe I 'll , uh , ping them a little bit about it to <vocalsound> get that straight .
speaker: F
text: OK .
speaker: F
text: I 'm keeping the conventions <pause> absolutely <pause> as simple <nonvocalsound> as possible .
speaker: G
text: Yeah . So is it <disfmarker> cuz with any luck there 'll actually be a <disfmarker> a <disfmarker> there 'll be collections at Columbia ,
speaker: G
text: collections at <disfmarker> at UW <disfmarker>
speaker: G
text: I mean Dan <disfmarker> Dan is very interested in doing some other things ,
speaker: A
text: Right .
speaker: F
text: Yeah . Yeah .
speaker: A
text: Well , I think it 's important both for the notation and the machine representation to be the same .
speaker: G
text: and collections at NIST .
speaker: G
text: So <disfmarker>
speaker: G
text: Yeah .
speaker: A
text: So .
speaker: F
text: N there was also this , <nonvocalsound> uh , email from Dan regarding the <pause> speech - non nonspeech segmentation thing .
speaker: A
text: Yep .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: F
text: I don't know if ,
speaker: F
text: uh ,
speaker: F
text: uh , we wanna ,
speaker: F
text: uh <disfmarker>
speaker: F
text: and Dan Gel - and Dave Gelbart is interested in pursuing the aspect <nonvocalsound> of using amplitude <nonvocalsound> as a <disfmarker> a <disfmarker> a <disfmarker> as a basis for the separation .
speaker: G
text: Oh , yeah . He was talking <disfmarker> he was talking <disfmarker> I mean , uh , we <disfmarker> he had <disfmarker>
speaker: A
text: Cross - correlation .
speaker: F
text: Cross
speaker: G
text: Yeah , cross - correlation .
speaker: C
text: Cross
speaker: G
text: I had mentioned this a couple times before , the c the commercial devices that do , uh , <vocalsound> uh , voice , uh <disfmarker> you know , active miking ,
speaker: F
text: Uh - huh .
speaker: G
text: basically look at the amp at the energy at each of the mikes .
speaker: G
text: And <disfmarker> and you basically compare the energy here to <vocalsound> some function of all of the mikes .
speaker: C
text: Yeah .
speaker: G
text: So ,
speaker: F
text: OK .
speaker: D
text: Yeah .
speaker: G
text: by doing that , you know , rather than setting any , uh , absolute threshold , you actually can do pretty good , uh , selection of who <disfmarker> who 's talking .
speaker: F
text: OK .
speaker: G
text: Uh <disfmarker>
speaker: G
text: And those <disfmarker> those systems work very well , by the way ,
speaker: G
text: I mean , so people use them in <vocalsound> panel discussions and so forth with sound reinforcement differing in <disfmarker> in sort of ,
speaker: D
text: Uh - huh .
speaker: G
text: uh <disfmarker>
speaker: G
text: and , uh , those <disfmarker> if <disfmarker>
speaker: G
text: Boy , the guy I knew who built them , built them like twenty <disfmarker> twenty years ago ,
speaker: G
text: so they 're <disfmarker> <vocalsound> it 's <disfmarker> the <disfmarker> the techniques work pretty well .
speaker: A
text: Hmm .
speaker: F
text: Fantastic .
speaker: G
text: So .
speaker: F
text: Cuz there is one thing that we don't have right now and that is the automatic , um , channel identifier .
speaker: G
text: Mm - hmm .
speaker: F
text: That <disfmarker> that , you know , that would g help in terms of encoding of overlaps .
speaker: F
text: The <disfmarker> the transcribers would have less , uh , disentangling to do <pause> if that were available .
speaker: G
text: Yeah . So I think , you know , basically you can look at some <disfmarker> p you have to play around a little bit , uh , to figure out what the right statistic is ,
speaker: F
text: But .
speaker: D
text: Mm - hmm .
speaker: G
text: but you compare each microphone to some statistic based on the <disfmarker> <vocalsound> on the overall <disfmarker>
speaker: F
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: D
text: Mm - hmm .
speaker: F
text: OK .
speaker: G
text: Uh , and we also have these <disfmarker> we have the advantage of having <pause> distant mikes too .
speaker: G
text: So that , you cou yo
speaker: A
text: Yeah , although the <disfmarker> the <disfmarker>
speaker: A
text: using the close - talking I think would be much better .
speaker: A
text: Wouldn't it ?
speaker: F
text: Yeah .
speaker: G
text: Um . I <disfmarker> I don't know .
speaker: G
text: I just <disfmarker> it 'd be <disfmarker>
speaker: A
text: Yeah .
speaker: G
text: If I was actually working on it , I 'd sit there and <disfmarker> and play around with it ,
speaker: G
text: and <disfmarker> and get a feeling for it .
speaker: G
text: I mean , the <disfmarker> the <disfmarker> the ,
speaker: G
text: uh <disfmarker>
speaker: G
text: But ,
speaker: G
text: uh , you certainly wanna use the close - talking , as a <disfmarker> at least .
speaker: A
text: Right .
speaker: G
text: I don't know if the other would <disfmarker> would add some other helpful dimension or not .
speaker: F
text: Mm - hmm .
speaker: D
text: Mm - hmm .
speaker: D
text: OK . What <disfmarker> what are the different , uh , classes to <disfmarker> to code , uh , the <disfmarker> the overlap , you will use ?
speaker: F
text: Um , to code d
speaker: F
text: so types of overlap ?
speaker: D
text: What you <disfmarker> you <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: Um , so <nonvocalsound> at a meeting that wasn't transcribed , we worked up a <disfmarker> a typology .
speaker: D
text: Yeah .
speaker: F
text: And , um <disfmarker>
speaker: D
text: Look like , uh , you t you explaining in the blackboard ?
speaker: D
text: The <disfmarker> ?
speaker: F
text: Yes , exactly .
speaker: D
text: Yeah ? Yeah .
speaker: F
text: That hasn't changed .
speaker: F
text: So
speaker: F
text: it <nonvocalsound> i the <disfmarker> it 's basically a two - tiered structure where the first one is whether <nonvocalsound> the person who 's interrupted continues or not .
speaker: F
text: And then below that there 're <nonvocalsound> subcategories , uh , that have more to do with , <nonvocalsound> you know , is it , <vocalsound> uh , simply <nonvocalsound> backchannel
speaker: D
text: Mm - hmm .
speaker: F
text: or is <nonvocalsound> it , um , someone completing someone else 's thought ,
speaker: F
text: or is it someone in introducing a new thought .
speaker: A
text: Right .
speaker: A
text: And I hope that if we do a forced alignment with the close - talking mike , that will be enough to recover at least some of the time the time information of when the overlap occurred .
speaker: D
text: Huh .
speaker: D
text: Yeah .
speaker: F
text: Mm - hmm . Well , <vocalsound> one would <disfmarker>
speaker: D
text: Yeah .
speaker: D
text: We hope .
speaker: A
text: Yeah . Who knows ?
speaker: F
text: That 'd be <disfmarker> that 'd be nice .
speaker: F
text: I mean , <vocalsound> I <disfmarker> I <disfmarker> I <disfmarker> I 've <disfmarker>
speaker: B
text: So who 's gonna do that ?
speaker: B
text: Who 's gonna do forced alignment ?
speaker: A
text: Well , u uh , IBM was going to .
speaker: A
text: Um <disfmarker>
speaker: B
text: Oh , OK .
speaker: D
text: Oh .
speaker: A
text: and I imagine they still plan to
speaker: A
text: but <disfmarker> but , you know , I haven't spoken with them about that recently .
speaker: B
text: OK .
speaker: D
text: Uh - huh .
speaker: G
text: Well , uh , my suggestion now is <disfmarker> is on all of these things to , uh , contact Brian .
speaker: A
text: OK . I 'll do that .
speaker: F
text: This is wonderful <nonvocalsound> to have a direct contact like that .
speaker: D
text: Yeah .
speaker: G
text: Yeah .
speaker: F
text: uh Well , th lemme ask <nonvocalsound> you this .
speaker: G
text: Yeah .
speaker: F
text: It occurs to me <disfmarker> <vocalsound> one of my transcribers t <nonvocalsound> told <nonvocalsound> me today that she 'll <nonvocalsound> be finished with one meeting , <vocalsound> um , by <disfmarker>
speaker: G
text: Mm - hmm .
speaker: F
text: well , she said tomorrow
speaker: F
text: but then she said <nonvocalsound> <disfmarker> you know ,
speaker: F
text: but <nonvocalsound> <disfmarker> the , you know <disfmarker> let 's <disfmarker> let 's just , uh , say
speaker: G
text: Mm - hmm .
speaker: F
text: maybe the day after just to be s on the safe side .
speaker: F
text: I could send Brian the , <nonvocalsound> um <disfmarker> the <nonvocalsound> transcript .
speaker: F
text: I know these <nonvocalsound> are <disfmarker>
speaker: F
text: er , uh , I could send him that <nonvocalsound> if <nonvocalsound> it would be possible , <nonvocalsound> or a good idea or not , to <nonvocalsound> try <nonvocalsound> to do a s forced alignment on what we 're <disfmarker> on the way we 're encoding overlaps now .
speaker: G
text: Well , just talk to him about it .
speaker: A
text: Yep .
speaker: F
text: Good .
speaker: G
text: I mean , you know , basically he 's <disfmarker> he just studies , he 's a colleague ,
speaker: G
text: a friend ,
speaker: G
text: and ,
speaker: F
text: Yeah !
speaker: G
text: uh , they <disfmarker> and <disfmarker> and , you know , the <disfmarker> the organization always did wanna help us .
speaker: F
text: Super . Super .
speaker: G
text: It was just a question of getting , you know , the right people connected in , who had the time .
speaker: F
text: Yeah , yeah .
speaker: A
text: Right .
speaker: G
text: So ,
speaker: G
text: um , eh <disfmarker>
speaker: A
text: Is he on the mailing list ?
speaker: A
text: The Meeting Recorder mailing li ?
speaker: F
text: Oh !
speaker: A
text: We should add him .
speaker: F
text: Yeah . I <disfmarker> I <disfmarker> I don't know for sure .
speaker: G
text: Yeah .
speaker: E
text: Did something happen , Morgan , that he got put on this , or was he already on it ,
speaker: A
text: Add him .
speaker: E
text: or <disfmarker> ?
speaker: G
text: No , I , eh , eh , p
speaker: G
text: It <disfmarker> it oc I <disfmarker> h it 's <disfmarker>
speaker: G
text: Yeah , something happened .
speaker: G
text: I don't know what .
speaker: B
text: He asked for more work .
speaker: E
text: Huh .
speaker: G
text: But he 's on it now .
speaker: F
text: That would be <nonvocalsound> like <disfmarker> that 'd be like him .
speaker: F
text: He 's great .
speaker: G
text: Right .
speaker: G
text: So , uh ,
speaker: G
text: where are we ?
speaker: G
text: Maybe , uh , uh , brief <disfmarker>
speaker: G
text: Well , let 's <disfmarker> why don't we talk about microphone issues ?
speaker: F
text: Yeah . That 'd be great .
speaker: G
text: That was <disfmarker> that was a <disfmarker>
speaker: A
text: Um ,
speaker: A
text: so one thing is that I did look on Sony 's for a replacement for the mikes <disfmarker> <vocalsound> for the head m head - worn ones
speaker: A
text: cuz they 're so uncomfortable .
speaker: A
text: But I think I need someone who knows more about mikes than I do ,
speaker: A
text: because I couldn't find a single other model that seemed like it would fit the connector ,
speaker: A
text: which seems really unlikely to me .
speaker: A
text: Does anyone , like , know stores
speaker: A
text: or <vocalsound> know about mikes who <disfmarker> who would know the right questions to ask ?
speaker: G
text: Oh , I probably would .
speaker: G
text: I mean , my knowledge is twenty years out of date
speaker: G
text: but some of it 's still the same .
speaker: G
text: So <disfmarker>
speaker: A
text: Mm - hmm .
speaker: G
text: Uh , so maybe we c we can take a look at that .
speaker: E
text: You couldn't <disfmarker> you couldn't find the right connector to go into these things ?
speaker: A
text: Yep .
speaker: E
text: Huh !
speaker: A
text: When I looked , i they listed one microphone and that 's it
speaker: A
text: as having that type of connector .
speaker: A
text: But my guess is that Sony maybe uses a different number for their connector than everyone else does .
speaker: A
text: And <disfmarker> and so <disfmarker>
speaker: G
text: Mm - hmm .
speaker: G
text: Well , let 's look at it together
speaker: A
text: it seems <disfmarker> it seems really unlikely to me that there 's only one .
speaker: G
text: and <disfmarker>
speaker: F
text: And there 's no adaptor for it ?
speaker: F
text: Seems like there 'd be a <disfmarker>
speaker: C
text: Yeah .
speaker: F
text: OK .
speaker: A
text: As I said , who knows ?
speaker: F
text: Mm - hmm .
speaker: G
text: Who <disfmarker> who are we buying these from ?
speaker: A
text: Um ,
speaker: G
text: That 'd be
speaker: A
text: I have it downstairs .
speaker: A
text: I don't remember off the top of my head .
speaker: G
text: Yeah .
speaker: G
text: OK .
speaker: G
text: Yeah . We <disfmarker> we can try and look at that together .
speaker: A
text: And then , uh <disfmarker>
speaker: A
text: just in terms of how you wear them <disfmarker>
speaker: A
text: I mean , I had thought about this before .
speaker: A
text: I mean , when <disfmarker> when <disfmarker> when you use a product like DragonDictate , they have a very extensive description about how to wear the microphone and so on .
speaker: F
text: Oh .
speaker: A
text: But I felt that in a real situation we were very seldom gonna get people to really do it
speaker: A
text: and maybe it wasn't worth concentrating on .
speaker: A
text: But <disfmarker>
speaker: G
text: Well , I think that that 's <disfmarker> that 's a good back - off position .
speaker: G
text: That 's what I was saying <vocalsound> earlier ,
speaker: G
text: th that , you know , we are gonna get some <vocalsound> recordings that are imperfect
speaker: G
text: and , hey , that 's life .
speaker: G
text: But I <disfmarker> I think that it <disfmarker> it doesn't hurt , uh , the naturalness of the situation to try to have people <pause> wear the microphones properly , if possible ,
speaker: A
text: Mm - hmm .
speaker: G
text: because , <vocalsound> um , the natural situation is really what we have with the microphones on the table .
speaker: G
text: I mean , I think , <vocalsound> you know , in the target applications that we 're talking about , people aren't gonna be wearing head - mounted mikes anyway .
speaker: A
text: Oh . That 's true .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: G
text: So this is just for u these head - mounted mikes are just for use with research .
speaker: A
text: Mm - hmm .
speaker: G
text: And , uh , it 's gonna make <disfmarker>
speaker: D
text: Yeah .
speaker: G
text: You know , if <disfmarker> if An - Andreas plays around with language modeling , he 's not gonna be m wanna be messed up by people breathing into the microphone .
speaker: A
text: Right .
speaker: G
text: So it 's <disfmarker> it 's , uh , uh <disfmarker>
speaker: A
text: Well , I 'll dig through the documentation to DragonDictate and ste s see if they still have the little <pause> form .
speaker: G
text: But it does happen .
speaker: G
text: Right ?
speaker: G
text: I mean , and any <disfmarker>
speaker: D
text: Yeah .
speaker: B
text: It 's interesting ,
speaker: B
text: uh ,
speaker: B
text: I talked to some IBM guys , uh , last January , I think , I was there .
speaker: B
text: And <disfmarker>
speaker: B
text: so people who were working on the <disfmarker> on their ViaVoice dictation product .
speaker: G
text: Yeah .
speaker: B
text: And they said , uh , the breathing is really a <disfmarker> a terrible problem <pause> for them ,
speaker: B
text: to <disfmarker> to not recognize breathing as speech .
speaker: F
text: Wow .
speaker: B
text: So , anything to reduce breathing is <disfmarker> is <disfmarker> is a good thing .
speaker: G
text: Yeah .
speaker: A
text: Well , that 's the <disfmarker>
speaker: A
text: It seemed to me when I was using Dragon that it was really microphone placement helped an <disfmarker> in , uh <disfmarker> an enormous amount .
speaker: B
text: Mm - hmm .
speaker: A
text: So you want it enough to the side so that when you exhale through your nose , it doesn't <disfmarker> the wind doesn't hit the mike .
speaker: B
text: Right .
speaker: B
text: Mm - hmm .
speaker: A
text: And then , uh <disfmarker>
speaker: A
text: Everyone 's adjusting their microphones , of course .
speaker: A
text: And then just close enough so that you get good volume .
speaker: A
text: So you know , wearing it right about here seems to be about the right way to do it .
speaker: D
text: Yeah .
speaker: G
text: Yeah .
speaker: G
text: I remember when I was <disfmarker> when I <disfmarker> I <disfmarker> I <disfmarker> I used , uh , um , <vocalsound> a prominent laboratory 's , uh , uh , speech recognizer
speaker: F
text: Is <disfmarker>
speaker: F
text: Uh - huh .
speaker: G
text: about , <vocalsound> uh <disfmarker> This was , boy , this was a while ago ,
speaker: G
text: this was about twelve <disfmarker> twelve years ago or something .
speaker: G
text: And , um ,
speaker: G
text: they were <disfmarker> they were perturbed with me
speaker: G
text: because I was breathing in instead of breathing out .
speaker: G
text: And they had models for <disfmarker> they <disfmarker> <vocalsound> they had Markov models for br breathing out
speaker: G
text: but they didn't have them for breathing in .
speaker: G
text: Uh <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: That 's interesting .
speaker: F
text: Well , what I wondered is whether it 's possible to have <disfmarker> <vocalsound> to maybe use the display at the beginning
speaker: F
text: to be able to <disfmarker> to judge how <disfmarker> how correctly <disfmarker>
speaker: A
text: Yeah .
speaker: F
text: I mean , have someone do some routine whatever ,
speaker: F
text: and <disfmarker> and then see if when they 're breathing it 's showing .
speaker: F
text: I don't know if the <disfmarker> if it 's <disfmarker>
speaker: A
text: I mean , when <disfmarker> when it 's on , you can see it .
speaker: G
text: I <disfmarker>
speaker: A
text: You can definitely see it .
speaker: F
text: Can you see the breathing ?
speaker: F
text: Cuz I <disfmarker>
speaker: A
text: Absolutely .
speaker: F
text: Oh .
speaker: A
text: Absolutely .
speaker: G
text: Yeah .
speaker: G
text: I
speaker: A
text: And so , you know , I 've <disfmarker> I 've sat here and watched sometimes the breathing ,
speaker: A
text: and the bar going up and down ,
speaker: A
text: and I 'm thinking , I could say something ,
speaker: A
text: but
speaker: G
text: I mean , I think <disfmarker>
speaker: A
text: I don't want to make people self - conscious .
speaker: A
text: Stop breathing !
speaker: G
text: It <disfmarker> it 's going to be imperfect .
speaker: G
text: You 're not gonna get it perfect .
speaker: F
text: Yeah . Uh - huh .
speaker: G
text: And you can do some , uh , you know , first - order thing about it ,
speaker: G
text: which is to have people move it , uh , uh , a away from being just directly in front of the middle
speaker: D
text: Yeah .
speaker: F
text: Good .
speaker: G
text: but not too far away .
speaker: F
text: Yeah , i
speaker: G
text: And then , you know , I think there 's not much <disfmarker>
speaker: G
text: Because you can't al you know , interfere w
speaker: G
text: you can't fine tune the meeting that much , I think .
speaker: A
text: Right .
speaker: G
text: It 's sort of <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: That 's true .
speaker: F
text: It just seems like i if something l simple like that can be tweaked <vocalsound> and the quality goes , you know , uh , dramatically up , then it might be worth <pause> doing .
speaker: A
text: Yep .
speaker: A
text: And then also <disfmarker> the position of the mike also .
speaker: A
text: If it 's more directly , you 'll get better volume .
speaker: D
text: Yeah .
speaker: A
text: So <disfmarker> so , like , yours is pretty far down <pause> below your mouth . Yeah .
speaker: F
text: But <disfmarker>
speaker: F
text: Mm - hmm .
speaker: F
text: My <disfmarker> my feedback from the transcribers is he is always close to crystal clear and <disfmarker> and just fan fantastic to <disfmarker>
speaker: C
text: Yeah .
speaker: D
text: Mmm , yeah .
speaker: G
text: Mm - hmm .
speaker: A
text: I don't know why that is .
speaker: F
text: Well , I mean , you <disfmarker> Yeah , of course . You 're <disfmarker> you 're also <disfmarker>
speaker: F
text: uh , your volume is <disfmarker> is greater .
speaker: F
text: But <disfmarker> but still , I mean , they <disfmarker> they say <disfmarker>
speaker: A
text: I 've been eating a lot .
speaker: F
text: I it makes their <disfmarker> their job extremely easy .
speaker: G
text: Uh .
speaker: F
text: Yeah .
speaker: G
text: And then there 's mass .
speaker: F
text: Mm - hmm .
speaker: G
text: Anyway .
speaker: F
text: I could say something about <disfmarker> about the <disfmarker>
speaker: F
text: Well , I don't know what you wanna do . Yeah .
speaker: G
text: About what ?
speaker: F
text: About the transcribers or anything or <disfmarker> ?
speaker: F
text: I don't know .
speaker: G
text: Well , the other <disfmarker>
speaker: G
text: why don't we do that ?
speaker: B
text: But , uh , just to <disfmarker> to , um <disfmarker>
speaker: B
text: One more remark , uh , concerning the SRI recognizer .
speaker: B
text: Um .
speaker: B
text: It is useful to transcribe and then ultimately train models for things like breath ,
speaker: B
text: and also laughter is very , very frequent and important to <disfmarker> <vocalsound> to model .
speaker: G
text: Mm - hmm .
speaker: B
text: So ,
speaker: B
text: if you can in your transcripts mark <disfmarker>
speaker: A
text: So ,
speaker: A
text: mark them ?
speaker: B
text: mark very audible breaths and laughter especially ,
speaker: C
text: Mmm .
speaker: F
text: They are .
speaker: B
text: um <disfmarker>
speaker: F
text: They 're putting <disfmarker> Eh , so in curly brackets they put " inhale " or " breath " .
speaker: B
text: OK .
speaker: B
text: Mm - hmm .
speaker: A
text: Oh , great .
speaker: F
text: It <disfmarker> they <disfmarker> and then in curly brackets they say " laughter " .
speaker: F
text: Now they 're <disfmarker> <vocalsound> they 're not being <pause> awfully precise ,
speaker: F
text: uh , m So they 're two types of laughter that are not being distinguished .
speaker: B
text: Mm - hmm .
speaker: F
text: One is <vocalsound> when sometimes s someone will start laughing when they 're in the middle of a sentence .
speaker: B
text: Mm - hmm .
speaker: F
text: And <disfmarker> and then the other one is when they finish the sentence and then they laugh .
speaker: F
text: So , um , I <disfmarker> I did s I did some double checking to look through <disfmarker>
speaker: F
text: I mean , <vocalsound> you 'd need to have extra
speaker: F
text: e extra complications , like time tags indicating the beginning and ending of <disfmarker> <vocalsound> of the laughing through the utterance .
speaker: B
text: It 's not so <disfmarker> I don't think it 's , um <disfmarker>
speaker: F
text: And that <disfmarker> and what they 're doing is in both cases just saying " curly brackets laughing " a after the unit .
speaker: B
text: As <disfmarker> as long as there is an indication that there was laughter somewhere between <pause> two words <vocalsound> I think that 's sufficient ,
speaker: C
text: Yeah .
speaker: F
text: Good .
speaker: F
text: Oh !
speaker: F
text: OK .
speaker: A
text: Against <disfmarker> they could do forced alignment .
speaker: B
text: because
speaker: C
text: Yeah .
speaker: B
text: actually the recognition of laughter once you kn um <disfmarker> you know , is pretty good .
speaker: B
text: So as long as you can stick a <disfmarker> you know , a t a tag in there that <disfmarker> that indicates that there was laughter ,
speaker: A
text: Oh , I didn't know that .
speaker: F
text: OK .
speaker: B
text: that would probably be , uh , sufficient to train models .
speaker: A
text: That would be a really interesting <pause> prosodic feature ,
speaker: F
text: Then <disfmarker>
speaker: F
text: And let me ask y
speaker: D
text: Yeah .
speaker: F
text: and I gotta ask you one thing about that .
speaker: A
text: when <disfmarker>
speaker: F
text: So , um ,
speaker: B
text: Hmm .
speaker: F
text: if they laugh between two words , you <disfmarker> you 'd get it in between the two words .
speaker: B
text: Mm - hmm .
speaker: F
text: But if they laugh across three or four words you <disfmarker> you get it after those four words .
speaker: B
text: Right .
speaker: F
text: Does that matter ?
speaker: D
text: Yeah .
speaker: B
text: Well , the thing that you <disfmarker> is hard to deal with is whe <vocalsound> when they speak while laughing .
speaker: B
text: Um , and that 's , uh <disfmarker> I don't think that we can do very well with that .
speaker: A
text: Right .
speaker: B
text: So <disfmarker>
speaker: D
text: Yeah .
speaker: B
text: But , um , that 's not as frequent as just laughing between speaking ,
speaker: F
text: OK .
speaker: B
text: so <disfmarker>
speaker: A
text: So are <disfmarker> do you treat breath and laughter as phonetically , or as word models , or what ?
speaker: G
text: Uh is it ?
speaker: D
text: Huh .
speaker: F
text: I think he 's right .
speaker: D
text: I <disfmarker> I think it 's frequent in <disfmarker> in the meeting .
speaker: F
text: Yeah .
speaker: B
text: We tried both .
speaker: B
text: Uh , currently , um , we use special words .
speaker: B
text: There was a <disfmarker> there 's actually a word for <disfmarker> uh , it 's not just breathing but all kinds of mouth <disfmarker>
speaker: A
text: Mm - hmm .
speaker: A
text: Mouth stuff ?
speaker: B
text: uh , mouth <disfmarker> mouth stuff .
speaker: B
text: And then laughter is a <disfmarker> is a special word .
speaker: A
text: How would we do that with the hybrid system ?
speaker: G
text: Same thing .
speaker: B
text: Same thing ?
speaker: A
text: So train a phone <pause> in the neural net ?
speaker: B
text: Yeah .
speaker: B
text: Yeah . You ha Oh . And each of these words has a dedicated phone .
speaker: G
text: No <disfmarker>
speaker: A
text: Oh , it does ?
speaker: B
text: So the <disfmarker> so the <disfmarker> the mouth noise , uh , word has just a single phone ,
speaker: B
text: um , that is for that .
speaker: A
text: Right . So in the hybrid system we could train the net with a laughter phone and a breath sound phone .
speaker: G
text: Yeah .
speaker: B
text: Yeah .
speaker: G
text: I mean , it 's <disfmarker> it 's <disfmarker> it 's always the same thing .
speaker: B
text: Yeah .
speaker: G
text: Right ?
speaker: F
text: Mm - hmm .
speaker: G
text: I mean , you could <disfmarker> you could say well , let <disfmarker>
speaker: G
text: we now think that laughter should have three sub sub <vocalsound> sub - units in the <disfmarker> the three states , uh <disfmarker> different states .
speaker: C
text: Yeah .
speaker: G
text: And then you would have three <disfmarker>
speaker: G
text: I mean , you know , eh , eh , it 's u
speaker: B
text: And the <disfmarker> the pronun the pronunciations <disfmarker> the pronunciations are l are somewhat non - standard .
speaker: A
text: Do whatever you want .
speaker: G
text: Yeah , yeah .
speaker: D
text: Yeah .
speaker: D
text: No .
speaker: B
text: They actually are <disfmarker>
speaker: B
text: uh , it 's just a single , s uh , you know , a single phone in the pronunciation ,
speaker: B
text: but it has a self - loop on it ,
speaker: B
text: so it can <disfmarker>
speaker: A
text: To <pause> go on forever ?
speaker: B
text: r can go on forever .
speaker: A
text: And how do you handle it in the language model ?
speaker: B
text: It 's just a <disfmarker> it 's just a word .
speaker: B
text: We train it like any other word .
speaker: A
text: It 's just a word in the language model .
speaker: A
text: Cool .
speaker: B
text: Yeah .
speaker: B
text: We also tried , <vocalsound> um , absorbing these <disfmarker> uh , both laughter and <disfmarker> and actually also noise ,
speaker: B
text: and , um <disfmarker>
speaker: D
text: Yeah .
speaker: B
text: Yes .
speaker: B
text: OK .
speaker: B
text: Anyway . We also tried absorbing that into the pause model <disfmarker>
speaker: B
text: I mean , the <disfmarker> the <disfmarker> the model that <disfmarker> that matches the stuff between words .
speaker: G
text: Mm - hmm .
speaker: B
text: And , um ,
speaker: B
text: it didn't work as well . So .
speaker: A
text: Huh .
speaker: A
text: OK .
speaker: F
text: Mm - hmm .
speaker: A
text: Can you hand me your digit form ?
speaker: B
text: Sorry .
speaker: A
text: I just wanna mark that you did not read digits .
speaker: G
text: OK .
speaker: G
text: Say hi for me .
speaker: F
text: Good .
speaker: F
text: You <disfmarker> you did get me to thinking about <disfmarker>
speaker: F
text: I <disfmarker> I 'm not really sure which is more frequent ,
speaker: F
text: whether f f laughing <disfmarker>
speaker: F
text: I think it may be an individual thing . Some people are more prone to laughing when they 're speaking .
speaker: G
text: Yeah .
speaker: G
text: Yeah . I think <disfmarker>
speaker: A
text: I was noticing that with Dan in the one that we , uh <disfmarker> we hand tran hand - segmented ,
speaker: F
text: But I can't <disfmarker>
speaker: D
text: Yeah .
speaker: A
text: that <disfmarker> th he has these little chuckles as he talks .
speaker: F
text: Yeah . OK .
speaker: G
text: I 'm sure it 's very individual .
speaker: G
text: And <disfmarker> and <disfmarker>
speaker: G
text: one thing that c that we 're not doing , of course , is we 're not claiming to , uh , get <disfmarker> be getting a representation of mankind
speaker: G
text: in these recordings . We have <vocalsound> this very , very tiny sample of <disfmarker> of <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: Yeah .
speaker: D
text: Yeah .
speaker: A
text: Speech researchers ?
speaker: G
text: Uh , yeah .
speaker: G
text: And <disfmarker> <vocalsound> Yeah , r right .
speaker: D
text: Speech research .
speaker: G
text: So , uh , who knows .
speaker: G
text: Uh <disfmarker>
speaker: G
text: Yeah . Why don why don't we just <disfmarker> since we 're on this vein , why don't we just continue with , uh , what you were gonna say about the transcriptions
speaker: G
text: and <disfmarker> ?
speaker: F
text: OK .
speaker: F
text: Um , um , the <disfmarker> I <disfmarker> I 'm really very for I 'm extremely fortunate with the people who , uh , applied and who are transcribing for us .
speaker: F
text: They <vocalsound> are , um , um , uh really perceptive and very , um <disfmarker>
speaker: F
text: and I 'm not just saying that cuz they might be hearing this .
speaker: A
text: Cuz they 're gonna be transcribing it in a few days .
speaker: F
text: No , they 're super . They 're <disfmarker> the they <disfmarker> very quick .
speaker: E
text: OK . Turn the mikes off and let 's talk .
speaker: F
text: Yeah , I know . I am <disfmarker> I 'm serious .
speaker: F
text: They 're just super .
speaker: F
text: So I , um , e you know , I <disfmarker> I brought them in and , um , trained them in pairs
speaker: F
text: because I think people can raise questions <disfmarker>
speaker: F
text: you know , i i the they think about different things
speaker: A
text: That 's a good idea .
speaker: F
text: and they think of different <disfmarker>
speaker: F
text: and um ,
speaker: F
text: I trained them to , uh , f on about a minute or two of the one that was already transcribed .
speaker: F
text: This also gives me a sense of <disfmarker>
speaker: F
text: You know , I can <disfmarker> I can use that later , with reference to inter - coder reliability kind of issues .
speaker: F
text: But the main thing was to get them used to the conventions
speaker: F
text: and , <vocalsound> you know , the idea of the <disfmarker> th th the size of the unit versus how long it takes to play it back
speaker: F
text: so these <disfmarker> th sort of calibration issues .
speaker: F
text: And then , um , I just set them loose
speaker: F
text: and they 're <disfmarker>
speaker: F
text: they all have e a already background in using computers .
speaker: F
text: They 're , um <disfmarker> they 're trained in linguistics .
speaker: A
text: Good .
speaker: F
text: They got <disfmarker>
speaker: G
text: Uh - huh .
speaker: A
text: Oh , no .
speaker: A
text: Is that good or bad ?
speaker: F
text: Well , they they 're very perce
speaker: F
text: they 'll <disfmarker> So one of them said " well , you know , he really said " n " ,
speaker: F
text: not really " and " ,
speaker: D
text: Yeah .
speaker: F
text: so what <vocalsound> <disfmarker> what should I do with that ? "
speaker: D
text: Yeah .
speaker: F
text: And I said , " well for our purposes ,
speaker: A
text: Yeah .
speaker: G
text: Yeah .
speaker: F
text: I do have a convention . If it 's an <disfmarker> a noncanonical p "
speaker: F
text: That one , I think we <disfmarker> you know , with Eric 's work , I sort of figure we <disfmarker> we can just treat that as a variant .
speaker: G
text: OK .
speaker: F
text: But I told them if <disfmarker> if there 's an obvious speech error , uh , like I said in one thing ,
speaker: G
text: Yes .
speaker: F
text: and I gave my <disfmarker> my example , like I said , " microfon " <pause> in instead of " microphone " .
speaker: F
text: Didn't bother <disfmarker>
speaker: F
text: I knew it when I said it .
speaker: F
text: I remember s thinking " oh , that 's not correctly pronounced " .
speaker: F
text: But it <disfmarker> but I thought <vocalsound> it 's not worth fixing
speaker: F
text: cuz often when you 're speaking everybody knows what <disfmarker> what you mean .
speaker: A
text: You 'll self - repair .
speaker: A
text: Yeah .
speaker: C
text: Yeah .
speaker: F
text: But I have a convention that if it 's obviously a noncanonical pronunciation <disfmarker> a speech error with <disfmarker> you know , wi within the realm of resolution that you can tell in this native English <disfmarker> American English speaker , you know that I didn't mean to say " microfon . "
speaker: F
text: Then you 'd put a little tick at the beginning of the word ,
speaker: G
text: Yeah .
speaker: F
text: and that just signals that , um , this is not standard ,
speaker: F
text: and then in curly brackets " pron <nonvocalsound> error " .
speaker: F
text: And , um , and other than that , it 's w word level .
speaker: F
text: But , you know , the fact that they noticed , you know , the " nnn " . " He said " nnn " , not " and " .
speaker: F
text: What shall I do with that ? "
speaker: F
text: I mean , they 're very perceptive .
speaker: F
text: And <disfmarker> and s several of them are trained in IPA .
speaker: F
text: C they really could do phonetic transcription if <disfmarker> if we wanted them to .
speaker: G
text: Mm - hmm .
speaker: G
text: Right . Well <disfmarker> <vocalsound> Well , you know , it might be something we 'd wanna do with some , uh , s small subset <pause> of the whole thing .
speaker: A
text: Hmm .
speaker: A
text: Where were they when <pause> we needed them ?
speaker: F
text: I think <disfmarker>
speaker: G
text: We certainly wouldn't wanna do it with everything .
speaker: F
text: And I 'm also thinking these people are a terrific pool .
speaker: F
text: I mean , if , uh <disfmarker> so I <disfmarker> I told them that , um , we don't know if this will continue past the end of the month
speaker: G
text: Uh - huh .
speaker: F
text: and I also <disfmarker>
speaker: F
text: m I
speaker: F
text: think they know that the data p source is limited
speaker: F
text: and I may not be able to keep them employed till the end of the month
speaker: F
text: even , although I hope to .
speaker: G
text: The other thing we could do , actually , uh , is , uh , use them for a more detailed analysis of the overlaps .
speaker: F
text: And <disfmarker>
speaker: F
text: Oh , that 'd be so super .
speaker: F
text: They would be so <disfmarker> s so terrific .
speaker: G
text: Right ?
speaker: A
text: I mean , this was something that we were talking about .
speaker: A
text: We could get a very detailed overlap if they were willing to transcribe each meeting four or five times .
speaker: A
text: Right ?
speaker: A
text: One for each participant .
speaker: A
text: So they could by hand <disfmarker>
speaker: G
text: Well , that 's one way to do it .
speaker: A
text: Yeah .
speaker: G
text: But I 've been saying the other thing is just go through it for the overlaps .
speaker: A
text: Yeah .
speaker: F
text: Mm - hmm , that 's right .
speaker: G
text: Right ?
speaker: F
text: And with the right in interface <disfmarker>
speaker: G
text: Given that y and <disfmarker> and do <disfmarker> so instead of doing phonetic , uh , uh , transcription for the whole thing ,
speaker: G
text: which <vocalsound> we know from the <disfmarker> Steve 's experience with the Switchboard transcription is , you know , very , very time - consuming .
speaker: D
text: Yeah .
speaker: G
text: And <disfmarker> <vocalsound> and you know , it took them I don't know how many months to do <disfmarker> to get four hours .
speaker: G
text: And so <vocalsound> that hasn't been really our focus .
speaker: G
text: Uh , we can consider it .
speaker: G
text: But , I mean , the other thing is since we 've been spending so much time thinking about overlaps is <disfmarker> is maybe get a much more detailed analysis of the overlaps .
speaker: D
text: Yeah .
speaker: F
text: Mm - hmm .
speaker: G
text: But anyway , I 'm <disfmarker> I 'm open to c our consideration .
speaker: F
text: That 'd be great .
speaker: G
text: I <disfmarker> I don't wanna say that by fiat .
speaker: D
text: Hmm .
speaker: G
text: I 'm open to every consideration of <vocalsound> what are some other kinds of detailed analysis that would be most useful .
speaker: F
text: Yeah .
speaker: G
text: And , uh , uh ,
speaker: F
text: Mm - hmm .
speaker: D
text: Hmm .
speaker: G
text: I <disfmarker> I <disfmarker> I think <vocalsound> this year we <disfmarker> we actually , uh , can do it .
speaker: F
text: Oh , wonderful .
speaker: G
text: It 's a <disfmarker> we have <disfmarker> we have <disfmarker> due to @ @ <comment> variations in funding we have <disfmarker> we seem to be doing , uh , very well on m money for this <disfmarker> this year ,
speaker: G
text: and <vocalsound> next year we may have <disfmarker> have much less .
speaker: G
text: So I don't wanna hire a <disfmarker>
speaker: A
text: Is <disfmarker> you mean two thousand one ?
speaker: A
text: Calendar year
speaker: A
text: or <disfmarker> ?
speaker: G
text: Uh , I mean , calendar year two thousand one .
speaker: A
text: OK .
speaker: G
text: Yeah . So it 's <disfmarker> uh , it 's <disfmarker> we don't wanna hire a bunch of people , a long - term staff ,
speaker: A
text: Full - time .
speaker: F
text: Mm - hmm . Yeah .
speaker: A
text: Yeah .
speaker: G
text: because <vocalsound> the <disfmarker> the funding that we 've gotten is sort of a big chunk for this year .
speaker: G
text: But <vocalsound> having <pause> temporary people doing some specific thing that we need is actually a perfect match to that kind of , uh , funding .
speaker: F
text: Wonderful .
speaker: F
text: And then school will start in <disfmarker> in the sixt on the sixteenth .
speaker: D
text: Yeah .
speaker: G
text: So .
speaker: F
text: Some of them will have to cut back their hours at that point .
speaker: G
text: Yeah .
speaker: E
text: Are they working full - time now ,
speaker: E
text: or <disfmarker> ?
speaker: F
text: But <disfmarker> <nonvocalsound> <vocalsound> Some of them are .
speaker: F
text: Yeah .
speaker: A
text: Wow .
speaker: F
text: Well , why do I wouldn't say forty - hour weeks .
speaker: F
text: No .
speaker: F
text: But what I mean is <disfmarker>
speaker: F
text: Oh , I shouldn't say it that way
speaker: F
text: because <nonvocalsound> that does sound like forty - hour weeks .
speaker: F
text: No .
speaker: F
text: I th I <disfmarker> I would say they 're probably <nonvocalsound> <disfmarker> they don't have o they don't have other things that are taking away their time .
speaker: A
text: I don't see how someone could do forty hours a week on transcription .
speaker: E
text: Hmm .
speaker: F
text: But <nonvocalsound> it 's <disfmarker>
speaker: F
text: you can't .
speaker: G
text: Yeah . Yeah .
speaker: F
text: No . You 're right .
speaker: F
text: It 's <disfmarker> i it would be too taxing .
speaker: F
text: But , um , they 're putting <nonvocalsound> in a lot of <disfmarker>
speaker: G
text: Yeah .
speaker: F
text: And <disfmarker> and I checked them over .
speaker: G
text: I <disfmarker>
speaker: F
text: I <disfmarker> I <disfmarker> I haven't checked them all ,
speaker: F
text: but <pause> just spot - checking .
speaker: F
text: They 're fantastic .
speaker: G
text: I remember when we were transcribing BeRP , uh , uh , <vocalsound> uh , Ron Kay , uh , volunteered to <disfmarker> to do some of that .
speaker: A
text: I think it would be <disfmarker>
speaker: G
text: And , he was <disfmarker> the first <disfmarker> first stuff he did was transcribing Chuck .
speaker: G
text: And he 's saying " You <disfmarker> you know , I always thought Chuck spoke really well . "
speaker: F
text: Yeah . Yeah .
speaker: F
text: Well , you know , and I also thought , y Liz has this , eh , you know , and I do also , this <disfmarker> this interest in the types of overlaps that are involved .
speaker: F
text: These people would be <nonvocalsound> great choices for doing coding of that type if we wanted ,
speaker: A
text: We 'd have to mark them .
speaker: F
text: or
speaker: G
text: Mm - hmm .
speaker: F
text: whatever . So , um .
speaker: D
text: Mm - hmm .
speaker: G
text: Yeah .
speaker: A
text: I think it would also be interesting to have , uh , a couple of the meetings have more than one transcriber do ,
speaker: F
text: Mm - hmm .
speaker: A
text: cuz I 'm curious about inter - annotator agreement .
speaker: D
text: Yeah .
speaker: F
text: OK .
speaker: F
text: Yeah .
speaker: F
text: Th - that 'd be <disfmarker> I think that 's a <disfmarker> a good idea .
speaker: G
text: Yeah .
speaker: F
text: You know , there 's also , the e In my mind ,
speaker: F
text: I think A An - Andreas was <pause> leading to this topic ,
speaker: F
text: the idea that , um , <vocalsound> we haven't yet seen the <disfmarker> the type of transcript that we get from IBM ,
speaker: F
text: and it may just be , you know , pristine .
speaker: F
text: But on the other hand , given the lesser interface <disfmarker>
speaker: F
text: Cuz this is , you know <disfmarker> we 've got a good interface ,
speaker: F
text: we 've got great headphones , m
speaker: F
text: um <disfmarker>
speaker: G
text: It could be that they will uh <disfmarker> theirs will end up being a kind of fir first pass or something .
speaker: F
text: Something like that .
speaker: G
text: Maybe an elaborate one ,
speaker: G
text: cuz again they probably are gonna do these alignments ,
speaker: G
text: which will also clear things up .
speaker: F
text: That 's <disfmarker> that 's true .
speaker: F
text: Al - although you have to s Don't you have to start with a close enough approximation <nonvocalsound> of the <disfmarker> of the verbal part <nonvocalsound> to be able to <disfmarker> ?
speaker: G
text: Well , tha that 's <disfmarker> that 's debatable .
speaker: G
text: Right ?
speaker: G
text: I mean , so the <disfmarker> so the argument is that if your statistical system is good <vocalsound> it will in fact , uh , clean things up .
speaker: F
text: OK .
speaker: G
text: Right ?
speaker: F
text: OK .
speaker: G
text: So it it 's got its own objective criterion .
speaker: D
text: Yeah .
speaker: G
text: And , uh , so in principle you could start up with something that was kind of rough <disfmarker>
speaker: G
text: I mean , to give an example of , um , something we used to do , uh , at one point , uh , back <disfmarker> back when Chuck was here
speaker: G
text: in early times ,
speaker: G
text: is we would take ,
speaker: G
text: um , <vocalsound> da take a word and , uh , have a canonical pronunciation
speaker: G
text: and , uh , if there was five phones in a word , <vocalsound> you 'd break up the word , <vocalsound> uh , into five equal - length pieces
speaker: G
text: which is completely gross .
speaker: A
text: Wrong .
speaker: G
text: Right ?
speaker: D
text: Yeah .
speaker: G
text: I mean , th the timing is off <pause> all over the place in just about any word .
speaker: F
text: Mm - hmm .
speaker: F
text: OK .
speaker: G
text: But it 's O K .
speaker: G
text: You start off with that and the statistical system
speaker: G
text: then aligns things ,
speaker: G
text: and eventually you get something that doesn't really look too bad .
speaker: F
text: Oh , excellent .
speaker: F
text: OK .
speaker: G
text: So <disfmarker> so I think using a <disfmarker> a good <pause> aligner , um , actually can <disfmarker> can help a lot .
speaker: G
text: Um . <vocalsound> But , uh ,
speaker: G
text: you know , they both help each other .
speaker: G
text: If you have a <disfmarker> if you have a better starting point , then it helps the aligner .
speaker: G
text: If you have a good alignment , it helps the , uh , th the human in <disfmarker> in taking less time to correct things .
speaker: G
text: So <disfmarker> so <disfmarker>
speaker: F
text: OK .
speaker: F
text: Excellent .
speaker: F
text: I guess there 's another aspect , too ,
speaker: F
text: and I don't know <disfmarker>
speaker: F
text: uh , this <disfmarker> this is <disfmarker> very possibly a different , uh , topic .
speaker: F
text: But , <nonvocalsound> uh , just let me say <pause> with reference to this idea of , um , <vocalsound> higher - order organization within meetings .
speaker: F
text: So like in a <disfmarker>
speaker: F
text: you know , the topics that are covered during a meeting with reference to the other , uh , uses of the data ,
speaker: G
text: Mm - hmm .
speaker: F
text: so being able to <pause> find where so - and - so talked about such - and - such ,
speaker: F
text: then , um , um <disfmarker>
speaker: F
text: e I mean , I <disfmarker> I <disfmarker> I did sort of a <disfmarker> <vocalsound> a rough <pause> pass <nonvocalsound> on encoding , like , episode - like level things on the , uh , transcribed meeting <disfmarker>
speaker: G
text: Mm - hmm .
speaker: F
text: already transcribed meeting .
speaker: G
text: Mm - hmm .
speaker: F
text: And I don't know if , um <disfmarker>
speaker: F
text: where <nonvocalsound> that <disfmarker> i if that 's something that we wanna do with each meeting ,
speaker: F
text: sort of like a , um <disfmarker>
speaker: F
text: it 's like a manifest , when you get a box full of stuff ,
speaker: G
text: Mm - hmm .
speaker: F
text: or <disfmarker> or if that 's , um <disfmarker>
speaker: F
text: I mean , i I <disfmarker> I don't know what uh , level of detail would be most useful .
speaker: F
text: I don't know i if that 's something that <pause> I should do when I look over it , or if we want someone else to do , or whatever .
speaker: G
text: Mm - hmm .
speaker: F
text: But this issue of the contents of the meeting
speaker: F
text: in an outline form .
speaker: F
text: OK .
speaker: G
text: Yeah .
speaker: G
text: Meaning really isn't my thing .
speaker: G
text: Um <disfmarker>
speaker: A
text: I think it just <disfmarker> whoever is interested can do that .
speaker: A
text: I mean , so if someone wants to use that data <disfmarker>
speaker: F
text: OK .
speaker: G
text: We 're running a little short here .
speaker: G
text: We , uh , uh , cou trying to <disfmarker>
speaker: F
text: That 's fine .
speaker: F
text: I 'm finished .
speaker: G
text: eh , was <disfmarker> p Well , you know , the thing I 'm concerned about is we wanted to do these digits
speaker: G
text: and <disfmarker> and I haven't heard , uh , from Jose yet .
speaker: F
text: Oh , yeah .
speaker: F
text: Oh , yes .
speaker: G
text: So <disfmarker>
speaker: F
text: Mm - hmm .
speaker: D
text: OK . What do you want ?
speaker: G
text: Uh <disfmarker>
speaker: A
text: We could skip the digits .
speaker: A
text: We don't have to read digits each time .
speaker: G
text: Uh <disfmarker>
speaker: G
text: I <disfmarker> I <disfmarker> I think it <disfmarker> you know , another <disfmarker> another bunch of digits .
speaker: G
text: More data is good .
speaker: A
text: OK .
speaker: G
text: So <disfmarker> so I 'd like to do that .
speaker: D
text: Yeah . Sure .
speaker: G
text: But I think , do you , maybe ,
speaker: G
text: eh <disfmarker> ?
speaker: G
text: Did you prepare some whole thing you wanted us just to see ?
speaker: G
text: Or what was that ?
speaker: D
text: Yeah . It 's <disfmarker> it 's prepared .
speaker: G
text: Yeah .
speaker: G
text: Uh , how long a <disfmarker> ?
speaker: F
text: Oh , k Sorry .
speaker: D
text: I <disfmarker> I think it 's <disfmarker> it 's fast ,
speaker: D
text: because , uh , I have the results , eh , of the study of different energy without the law length .
speaker: D
text: Eh , um , eh ,
speaker: D
text: in the <disfmarker> in the measurement , uh , the average , uh , dividing by the <disfmarker> by the , um , variance .
speaker: G
text: Yeah .
speaker: D
text: Um , I <disfmarker> th i
speaker: D
text: the other , uh <disfmarker> the <disfmarker> the last w uh , meeting <disfmarker>
speaker: D
text: eh , I don't know if you remain
speaker: D
text: we have problem to <disfmarker> with the <disfmarker> <vocalsound> with <disfmarker> with the parameter <disfmarker>
speaker: D
text: with the representations of parameter ,
speaker: G
text: Yes .
speaker: D
text: because the <disfmarker> the valleys and the peaks in the signal , eh , look like , eh , it doesn't follow to the <disfmarker> to the energy in the signal .
speaker: G
text: Right .
speaker: D
text: And it was a problem , uh , with the scale .
speaker: D
text: Eh , the scale .
speaker: A
text: With what ?
speaker: F
text: Scale .
speaker: A
text: Scale .
speaker: D
text: Eh , and I <disfmarker> I change the scale and we can see the <disfmarker> the variance .
speaker: G
text: OK .
speaker: G
text: But the bottom line is it 's still not , uh , separating out very well .
speaker: D
text: Yeah .
speaker: G
text: Right ?
speaker: D
text: Yeah .
speaker: G
text: OK .
speaker: D
text: The distribution <disfmarker> the distribution is <disfmarker> is similar .
speaker: G
text: So that 's <disfmarker>
speaker: G
text: that 's <disfmarker> that 's enough then .
speaker: G
text: OK .
speaker: D
text: Yeah .
speaker: G
text: No , I mean , that there 's no point in going through all of that if that 's the bottom line , really .
speaker: D
text: Yeah .
speaker: F
text: Mm - hmm .
speaker: G
text: So , I <disfmarker> I think we have to start <disfmarker>
speaker: D
text: Yeah .
speaker: G
text: Uh , I mean , there there 's two suggestions , really ,
speaker: G
text: which is , uh <disfmarker> what we said before is that ,
speaker: D
text: Mmm ,
speaker: D
text: yeah .
speaker: G
text: um ,
speaker: G
text: it looks like ,
speaker: G
text: at least that you haven't found an obvious way to normalize
speaker: G
text: so that the energy is anything like a reliable , uh , indicator of the overlap .
speaker: D
text: Yeah .
speaker: G
text: Um , I <disfmarker> I 'm <disfmarker> I 'm still <pause> a little f think that 's a little funny . These things l @ @ seems like there should be ,
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: but <disfmarker> <vocalsound> but you don't want to keep , uh <disfmarker> keep knocking at it if it 's <disfmarker> if you 're not getting any <disfmarker> any result with that .
speaker: G
text: But , I mean , the other things that we talked about is , uh , <vocalsound> pitch - related things and harmonicity - related things ,
speaker: D
text: Yeah .
speaker: G
text: so <disfmarker> which we thought also should be some kind of a reasonable indicator .
speaker: G
text: Um <disfmarker>
speaker: G
text: But , uh ,
speaker: G
text: a completely different tack on it wou is the one that was suggested , uh , by your colleagues in Spain ,
speaker: D
text: Yeah .
speaker: G
text: which is to say , don't worry so much about the , uh , features .
speaker: D
text: Yeah .
speaker: G
text: That is to say , use , you know , as <disfmarker> as you 're doing with the speech , uh , nonspeech , use some very general features .
speaker: C
text: Yeah .
speaker: G
text: And , uh , then , uh , look at it more from the aspect of modeling .
speaker: D
text: Yeah .
speaker: G
text: You know , have a <disfmarker> have a couple Markov models
speaker: D
text: Yeah .
speaker: G
text: and <disfmarker>
speaker: G
text: and , uh , try to indi try to determine , you know , w when is th when are you in an overlap , when are you not in an overlap .
speaker: D
text: Hmm .
speaker: G
text: And let the , uh , uh , statistical system <pause> determine what 's the right way to look at the data .
speaker: G
text: I <disfmarker> I , um ,
speaker: D
text: Yeah .
speaker: G
text: I think it would be interesting to find individual features and put them together .
speaker: G
text: I think that you 'd end up with a better system overall .
speaker: G
text: But given the limitation in time <vocalsound> and given the fact that Javier 's system already exists <pause> doing this sort of thing ,
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: uh , but , uh ,
speaker: G
text: its main limitation is that , again , it 's only looking at silences which would <disfmarker>
speaker: D
text: Yeah .
speaker: G
text: maybe that 's a better place to go .
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: So .
speaker: F
text: Mm - hmm .
speaker: D
text: I <disfmarker> I <disfmarker> I think that , eh , the possibility , eh , can be that , eh ,
speaker: D
text: Thilo , eh , working , eh , with a new class ,
speaker: G
text: Mm - hmm .
speaker: D
text: not only , eh , nonspeech and speech , but , eh , in <disfmarker> in <disfmarker> in the speech class ,
speaker: G
text: Mm - hmm .
speaker: D
text: dividing , eh , speech , eh , of <disfmarker> from a speaker and overlapping ,
speaker: D
text: to try <disfmarker> to <disfmarker> to do , eh , eh , a fast <disfmarker> a fast , eh , <vocalsound> experiment to <disfmarker> to prove that , nnn , this fea eh , general feature , <vocalsound> eh , can solve the <disfmarker> the <disfmarker> the problem ,
speaker: G
text: Yeah .
speaker: D
text: and wh what <disfmarker>
speaker: D
text: nnn , how far is <disfmarker>
speaker: G
text: Maybe .
speaker: G
text: Yeah .
speaker: D
text: And , I <disfmarker> I have prepared the <disfmarker> the pitch tracker now .
speaker: A
text: Mm - hmm .
speaker: D
text: And I hope the <disfmarker> the next week I will have , eh , some results and we <disfmarker> we will show <disfmarker> we will see , eh , the <disfmarker> the parameter <disfmarker> the pitch , <vocalsound> eh , tracking in <disfmarker> with the program .
speaker: G
text: I see .
speaker: G
text: Ha - h have you ever looked at the , uh , uh <disfmarker> Javier 's , uh , speech segmenter ?
speaker: D
text: And , nnn , nnn <disfmarker>
speaker: C
text: No .
speaker: G
text: Oh . Maybe m you could , you kn uh show Thilo that .
speaker: D
text: No .
speaker: C
text: No .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: C
text: Sure .
speaker: G
text: Cuz again the idea is there <disfmarker> the limitation there again was that he was <disfmarker> he was only using it to look at silence as a <disfmarker> as a <disfmarker> as a <disfmarker> as a p putative split point between speakers .
speaker: D
text: Yeah .
speaker: G
text: But if you included , uh , broadened classes then <pause> in principle maybe you can <pause> cover the overlap cases .
speaker: C
text: OK .
speaker: D
text: Yeah .
speaker: D
text: Mmm , yeah .
speaker: C
text: Yeah , but I 'm not too sure if <disfmarker> if we can <pause> really represent <vocalsound> overlap with <disfmarker> with the s <pause> detector I <disfmarker> I <disfmarker> I used up to now ,
speaker: G
text: Uh <disfmarker>
speaker: F
text: Mm - hmm .
speaker: C
text: the <disfmarker> to speech - nonspeech as <disfmarker>
speaker: A
text: I think with <disfmarker>
speaker: D
text: Ah .
speaker: C
text: it 's only speech or it 's <disfmarker> it 's <disfmarker> it 's nonspeech .
speaker: A
text: That 's right . But I think Javier 's <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: Mm - hmm .
speaker: G
text: N n
speaker: A
text: I think Javier 's might be able to .
speaker: C
text: So .
speaker: A
text: It doesn't have the same Gaus - uh , H M M modeling ,
speaker: C
text: Yeah .
speaker: A
text: which is I think a drawback .
speaker: C
text: OK .
speaker: A
text: But , uh <disfmarker>
speaker: G
text: Well , it 's <disfmarker> sort of has a simple one .
speaker: D
text: Mmm ,
speaker: D
text: yeah .
speaker: G
text: Right ?
speaker: G
text: It 's <disfmarker>
speaker: A
text: Does it ?
speaker: G
text: it 's just <disfmarker> it 's just a <disfmarker> isn't it just a Gaussian
speaker: G
text: for each <disfmarker> ?
speaker: D
text: Yeah .
speaker: A
text: Yeah .
speaker: D
text: Hmm .
speaker: F
text: Mm - hmm .
speaker: G
text: Yeah .
speaker: A
text: And then <pause> he ch you choose optimal splitting .
speaker: G
text: Oh , it doesn't have <disfmarker> it doesn't have any temporal , uh <disfmarker> ?
speaker: G
text: I thought it <disfmarker>
speaker: A
text: Maybe I 'm misremembering , but I did not think it had a Markov <disfmarker>
speaker: G
text: Yeah .
speaker: G
text: I gues I guess I don't remember either .
speaker: G
text: Uh . It 's been a while .
speaker: D
text: Javier <disfmarker>
speaker: C
text: Yeah . Uh , I could have a look at it .
speaker: G
text: Uh .
speaker: D
text: You mean Ja - eh , eh , Javier program ?
speaker: C
text: So .
speaker: A
text: Mm - hmm .
speaker: D
text: No , Javier di doesn't worked with , uh , a Markov <disfmarker>
speaker: A
text: Yeah , I didn't think so .
speaker: D
text: He on only train <disfmarker>
speaker: G
text: Oh , OK . So he 's just <disfmarker> he just computes a Gaussian over potential <disfmarker>
speaker: A
text: Yep .
speaker: D
text: Yeah . It was only Gaussian .
speaker: G
text: Oh , I see . I see .
speaker: G
text: And <disfmarker> and <disfmarker>
speaker: D
text: This is the idea .
speaker: A
text: And so I <disfmarker> I think it would work fine for detecting overlap .
speaker: A
text: It 's just , uh , that i it <disfmarker>
speaker: A
text: he has the two - pass issue that <disfmarker>
speaker: A
text: What he does is , as a first pass he <disfmarker> he <disfmarker> p he does , um , a guess at where the divisions might be and he overestimates .
speaker: A
text: And that 's just a data reduction step ,
speaker: A
text: so that you 're not trying at every time interval .
speaker: C
text: OK .
speaker: A
text: And so those are the putative <pause> places where he tries .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: C
text: OK .
speaker: A
text: And right now he 's doing that with silence
speaker: A
text: and that doesn't work
speaker: A
text: with the Meeting Recorder .
speaker: C
text: Yeah .
speaker: A
text: So if we used another method to get the first pass , I think it would probably work .
speaker: C
text: Yeah . Sure .
speaker: C
text: Yeah .
speaker: C
text: Yeah , OK .
speaker: A
text: It 's a good method .
speaker: A
text: As long as the len as long the segments are long enough .
speaker: D
text: Yeah .
speaker: A
text: That 's the other problem .
speaker: G
text: O - k OK . So let me go back to what you had , though .
speaker: C
text: So <disfmarker>
speaker: C
text: Yeah .
speaker: G
text: Um .
speaker: G
text: The other thing one could do is <disfmarker> Couldn't <disfmarker>
speaker: D
text: Mm - hmm .
speaker: G
text: I mean , it 's <disfmarker> So you have two categories
speaker: G
text: and you have Markov models for each .
speaker: C
text: Yeah .
speaker: G
text: Couldn't you have a third category ?
speaker: G
text: So you have , uh <disfmarker> you have , <vocalsound> uh , nonspeech , single - person speech , and multiple - person speech ?
speaker: F
text: He has this on his board actually .
speaker: F
text: Don't you have , like those <disfmarker> those several different <vocalsound> categories on the board ?
speaker: G
text: Right ?
speaker: G
text: And then you have a Markov model for each ?
speaker: C
text: Um <disfmarker>
speaker: C
text: I 'm not sure .
speaker: C
text: I <disfmarker> I thought about , uh , adding , uh , uh , another class too .
speaker: C
text: But it 's not too easy , I think , the <disfmarker> the transition between the different class , to model them in <disfmarker> in the system I have now .
speaker: C
text: But it <disfmarker> it <disfmarker> it could be possible , I think ,
speaker: G
text: I see .
speaker: G
text: I see .
speaker: C
text: in principle .
speaker: G
text: Yeah , I mean , I <disfmarker>
speaker: G
text: This is all pretty gross .
speaker: G
text: I mean , the <disfmarker> th the reason why , uh , I was suggesting originally that we look at features is because I thought , well , we 're doing something we haven't done before ,
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: G
text: we should at least look at the space and understand <disfmarker>
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: G
text: It seems like if two people <disfmarker> two or more people talk at once , it should get louder ,
speaker: C
text: Yeah .
speaker: G
text: uh , and , uh , uh , there should be some discontinuity in pitch contours ,
speaker: C
text: I had the impression .
speaker: D
text: Yeah .
speaker: G
text: and , uh , there should overall be a , um , smaller proportion of the total energy that is explained by any particular harmonic <pause> sequence in the spectrum .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: A
text: Right .
speaker: G
text: So those are all things that should be there .
speaker: G
text: So far , um , uh , Jose has <disfmarker> has been <disfmarker>
speaker: D
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: G
text: By the way , I was told I should be calling you Pepe ,
speaker: G
text: but <disfmarker>
speaker: G
text: by your friends ,
speaker: D
text: Yeah .
speaker: G
text: but
speaker: G
text: Anyway ,
speaker: G
text: um ,
speaker: D
text: Yeah .
speaker: G
text: uh , the <disfmarker> has <disfmarker> has , uh , been exploring , uh , e largely the energy issue
speaker: G
text: and ,
speaker: G
text: um ,
speaker: G
text: as with a lot of things , it is not <disfmarker> uh , like this , it 's not as simple as it sounds .
speaker: G
text: And then there 's , you know <disfmarker> Is it energy ? Is it log energy ? Is it LPC residual energy ? Is it <disfmarker> is it <disfmarker> <vocalsound> is it , uh , delta of those things ?
speaker: C
text: Yeah .
speaker: G
text: Uh , what is it no
speaker: G
text: Obviously , just a simple number <disfmarker> <vocalsound> absolute number isn't gonna work .
speaker: G
text: So <vocalsound> it should be with <disfmarker> compared to what ?
speaker: G
text: Should there be a long window for the <vocalsound> normalizing factor and a short window for what you 're looking at ?
speaker: C
text: Yeah .
speaker: G
text: Or , you know , how b short should they be ?
speaker: G
text: So ,
speaker: G
text: th he 's been playing around with a lot of these different things
speaker: D
text: Hmm .
speaker: G
text: and <disfmarker> and so far at least has not come up with <vocalsound> any combination that really gave you an indicator .
speaker: D
text: Yeah .
speaker: G
text: So
speaker: G
text: I <disfmarker> I still have a hunch that there 's <disfmarker> it 's in there some place ,
speaker: G
text: but it may be <disfmarker> given that you have a limited time here , it <disfmarker> it just may not be the best thing to <disfmarker> <vocalsound> to <disfmarker> to focus on for the remaining of it .
speaker: D
text: Yeah .
speaker: D
text: To overrule , yeah .
speaker: G
text: So pitch - related and harmonic - related , I 'm <disfmarker> I 'm <pause> somewhat more hopeful for it .
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: But it seems like if we just wanna get something to work ,
speaker: C
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: that , uh , their suggestion of <disfmarker> of <disfmarker>
speaker: G
text: Th - they were suggesting going to Markov models ,
speaker: G
text: uh , but in addition there 's an expansion of what Javier did .
speaker: G
text: And one of those things , looking at the statistical component ,
speaker: D
text: One .
speaker: C
text: Yeah .
speaker: G
text: even if the features that you give it are maybe not ideal for it , it 's just sort of this general filter bank
speaker: G
text: or <disfmarker> <vocalsound> or cepstrum or something , um <disfmarker>
speaker: C
text: Yeah .
speaker: G
text: Eee <vocalsound> it 's in there somewhere probably .
speaker: D
text: But , eh , what did you think about the possibility of using the Javier software ?
speaker: D
text: Eh , I mean , the , uh <disfmarker> the , uh <disfmarker> the BIC criterion ,
speaker: D
text: the <disfmarker> the <disfmarker> t to train the <disfmarker> the Gaussian ,
speaker: D
text: eh , using the <disfmarker> the mark , eh , by hand , eh , eh , to distinguish be mmm , to train overlapping zone and speech zone . I mean ,
speaker: D
text: eh , <vocalsound> I <disfmarker> I <disfmarker> I think that an interesting , eh , experiment , eh , could be , th eh , to prove that , mmm , if s
speaker: D
text: we suppose that , eh , the <disfmarker> the first step <disfmarker> <vocalsound> I mean , the <disfmarker> the classifier
speaker: D
text: what
speaker: D
text: were the classifier from Javier or classifier from Thilo ?
speaker: D
text: W What happen with the second step ?
speaker: D
text: I <disfmarker> I mean , what <disfmarker> what happen with the , eh <disfmarker> the , uh , clu the , uh <disfmarker> the clu the clustering process ?
speaker: A
text: Mm - hmm .
speaker: D
text: Using the <disfmarker> the Gaussian .
speaker: A
text: You mean Javier 's ?
speaker: D
text: Yeah .
speaker: A
text: What do you mean ?
speaker: D
text: I <disfmarker> I mean , that is <disfmarker> is enough <disfmarker> is enough , eh , to work well , eh , to , eh , separate or to distinguish , eh , between overlapping zone and , eh , speaker zone ?
speaker: D
text: Because th <vocalsound> if <disfmarker> if we <disfmarker> if we , eh , nnn , develop an classifier <disfmarker> and the second step doesn't work <pause> well , eh , we have <pause> another problem .
speaker: A
text: I <disfmarker>
speaker: A
text: Yeah . I had tried doing it by hand at one point with a very short sample ,
speaker: D
text: N
speaker: A
text: and it worked pretty well ,
speaker: A
text: but I haven't worked with it a lot .
speaker: A
text: So what I d I d I took a hand - segmented sample
speaker: D
text: Nnn , yeah .
speaker: A
text: and I added ten times the amount of numbers at random ,
speaker: D
text: Yeah .
speaker: D
text: Oh .
speaker: A
text: and it did pick out pretty good boundaries .
speaker: D
text: Yeah . But is <disfmarker> is <disfmarker> if <disfmarker>
speaker: A
text: But this was just very anecdotal sort of thing .
speaker: D
text: But it 's possible with my segmentation by hand <pause> that we have information about the <disfmarker> the overlapping ,
speaker: A
text: Right . So if we <disfmarker> if we fed the hand - segmentation to Javier 's and it doesn't work , then we know something 's wrong .
speaker: D
text: uh <disfmarker> Yeah .
speaker: D
text: The <disfmarker>
speaker: D
text: N n Yeah .
speaker: D
text: No .
speaker: D
text: The demonstration by hand . Segmentation by hand I <disfmarker> I <disfmarker> I think is the fast experiment .
speaker: A
text: Yeah . I think that 's probably worthwhile doing .
speaker: G
text: Uh - huh .
speaker: D
text: Uh , we can prove that the <disfmarker>
speaker: A
text: Whether it 'll work or not .
speaker: D
text: this kind o emph emphasises parameter and Gaussian <disfmarker>
speaker: A
text: Yeah .
speaker: G
text: Yeah .
speaker: A
text: Yep .
speaker: A
text: Y do you know where his software is ?
speaker: A
text: Have you used it at all ?
speaker: D
text: I yeah have . I have .
speaker: A
text: OK .
speaker: A
text: So .
speaker: A
text: I <disfmarker> I have as well ,
speaker: A
text: so if you need <disfmarker> need help let me know .
speaker: D
text: OK .
speaker: G
text: Let 's read some digits .
speaker: A
text: OK .
speaker: F
text: Mm - hmm .
speaker: A
text: uuh
speaker: A
text: And we are <disfmarker>

Meeting summary:
text: The Berkeley Meeting Recorder group talked about the ongoing transcription effort and issues related to the Transcriber tool, which despite its limitations for capturing tight time markings for overlapping speech, will continue to remain in use.
text: Speaker mn014 explained his efforts to pre-segment the signal into speech and non-speech portions for facilitating transcriptions.
text: Recording equipment and procedures were discussed, with a focus on audible breathing and the need for standards in microphone wear and use.
text: And, finally, it was determined that speaker mn005's efforts to detect speaker overlap using energy should instead be focussed on pitch- and harmonicity-related features or be guided by a non-featural, statistical approach, i.e. via the use of Markov models.
text: In the interest of time, it was decided that the group should continue using the existing Transcriber tool and perform a forced alignment on the close-talking microphones that will, it is hoped, help to recover some of the time information indicating where different speaker overlaps occurred in the signal.
text: A meeting will be arranged with NIST to decide on a common standard and format for doing transcriptions.
text: One or two meetings will be assigned to multiple transcribers to check for inter-annotator agreement.
text: To cut down on audible breaths during recordings, the group will institute some level of standards for microphone wear and use.
text: Speaker mn005 will feed his hand-segmented data into the speech segmenter developed by Javier to train it to identify different types of speech (i.e. that of single versus multiple speakers), as well as focussing on pitch- and harmonicity-related features for identifying overlapping speech.
text: There is no channel identifier to help in encoding speaker overlaps.
text: Speech uttered while laughing is problematic for ASR.
text: So far, speaker mn005's attempts to detect speaker overlap have been unsuccessful, as it has not been possible to normalize energy as a reliable indicator of overlap.
text: Speaker mn014's efforts to detect speech/non-speech portions in the mixed signal (using an HMM-based detector with Gaussian mixtures) have produced pre-segmentations that facilitate the transcription effort.
text: Speaker mn014 also trained the system to identify speech from loud versus quiet speakers.
text: Such pre-segmentation modifications allow the experimenter to specify the minimum length of speech and silence portions desired, and also facilitate the identification of pauses and utterance boundaries.
text: The transcriber pool is making quick progress, and may be used in the future to perform other types of coding, e.g. a more detailed analysis of speaker overlap.
text: Transcribers are coding non-speech gestures, such as audible breaths and laughter, both of which are useful for improving recognition results.
text: Recent modifications to the Transcriber tool allow transcribers to listen to speech from different channels, as well as helping to preserve portions of overlapping speech, and enabling the creation of different output files for each channel for a cleaner and more segmentable transcript.
text: The Praat software package was discussed as an alternative transcription tool capable of representing multiple channels of speech.
text: Cross-correlation was discussed as a means of enabling speaker identification, and may be integrated into future work.