Meeting transcript:
speaker: A
text: OK ,
speaker: A
text: we 're recording .
speaker: F
text: We can say the word " zero " all we want ,
speaker: G
text: I 'm doing some
speaker: F
text: but just <disfmarker>
speaker: G
text: square brackets ,
speaker: G
text: coffee sipping ,
speaker: G
text: square brackets .
speaker: B
text: That 's not allowed , I think .
speaker: C
text: Cur - curly brackets .
speaker: E
text: Is that voiced or unvoiced ?
speaker: B
text: Curly brackets .
speaker: F
text: Curly brackets .
speaker: A
text: Curly brackets .
speaker: A
text: Right .
speaker: F
text: Well ,
speaker: B
text: Oops .
speaker: F
text: correction for transcribers .
speaker: G
text: Mmm ! <comment> <vocalsound> Gar - darn !
speaker: F
text: Yeah .
speaker: C
text: Channel two .
speaker: A
text: Do we use square brackets for anything ?
speaker: C
text: Yeah .
speaker: E
text: These poor transcribers .
speaker: C
text: Uh <disfmarker>
speaker: F
text: u
speaker: C
text: Not ri not right now .
speaker: C
text: I mean <disfmarker> No .
speaker: D
text: There 's gonna be some zeros from this morning 's meeting because I noticed that
speaker: F
text: u
speaker: D
text: Barry , I think maybe you turned your mike off before the digits were <disfmarker>
speaker: D
text: Oh ,
speaker: D
text: was it during digits ?
speaker: D
text: Oh , so it doesn't matter .
speaker: F
text: Yeah .
speaker: B
text: So it 's not <disfmarker> it 's not that bad if it 's at the end ,
speaker: A
text: It 's still not a good idea .
speaker: B
text: but it 's <disfmarker> in the beginning , it 's <pause> bad .
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: A
text: Yeah ,
speaker: A
text: you wanna <disfmarker> you wanna keep them on so you get <pause> good noise <disfmarker>
speaker: A
text: noise floors ,
speaker: C
text: That 's interesting .
speaker: A
text: through the whole meeting .
speaker: F
text: Uh ,
speaker: F
text: I probably just should have left it on .
speaker: C
text: Hmm .
speaker: F
text: Yeah I did have to run ,
speaker: F
text: but <disfmarker>
speaker: E
text: Is there any way to change that in the software ?
speaker: A
text: Change what in the software ?
speaker: E
text: Where like you just don't <disfmarker> like if you <disfmarker> if it starts catching zeros , like in the driver or something <disfmarker>
speaker: E
text: in the card , or somewhere in the hardware <disfmarker>
speaker: E
text: Where if you start seeing zeros on w across one channel , you just add some <vocalsound> random , @ @ <comment> noise floor <disfmarker>
speaker: E
text: like a small noise floor .
speaker: A
text: I mean certainly we could do that ,
speaker: A
text: but I don't think that 's a good idea .
speaker: A
text: We can do that in post - processing if <disfmarker> if the application needs it .
speaker: E
text: Yeah .
speaker: F
text: Well , I <disfmarker> u I actually don't know what the default <comment> is anymore as to how we 're using the <disfmarker> the front - end stuff but <disfmarker> for <disfmarker> for <disfmarker> when we use the ICSI front - end ,
speaker: B
text: Manual post - processing .
speaker: F
text: but um ,
speaker: A
text: As an argument .
speaker: F
text: there is an <disfmarker> there is an o an option in <disfmarker> in RASTA ,
speaker: F
text: which ,
speaker: F
text: um , <vocalsound> in when I first put it in , uh , back in the days when I actually wrote things , uh , <vocalsound> I <pause> did actually put in a random bit or so that was in it ,
speaker: E
text: OK .
speaker: F
text: but <vocalsound> then I realized that putting in a random bit was equivalent to adding uh <disfmarker> adding flat spectrum ,
speaker: E
text: Right .
speaker: F
text: and it was a lot faster to just add a constant to the <disfmarker> <vocalsound> to the spectrum . So then I just started doing that
speaker: E
text: Mmm .
speaker: F
text: instead of calling " rand " <comment> or something ,
speaker: E
text: OK .
speaker: E
text: Right .
speaker: F
text: so .
speaker: F
text: So it d it does that .
speaker: F
text: Gee ! Here we all are !
speaker: A
text: Uh ,
speaker: A
text: so the only agenda items were Jane <disfmarker> was Jane wanted to talk about some of the IBM transcription process .
speaker: F
text: There 's an agenda ?
speaker: A
text: I sort of <vocalsound> condensed the three things you said into that .
speaker: A
text: And then just <disfmarker> I only have like , this afternoon and maybe tomorrow morning to get anything done before I go to Japan for ten days .
speaker: A
text: So if there 's anything that n absolutely , desperately needs to be done , you should let me know now .
speaker: F
text: Uh , and you just sent off a Eurospeech paper ,
speaker: F
text: so .
speaker: G
text: Right .
speaker: G
text: I hope they accept it .
speaker: G
text: I mean , I <disfmarker>
speaker: F
text: Right .
speaker: G
text: both actu as <disfmarker> as a submission and <disfmarker> <vocalsound> you know , as a paper .
speaker: G
text: Um <disfmarker>
speaker: G
text: but <disfmarker>
speaker: A
text: Well yeah , you sent it in <pause> late .
speaker: F
text: Yeah , I guess you <disfmarker> first you have to do the first one ,
speaker: A
text: Yeah .
speaker: F
text: and then <disfmarker>
speaker: F
text: Yeah .
speaker: G
text: We actually exceeded the delayed deadline by o another day ,
speaker: G
text: so .
speaker: B
text: Oops .
speaker: F
text: Oh they <disfmarker> they had some extension that they announced or something ?
speaker: G
text: Well yeah .
speaker: G
text: Liz had sent them a note saying " could we please <pause> have another " <comment> <pause> I don't know , " three days " or something ,
speaker: G
text: and they said yes .
speaker: D
text: And then she said " Did I say three ?
speaker: D
text: I meant four . "
speaker: A
text: Oh ,
speaker: A
text: that was the other thing
speaker: A
text: uh ,
speaker: G
text: But u
speaker: A
text: uh , Dave Gelbart sent me email , I think he sent it to you too , <comment> that um , there 's a special topic , section in si in Eurospeech on new , corp corpors corpora .
speaker: A
text: And it 's not due until like May fifteenth .
speaker: F
text: Oh this isn't the Aurora one ?
speaker: F
text: It 's another one ?
speaker: A
text: No .
speaker: B
text: No
speaker: A
text: It 's a different one .
speaker: B
text: it 's <disfmarker>
speaker: E
text: Huh !
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: A
text: And uh ,
speaker: F
text: Oh !
speaker: B
text: I got this mail from <disfmarker>
speaker: A
text: I s forwarded it to Jane as I thought being the most relevant person .
speaker: A
text: Um <disfmarker>
speaker: A
text: So , I thought it was highly relevant <disfmarker>
speaker: F
text: That 's <disfmarker>
speaker: C
text: Yeah I 'm <disfmarker>
speaker: C
text: Yeah .
speaker: C
text: I think so too .
speaker: A
text: have you <disfmarker> did you look at the URL ?
speaker: C
text: Um , I haven't gotten over to there yet ,
speaker: C
text: but what <disfmarker> our discussion yesterday , I really <disfmarker> I <disfmarker> I wanna submit one .
speaker: A
text: Mm - hmm .
speaker: B
text: Was this <pause> SmartKom message ?
speaker: C
text: Yeah .
speaker: B
text: I think <pause> Christoph Draxler sent this ,
speaker: C
text: And , you offered to <disfmarker> to join me , if you want me to .
speaker: B
text: yeah .
speaker: A
text: I 'll help ,
speaker: A
text: but obviously I can't , really do , most of it ,
speaker: C
text: Yeah .
speaker: G
text: I think several people <disfmarker> sent this ,
speaker: C
text: Yeah , that 's right .
speaker: B
text: Yeah .
speaker: A
text: so .
speaker: G
text: yeah .
speaker: C
text: Uh - huh .
speaker: A
text: But any <disfmarker> any help you need I can certainly provide .
speaker: F
text: Well ,
speaker: G
text: Yeah .
speaker: F
text: that 's <disfmarker> that 's a great idea .
speaker: G
text: Well <disfmarker>
speaker: G
text: there <disfmarker> there were some interesting results in this paper , though .
speaker: G
text: For instance that Morgan <disfmarker> uh , accounted for fifty - six percent of the Robustness meetings in terms of number of words .
speaker: A
text: Wow .
speaker: C
text: In <disfmarker> in terms of what ?
speaker: G
text: Number of words .
speaker: C
text: In term
speaker: C
text: One ?
speaker: C
text: Wow !
speaker: C
text: OK .
speaker: A
text: That 's just cuz he talks really fast .
speaker: C
text: Do you mean ,
speaker: F
text: n No .
speaker: B
text: Oh .
speaker: B
text: Short words .
speaker: C
text: because <disfmarker>
speaker: A
text: I know
speaker: C
text: is it partly , eh , c correctly identified words ?
speaker: C
text: Or is it <disfmarker>
speaker: G
text: No . Well , according to the transcripts .
speaker: C
text: or just overall volume ?
speaker: F
text: Yeah .
speaker: A
text: But re well regardless . I think it 's <disfmarker> he 's <disfmarker> he 's in all of them ,
speaker: C
text: Oh . OK .
speaker: G
text: I mean , we didn't mention Morgan by name
speaker: A
text: and he talks a lot .
speaker: G
text: we just <disfmarker>
speaker: F
text: Well <disfmarker> we have now ,
speaker: A
text: One participant .
speaker: G
text: We <disfmarker> we <disfmarker> we <disfmarker> something about <disfmarker>
speaker: F
text: but <disfmarker>
speaker: A
text: Did you identify him as a senior <pause> member ?
speaker: G
text: No ,
speaker: G
text: we as identify him as the person dominating the conversation .
speaker: F
text: Well .
speaker: A
text: Yeah .
speaker: C
text: OK .
speaker: F
text: I mean I get these AARP things ,
speaker: F
text: but I 'm not se really senior yet ,
speaker: G
text: Right
speaker: F
text: but <disfmarker>
speaker: G
text: Hmm .
speaker: F
text: Um ,
speaker: F
text: but uh , other than that delightful result , what was the rest of the paper about ?
speaker: G
text: Um ,
speaker: G
text: well it was about <disfmarker> it had three sections
speaker: F
text: You sent it to me
speaker: F
text: but I haven't seen it yet .
speaker: G
text: uh <disfmarker>
speaker: G
text: three kinds of uh results , if you will .
speaker: G
text: Uh , the one was that the <disfmarker> just the <disfmarker> the amount of overlap
speaker: A
text: The good , the bad , and the ugly .
speaker: G
text: um ,
speaker: G
text: s in terms of <disfmarker> in terms of number of words
speaker: G
text: and also we computed something called a " spurt " ,
speaker: G
text: which is essentially a stretch of speech with uh , no pauses exceeding five hundred milliseconds .
speaker: G
text: Um , and we computed how many overlapped i uh spurts there were and how many overlapped words there were . <vocalsound> Um , for four different <pause> corpora ,
speaker: G
text: the Meeting Recorder meetings ,
speaker: G
text: the Robustness meetings
speaker: G
text: Switchboard
speaker: G
text: and CallHome ,
speaker: G
text: and , found <disfmarker> and sort of compared the numbers .
speaker: G
text: Um ,
speaker: G
text: and found that the ,
speaker: G
text: uh ,
speaker: G
text: you know , as you might expect the Meeting Recorder <pause> meetings had the most overlap
speaker: G
text: uh , but next were Switchboard and CallHome ,
speaker: G
text: which both had roughly the same ,
speaker: G
text: almost identical in fact ,
speaker: G
text: and the Robustness meetings were <disfmarker> had the least ,
speaker: G
text: so <disfmarker>
speaker: G
text: One sort of unexpected result there is that uh two - party telephone conversations have <vocalsound> about the same amount of overlap ,
speaker: A
text: I 'm surprised .
speaker: G
text: sort of in gen you know <disfmarker> order of magnitude - wise as , uh <disfmarker> as face - to - face meetings with multiple <disfmarker>
speaker: A
text: I have <disfmarker> I had better start changing all my slides !
speaker: G
text: Yeah .
speaker: G
text: Also , I <disfmarker> in the Levinson , the pragmatics book , <comment> in you know , uh , textbook , <vocalsound> there 's <disfmarker> I found this great quote where he says <vocalsound> you know <disfmarker> you know , how people <disfmarker> it talks about how uh <disfmarker> how <disfmarker> how people are so good at turn taking ,
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: G
text: and <vocalsound> so <disfmarker> they 're so good that <vocalsound> generally , u the overlapped speech does not <disfmarker> is less than five percent .
speaker: C
text: Oh ,
speaker: C
text: that 's interesting .
speaker: G
text: So ,
speaker: C
text: Yeah .
speaker: G
text: this is way more than five percent .
speaker: E
text: Did he mean face <disfmarker> like face - to - face ?
speaker: E
text: Or <disfmarker> ?
speaker: G
text: Well , in real conversations ,
speaker: G
text: everyday conversations .
speaker: E
text: Hmm .
speaker: G
text: It 's s what these conversation analysts have been studying for years and years there .
speaker: C
text: Mm - hmm .
speaker: C
text: Mm - hmm .
speaker: C
text: Well , of course , no , it doesn't necessarily go against what he said ,
speaker: B
text: But <disfmarker>
speaker: C
text: cuz he said " generally speaking " . In order to <disfmarker> to go against that kind of a claim you 'd have to big canvassing .
speaker: A
text: Hmm .
speaker: B
text: And in f
speaker: G
text: Well , he <disfmarker> he made a claim <disfmarker>
speaker: A
text: Well <disfmarker>
speaker: G
text: Well <disfmarker>
speaker: F
text: Yeah , we <disfmarker> we have pretty limited sample here .
speaker: B
text: But <disfmarker>
speaker: B
text: Five percent of time or five percent of what ?
speaker: C
text: Yeah .
speaker: A
text: Yeah , I was gonna ask that too .
speaker: G
text: Well it 's time .
speaker: B
text: Yeah .
speaker: C
text: Exactly .
speaker: G
text: So <disfmarker> <vocalsound> but still <disfmarker> but still <disfmarker> u
speaker: C
text: It 's <disfmarker> i it 's not against his conclusion ,
speaker: B
text: Yeah ,
speaker: B
text: so <disfmarker>
speaker: C
text: it just says that it 's a bi bell curve , and that , <vocalsound> you have something that has a nice range , in your sampling .
speaker: G
text: Yeah .
speaker: G
text: So there are slight <disfmarker>
speaker: G
text: There are differences in how you measure it ,
speaker: G
text: but still it 's <disfmarker> <vocalsound> You know , the difference between um <disfmarker> between that number and what we have in meetings ,
speaker: G
text: which is more like , <vocalsound> you know , close to <disfmarker> in meetings like these , uh <disfmarker> you know , close to twenty percent .
speaker: C
text: Mm - hmm .
speaker: F
text: But what was it like , say , in the Robustness meeting , for instance ?
speaker: C
text: Mm - hmm .
speaker: G
text: That <disfmarker>
speaker: A
text: But <disfmarker>
speaker: G
text: Robustness meeting ?
speaker: G
text: It was <vocalsound> about half of the r
speaker: G
text: So , <vocalsound> in terms of number of words , it 's like seventeen or eigh eighteen percent for the Meeting Recorder meetings and <vocalsound> about half that for , <vocalsound> uh , the Robustness .
speaker: F
text: Maybe ten percent ?
speaker: A
text: But I don't know if that 's really a fair way of comparing between , multi - party , conversations and two - party conversations .
speaker: B
text: Then <disfmarker> then <disfmarker> then you have to <disfmarker>
speaker: A
text: Yeah .
speaker: A
text: I <disfmarker> I <disfmarker> I don't know .
speaker: A
text: I mean that 's just something <disfmarker>
speaker: D
text: Yeah , I just wonder if you have to normalize by the numbers of speakers or something .
speaker: C
text: Yeah .
speaker: B
text: Then <disfmarker> Yeah , then normalize by <disfmarker> by something like that ,
speaker: G
text: Well , we didn't get to look at that ,
speaker: C
text: Yeah ,
speaker: C
text: that 's a good point .
speaker: B
text: yeah .
speaker: C
text: Yeah .
speaker: G
text: but this obvious thing to see if <disfmarker> if there 's a dependence on the number of uh <disfmarker> participants .
speaker: C
text: Good idea .
speaker: A
text: I mean <disfmarker>
speaker: A
text: I bet there 's a weak dependence .
speaker: B
text: Yeah .
speaker: A
text: I 'm sure it 's <disfmarker> it 's not a real strong one .
speaker: G
text: Right .
speaker: A
text: Right ?
speaker: D
text: Cuz not everybody talks .
speaker: A
text: Because you
speaker: G
text: Right .
speaker: A
text: Right .
speaker: D
text: Yeah .
speaker: A
text: You have a lot of <disfmarker> a lot of two - party , subsets within the meeting .
speaker: G
text: Right .
speaker: C
text: Uh - huh .
speaker: A
text: Well regardless <disfmarker>
speaker: G
text: So <disfmarker>
speaker: A
text: it 's an interesting result regardless .
speaker: G
text: Right .
speaker: G
text: And <disfmarker> and <disfmarker> and then <disfmarker> and we also d computed this both with and without backchannels ,
speaker: C
text: Yes , that 's right .
speaker: C
text: Mm - hmm .
speaker: G
text: so you might think that backchannels have a special status because they 're essentially just <disfmarker>
speaker: A
text: Uh - huh .
speaker: A
text: So , did <disfmarker> we all said " uh - huh " and nodded at the same time ,
speaker: G
text: R right .
speaker: G
text: But , even if you take out all the backchannels <disfmarker>
speaker: A
text: so .
speaker: G
text: so basically you treat backchannels l as nonspeech , as pauses ,
speaker: A
text: Mm - hmm .
speaker: F
text: Mm - hmm .
speaker: G
text: you still have significant overlap .
speaker: G
text: You know , it goes down from maybe <disfmarker> For Switchboard it goes down from <disfmarker> I don't know <disfmarker> f um <disfmarker> <comment> I don't know <disfmarker> f fourteen percent of the words to maybe <vocalsound> uh I don't know , eleven percent or something <disfmarker>
speaker: G
text: it 's <disfmarker> it 's not a dramatic change ,
speaker: G
text: so it 's <disfmarker>
speaker: A
text: Mm - hmm .
speaker: G
text: Anyway ,
speaker: G
text: so it 's uh <disfmarker>
speaker: G
text: That was <disfmarker> that was one set of <pause> results ,
speaker: G
text: and then the second one was just basically the <disfmarker> <vocalsound> the stuff we had in the <disfmarker> in the HLT paper on how overlaps effect the <pause> recognition performance .
speaker: C
text: Hmm .
speaker: A
text: Nope .
speaker: A
text: Right .
speaker: F
text: Mm - hmm .
speaker: G
text: And we rescored things um , a little bit more carefully .
speaker: G
text: We also fixed the transcripts in <disfmarker> in numerous ways .
speaker: G
text: Uh , but mostly we added one <disfmarker> one number , which was
speaker: G
text: what if you <pause> uh , basically score ignoring all <disfmarker>
speaker: G
text: So <disfmarker> so the <disfmarker> the conjecture from the HLT results was that <vocalsound> most of the added recognition error is from insertions <vocalsound> due to background speech .
speaker: G
text: So , we scored <vocalsound> all the recognition results , <vocalsound> uh , in such a way that the
speaker: G
text: uh <disfmarker>
speaker: A
text: Oh by the way , who 's on channel four ?
speaker: B
text: Yeah .
speaker: A
text: You 're getting a lot of breath .
speaker: E
text: That 's <disfmarker>
speaker: B
text: I j was just wondering .
speaker: B
text: Yeah .
speaker: E
text: That 's me .
speaker: G
text: uh , well Don 's been working hard .
speaker: E
text: That 's right .
speaker: G
text: OK ,
speaker: G
text: so <disfmarker> <vocalsound> so if you have the foreground speaker speaking here , and then there 's some background speech , may be overlapping it somehow ,
speaker: G
text: um , and this is the time bin that we used ,
speaker: G
text: then of course you 're gonna get insertion errors here and here .
speaker: A
text: Right .
speaker: G
text: Right ?
speaker: G
text: So we scored everything ,
speaker: G
text: and I must say the NIST scoring tools are pretty nice for this ,
speaker: G
text: where you just basically ignore everything outside of the , <vocalsound> uh , region that was deemed to be foreground speech .
speaker: G
text: And where that was we had to use the t forced alignment , uh , results from s for <disfmarker>
speaker: G
text: so <disfmarker>
speaker: G
text: That 's somewhat <disfmarker> that 's somewhat subject to error ,
speaker: G
text: but still we <disfmarker> we <disfmarker> <vocalsound> Uh , Don did some ha hand - checking
speaker: G
text: and <disfmarker> and we think that <disfmarker> based on that , we think that the results are you know , valid ,
speaker: G
text: although of course , some error is gonna be in there .
speaker: G
text: But basically what we found is after we take out these regions <disfmarker> so we only score the regions that were certified as foreground speech , <comment> <vocalsound> the recognition error went down to almost <vocalsound> uh , the <pause> level of the non - overlapped <pause> speech .
speaker: G
text: So that means that <vocalsound> even if you do have background speech , if you can somehow separate out or find where it is , <vocalsound> uh , the recognizer does a good job ,
speaker: A
text: That 's great .
speaker: B
text: Yeah .
speaker: G
text: even though there is this back
speaker: A
text: Yeah , I guess that doesn't surprise me ,
speaker: A
text: because , with the close - talking mikes , the <disfmarker> the signal will be so much stronger .
speaker: G
text: Right .
speaker: G
text: Right .
speaker: G
text: Mm - hmm .
speaker: F
text: Mm - hmm .
speaker: G
text: Um ,
speaker: G
text: so <disfmarker>
speaker: A
text: What <disfmarker> what sort of normalization do you do ?
speaker: G
text: Uh , well , we just <disfmarker> @ @ <comment> we do <disfmarker> u you know , vit
speaker: A
text: I mean in you recognizer ,
speaker: A
text: in the SRI recognizer .
speaker: G
text: Well , we do uh , VTL <disfmarker> <vocalsound> vocal tract length normalization ,
speaker: G
text: w and we uh <disfmarker> you know , we <disfmarker> we uh , <vocalsound> make all the features have zero mean and unit variance .
speaker: F
text: And <disfmarker>
speaker: A
text: Over an entire utterance ?
speaker: G
text: Over <disfmarker> over the entire c over the entire channel .
speaker: A
text: Or windowed ?
speaker: B
text: Don't <pause> train <disfmarker>
speaker: G
text: Over the <disfmarker>
speaker: G
text: but you know .
speaker: A
text: Hmm .
speaker: G
text: Um , now we didn't re - align the recognizer for this .
speaker: G
text: We just took the old <disfmarker>
speaker: G
text: So this is actually a sub - optimal way of doing it ,
speaker: F
text: Right .
speaker: G
text: right ?
speaker: A
text: Right .
speaker: G
text: So we took the old recognition output
speaker: G
text: and we just scored it differently .
speaker: G
text: So the recognizer didn't have the benefit of knowing where the foreground speech <disfmarker> a start
speaker: F
text: Were you including the <disfmarker> the lapel <pause> in this ?
speaker: G
text: Yes .
speaker: F
text: And did the <disfmarker> did <disfmarker> did the la did the <disfmarker> the problems with the lapel go away also ?
speaker: G
text: Um , it <disfmarker> Yeah .
speaker: F
text: Or <disfmarker>
speaker: F
text: fray for <disfmarker> for insertions ?
speaker: G
text: It u not per <disfmarker> I mean , not completely ,
speaker: G
text: but yes ,
speaker: G
text: dramatically .
speaker: F
text: Less so .
speaker: G
text: So we have to
speaker: G
text: um <disfmarker>
speaker: F
text: I mean , you still <disfmarker>
speaker: G
text: Well I should bring the <disfmarker> should bring the table with results .
speaker: G
text: Maybe we can look at it <pause> Monday .
speaker: F
text: I would presume that you still would have somewhat higher error with the lapel for insertions than <disfmarker>
speaker: G
text: Yes .
speaker: G
text: It 's <disfmarker> It 's <disfmarker>
speaker: G
text: Yes .
speaker: F
text: Yeah .
speaker: G
text: Yeah .
speaker: F
text: Cuz again , looking forward to the non - close miked case , I think that we s still <disfmarker>
speaker: G
text: Mm - hmm .
speaker: A
text: I 'm not looking forward to it .
speaker: F
text: i it 's the high signal - to - noise ratio
speaker: G
text: Right .
speaker: F
text: here that <disfmarker> that helps you .
speaker: G
text: u s Right .
speaker: G
text: So <disfmarker>
speaker: G
text: so that was number <disfmarker> that was the second set of <disfmarker> uh , the second section .
speaker: G
text: And then , <vocalsound> the third thing was , we looked at , <vocalsound> <vocalsound> uh , what we call " interrupts " ,
speaker: G
text: although that 's <disfmarker> that may be <vocalsound> a misnomer ,
speaker: G
text: but basically <vocalsound> we looked at cases where <disfmarker>
speaker: G
text: Uh , so we <disfmarker> we used the punctuation from the original transcripts
speaker: G
text: and we inferred the beginnings and ends of sentences .
speaker: G
text: So ,
speaker: G
text: you know <disfmarker>
speaker: C
text: Di - did you use upper - lower case also , or not ?
speaker: G
text: Um <disfmarker>
speaker: G
text: Hmm ?
speaker: C
text: U upper lower case or no ?
speaker: G
text: No ,
speaker: G
text: we only used , you know , uh periods , uh , question marks and <pause> exclamation .
speaker: C
text: OK .
speaker: G
text: And we know that there 's th that 's not a very g
speaker: G
text: I mean , we miss a lot of them ,
speaker: C
text: Yeah .
speaker: G
text: but <disfmarker> but it 's f i i
speaker: C
text: That 's OK
speaker: C
text: but <disfmarker>
speaker: C
text: Comma also or not ?
speaker: G
text: No commas .
speaker: G
text: No .
speaker: G
text: And then <vocalsound> we looked at locations where ,
speaker: G
text: uh ,
speaker: G
text: if you have overlapping speech and someone else starts a sentence , you know , where do these <disfmarker> where do other people start their <vocalsound> turns <disfmarker> not turns really , but you know , sentences ,
speaker: B
text: Ah .
speaker: G
text: um <disfmarker>
speaker: G
text: So we only looked at cases where there was a foreground speaker
speaker: G
text: and then at the to at the <disfmarker> so the <disfmarker> the foreground speaker started into their sentence and then someone else started later .
speaker: G
text: OK ?
speaker: B
text: Somewhere in between the start and the end ?
speaker: G
text: And so what <disfmarker>
speaker: B
text: OK .
speaker: G
text: Sorry ?
speaker: B
text: Somewhere in between the start and the end of the foreground ?
speaker: G
text: Yes .
speaker: G
text: Uh , so that such that there was overlap between the two sentences .
speaker: B
text: Yeah .
speaker: G
text: So , the <disfmarker> the question was how can we <disfmarker> what can we say about the places where the second or <disfmarker> or actually , several second speakers , <vocalsound> um <pause> start their <pause> " interrupts " , as we call them .
speaker: D
text: Three words from the end .
speaker: A
text: At pause boundaries .
speaker: G
text: w
speaker: G
text: And we looked at this in terms of
speaker: G
text: um <disfmarker>
speaker: A
text: On T - closures , only .
speaker: G
text: So <disfmarker> so we had <disfmarker> <vocalsound> we had
speaker: G
text: um u
speaker: G
text: to <disfmarker> for <disfmarker> for the purposes of this analysis , we tagged the word sequences , and <disfmarker> and we time - aligned them .
speaker: G
text: Um ,
speaker: G
text: and we considered it interrupt <disfmarker> if it occurred in the middle of a word ,
speaker: G
text: we basically <disfmarker> you know , considered that to be a interrupt as if it were at <disfmarker> at the beginning of the word .
speaker: G
text: So that , <vocalsound> if any part of the word was overlapped , it was considered an interrupted <pause> word .
speaker: F
text: Mm - hmm .
speaker: G
text: And then we looked at the <disfmarker> the locatio the , <vocalsound> um , you know , the features that <disfmarker> the tags
speaker: G
text: because we had tagged these word strings , <comment> <vocalsound> um , that <disfmarker> that occurred right before these <disfmarker> these uh , interrupt locations .
speaker: B
text: Tag by uh
speaker: G
text: And the tags we looked at are <vocalsound> the spurt tag ,
speaker: G
text: which basically says <disfmarker>
speaker: G
text: or actually <disfmarker>
speaker: G
text: Sorry .
speaker: G
text: End of spurt .
speaker: G
text: So <disfmarker> <vocalsound> whether there was a pause essentially here ,
speaker: G
text: because spurts are a <disfmarker> defined as being you know , five hundred milliseconds or longer pauses ,
speaker: G
text: and then we had things like discourse markers ,
speaker: G
text: uh , backchannels ,
speaker: G
text: uh , disfluencies .
speaker: G
text: um ,
speaker: G
text: uh , filled pauses <disfmarker>
speaker: G
text: So disfluen the D 's are for , <vocalsound> um , <vocalsound> the interruption points of a disfluency ,
speaker: G
text: so , where you hesitate , or where you start the repair there .
speaker: G
text: Uh , what else do we had .
speaker: G
text: Uh , repeated <disfmarker> you know , repeated words is another of that kind of disfluencies and so forth .
speaker: G
text: So we had both the beginnings and ends of these <disfmarker>
speaker: G
text: uh so , the end of a filled pause
speaker: G
text: and the end of a discourse marker .
speaker: G
text: And we just eyeballed <disfmarker>
speaker: G
text: I mean <vocalsound> we didn't really hand - tag all of these things .
speaker: G
text: We just <pause> looked at the distribution of words ,
speaker: G
text: and so every <vocalsound> " so yeah " , and " OK " , uh , and " uh - huh " were <disfmarker> were the <disfmarker> were deemed to be backchannels
speaker: G
text: and <vocalsound> " wow " and " so " and <vocalsound> uh " right " , uh were um <disfmarker> <pause> Not " right " . " Right " is a backchannel .
speaker: G
text: But so , we sort of <disfmarker> just based on the lexical <disfmarker> <vocalsound> um , identity of the words , we <disfmarker> we tagged them as one of these things .
speaker: G
text: And of course the d the interruption points we got from the original transcripts .
speaker: G
text: So ,
speaker: G
text: and then we looked at the disti
speaker: G
text: so we looked at the <pause> distribution of these different kinds of tags , overall
speaker: G
text: uh , and <disfmarker> and <disfmarker> and particularly at the interruption points .
speaker: G
text: And uh , we found that there is a marked difference
speaker: G
text: so
speaker: G
text: that for instance after <disfmarker>
speaker: G
text: so at the end after a discourse marker or after backchannel or after filled pause , you 're much more likely to be interrupted <vocalsound> than before .
speaker: G
text: OK ?
speaker: G
text: And also of course after spurt ends ,
speaker: G
text: which means basically in p inside pauses .
speaker: G
text: So pauses are always an opportunity for <disfmarker>
speaker: G
text: So we have this little histogram which shows these distributions
speaker: G
text: and , <vocalsound> um ,
speaker: D
text: I wonder <disfmarker>
speaker: G
text: you know , it 's <disfmarker> it 's <disfmarker> it 's not <disfmarker> No big surprises ,
speaker: G
text: but it is <pause> sort of interesting from <disfmarker>
speaker: A
text: It 's nice to actually measure it though .
speaker: G
text: Yeah .
speaker: D
text: I wonder about the cause and effect there .
speaker: D
text: In other words uh <pause> if you weren't going to pause you <disfmarker> you will because you 're g being interrupted .
speaker: G
text: Well we 're ne
speaker: D
text: Uh <disfmarker>
speaker: G
text: Right .
speaker: G
text: There 's no statement about cause and effect .
speaker: D
text: Yeah ,
speaker: G
text: This is just a statistical correlation ,
speaker: D
text: right .
speaker: D
text: No , no , no .
speaker: D
text: Right ,
speaker: D
text: I <disfmarker> I see .
speaker: G
text: yeah .
speaker: D
text: Yeah .
speaker: F
text: But he <disfmarker> yeah , he 's <disfmarker> he 's right ,
speaker: F
text: y I mean maybe
speaker: F
text: you weren't intending to pause at all ,
speaker: F
text: but <disfmarker> <vocalsound> You were intending to stop for fifty - seven milliseconds ,
speaker: G
text: Right .
speaker: G
text: Right .
speaker: F
text: but then Chuck came in
speaker: F
text: and so you <vocalsound> paused for a second
speaker: D
text: Yeah .
speaker: G
text: Right .
speaker: G
text: Anyway . <comment> So ,
speaker: F
text: or more .
speaker: G
text: uh , and that was basically it .
speaker: G
text: And <disfmarker> and we <disfmarker> so we wrote this
speaker: G
text: and then , <vocalsound> we found we were at six pages ,
speaker: G
text: and then we started <vocalsound> cutting furiously
speaker: B
text: Oops .
speaker: G
text: and <vocalsound> threw out half of the <vocalsound> material again ,
speaker: G
text: and uh played with the LaTeX stuff
speaker: G
text: and <disfmarker>
speaker: G
text: uh ,
speaker: G
text: and <disfmarker> until it fi
speaker: A
text: Made the font smaller and the narrows longer .
speaker: B
text: Font smaller ,
speaker: B
text: yeah .
speaker: G
text: No , no .
speaker: G
text: W well , d you couldn't really make everything smaller
speaker: G
text: but we s we put <disfmarker>
speaker: B
text: Put the abstract end .
speaker: G
text: Oh , I <disfmarker> I <disfmarker>
speaker: G
text: you know the <disfmarker> the gap between the two columns is like ten millimeters ,
speaker: A
text: Took out white space .
speaker: B
text: Yeah .
speaker: G
text: so I d shrunk it to eight millimeters
speaker: G
text: and that helped some . And stuff like that .
speaker: D
text: Wasn't there <disfmarker> wasn't there some result , Andreas <disfmarker>
speaker: F
text: Yeah <disfmarker>
speaker: D
text: I <disfmarker> I thought maybe Liz presented this at some conference a while ago about <vocalsound> uh , backchannels
speaker: G
text: Mm - hmm .
speaker: G
text: Mm - hmm .
speaker: D
text: uh ,
speaker: D
text: and that they tend to happen when uh <pause> the pitch drops .
speaker: D
text: You know you get a falling pitch .
speaker: G
text: Yeah .
speaker: D
text: And so that 's when people tend to backchannel .
speaker: G
text: Well <disfmarker>
speaker: D
text: Uh - i i do you rem
speaker: G
text: y We didn't talk about , uh , prosodic , uh , properties at all ,
speaker: D
text: Right . Right .
speaker: G
text: although that 's <disfmarker> I <disfmarker> I take it that 's something that uh Don will <disfmarker> will look at
speaker: D
text: But <disfmarker>
speaker: G
text: now that we have the data and we have the alignment ,
speaker: E
text: Yeah , we 're gonna be looking at that .
speaker: G
text: so .
speaker: G
text: This is purely based on you know the words
speaker: G
text: and <disfmarker>
speaker: D
text: Mm - hmm .
speaker: C
text: I have a reference for that though .
speaker: D
text: Oh you do .
speaker: G
text: Yeah .
speaker: C
text: Uh - huh .
speaker: D
text: So am I recalling correctly ?
speaker: G
text: Anyway , so .
speaker: D
text: About <disfmarker>
speaker: C
text: Well , I didn't know about Liz 's finding on that ,
speaker: D
text: Uh - huh .
speaker: C
text: but I know of another paper that talks about something
speaker: D
text: Hmm .
speaker: C
text: that <disfmarker>
speaker: E
text: I 'd like to see that reference too .
speaker: D
text: It made me think about a cool little device that could be built
speaker: C
text: OK .
speaker: D
text: to
speaker: D
text: uh <disfmarker>
speaker: D
text: to handle those people that call you on the phone and just like to talk and talk and talk .
speaker: D
text: And you just have this little detector that listens for these <vocalsound> drops in pitch and gives them the backchannel .
speaker: D
text: And so then you <vocalsound> hook that to the phone and go off
speaker: A
text: Yeah .
speaker: D
text: and do the <vocalsound> <disfmarker> do whatever you r wanna do ,
speaker: A
text: Uh - huh .
speaker: G
text: Oh yeah .
speaker: G
text: Well <disfmarker>
speaker: D
text: while that thing keeps them busy .
speaker: G
text: There 's actually <disfmarker> uh there 's this a former student of here from Berkeley ,
speaker: G
text: Nigel <disfmarker> Nigel Ward .
speaker: G
text: Do you know him ?
speaker: D
text: Uh - huh .
speaker: D
text: Sure .
speaker: D
text: Yeah .
speaker: G
text: He did a system uh , in <disfmarker>
speaker: G
text: he <disfmarker> he lives in Japan now ,
speaker: G
text: and he did this backchanneling , automatic backchanneling system .
speaker: F
text: Right .
speaker: G
text: It 's a very <disfmarker>
speaker: D
text: Oh !
speaker: G
text: So , exactly what you describe ,
speaker: G
text: but for Japanese .
speaker: D
text: Huh .
speaker: G
text: And it 's apparently <disfmarker> for Japa - in Japanese it 's really important that you backchannel .
speaker: G
text: It 's really impolite if you don't ,
speaker: G
text: and <disfmarker>
speaker: G
text: So .
speaker: F
text: Huh .
speaker: F
text: Actually for a lot of these people I think you could just sort of backchannel continuously
speaker: F
text: and it would <pause> pretty much be fine .
speaker: D
text: It wouldn't matter ?
speaker: E
text: Yeah .
speaker: D
text: Yeah .
speaker: E
text: That 's w That 's what I do .
speaker: D
text: Random intervals .
speaker: A
text: There was <disfmarker> there was of course a Monty Python sketch with that .
speaker: A
text: Where the barber who was afraid of scissors was playing a <disfmarker> a tape of clipping sounds , and saying " uh - huh " ,
speaker: A
text: " yeah " ,
speaker: A
text: " how about them sports teams ? "
speaker: G
text: Anyway .
speaker: G
text: So the paper 's on - line
speaker: G
text: and
speaker: G
text: y I <disfmarker> I think I uh <disfmarker> I CC ' ed a message to Meeting Recorder with the URL
speaker: G
text: so you can get it .
speaker: A
text: Yep .
speaker: F
text: Yeah .
speaker: A
text: Printed it out ,
speaker: G
text: Um , uh one more thing .
speaker: A
text: haven't read it yet .
speaker: F
text: Yeah .
speaker: G
text: So I <disfmarker> I 'm actually <disfmarker> <vocalsound> about to send Brian Kingbury an email saying where he can find the <disfmarker> the s the m the material he wanted for the s for the speech recognition experiment ,
speaker: G
text: so <disfmarker>
speaker: G
text: but I haven't sent it out yet
speaker: G
text: because actually my desktop locked up ,
speaker: G
text: like I can't type anything .
speaker: G
text: Uh
speaker: G
text: b so if there 's any suggestions you have for that I was just gonna send him the <disfmarker>
speaker: D
text: Is it the same directory that you had suggested ?
speaker: G
text: I made a directory .
speaker: G
text: I called it
speaker: G
text: um <disfmarker>
speaker: G
text: Well this isn't <disfmarker>
speaker: C
text: He still has his Unix account here , you know .
speaker: G
text: He does ?
speaker: C
text: Yeah .
speaker: G
text: Yeah
speaker: C
text: And he <disfmarker> and he 's <disfmarker>
speaker: G
text: but <disfmarker> but <disfmarker> but he has to <disfmarker>
speaker: C
text: I 'd hafta add him to Meeting Recorder , I guess ,
speaker: G
text: he prefe he said he would prefer FTP
speaker: C
text: but <disfmarker>
speaker: C
text: OK .
speaker: G
text: and also , um , the other person that wants it <disfmarker> There is one person at SRI who wants to look at the <vocalsound> um , you know , the uh <disfmarker> the data we have so far ,
speaker: C
text: OK .
speaker: G
text: and so I figured that FTP is the best <pause> approach .
speaker: G
text: So what I did is I um <disfmarker> <vocalsound> <vocalsound> @ @ <comment> I made a n new directory
speaker: G
text: after Chuck said that would c that was gonna be a good thing .
speaker: G
text: Uh , so it 's " FTP <vocalsound> <pause> pub
speaker: A
text: Pub real .
speaker: G
text: real " <disfmarker>
speaker: G
text: Exactly .
speaker: G
text: MTGC <disfmarker>
speaker: G
text: What is it again ?
speaker: G
text: CR <disfmarker>
speaker: F
text: u R D <disfmarker> RDR ,
speaker: A
text: Ask Dan Ellis .
speaker: G
text: Or <disfmarker>
speaker: F
text: yeah .
speaker: G
text: Yeah .
speaker: G
text: Right ?
speaker: G
text: The same <disfmarker> the same as the mailing list ,
speaker: G
text: and <disfmarker>
speaker: F
text: Yeah ,
speaker: G
text: Yeah .
speaker: F
text: the <disfmarker> <pause> No vowels .
speaker: G
text: Um ,
speaker: G
text: and then under there <disfmarker>
speaker: F
text: Yeah
speaker: G
text: Um actually <disfmarker> Oh and this directory , <vocalsound> is not readable .
speaker: G
text: It 's only uh , accessible .
speaker: G
text: So , <vocalsound> in other words , to access anything under there , you have to <vocalsound> be told what the name is .
speaker: G
text: So that 's sort of a g <vocalsound> quick and dirty way of doing access control .
speaker: A
text: Right .
speaker: F
text: Mm - hmm .
speaker: G
text: So <disfmarker>
speaker: G
text: uh , and the directory for this I call it I " ASR zero point one "
speaker: G
text: because it 's sort of meant for recognition .
speaker: F
text: So anyone who hears this meeting now knows the <disfmarker>
speaker: A
text: Beta ?
speaker: G
text: And then <disfmarker> then in there I have a file that lists all the other <vocalsound> files ,
speaker: G
text: so that someone can get that file and then know the file names and therefore download them .
speaker: G
text: If you don't know the file names you can't <disfmarker>
speaker: F
text: Is that a dash or a dot in there ?
speaker: G
text: I mean you can <disfmarker>
speaker: A
text: Don't <disfmarker> don't <disfmarker> don't say .
speaker: G
text: Dash .
speaker: G
text: Anyway .
speaker: G
text: So all I <disfmarker> all I was gonna do there was stick the <disfmarker> the transcripts after we <disfmarker> the way that we munged them for scoring ,
speaker: G
text: because that 's what he cares about ,
speaker: G
text: and <disfmarker>
speaker: G
text: um ,
speaker: G
text: and also <disfmarker> and then the <disfmarker> the <pause> waveforms that Don segmented .
speaker: G
text: I mean , just basically tar them all up f I mean <disfmarker> w for each meeting I tar them all into one tar file and G - zip them and stick them there .
speaker: A
text: I uh , put digits in my own home directory <disfmarker> home FTP directory ,
speaker: G
text: And so .
speaker: A
text: but I 'll probably move them there as well .
speaker: G
text: Oh , OK .
speaker: G
text: OK .
speaker: D
text: So we could point Mari to this also for her <vocalsound> March O - one request ?
speaker: G
text: Yeah .
speaker: G
text: March O - one .
speaker: G
text: Oh !
speaker: D
text: Or <disfmarker>
speaker: D
text: You n Remember she was <disfmarker>
speaker: G
text: Oh she wanted that also ?
speaker: D
text: Well she was saying that it would be nice if we had <disfmarker> they had a <disfmarker>
speaker: D
text: Or was she talking <disfmarker>
speaker: D
text: Yeah .
speaker: D
text: She was saying it would be nice if they had eh <pause> the same set ,
speaker: D
text: so that when they did experiments they could compare .
speaker: G
text: Right ,
speaker: G
text: but they don't have a recognizer even .
speaker: D
text: Yeah .
speaker: E
text: Um <disfmarker>
speaker: G
text: But yeah ,
speaker: E
text: I
speaker: G
text: we can send <disfmarker> I can CC Mari on this so that she knows <disfmarker>
speaker: D
text: Yeah .
speaker: D
text: So , for the thing that <disfmarker>
speaker: C
text: That 's good .
speaker: D
text: We need to give Brian the beeps file ,
speaker: G
text: Right .
speaker: D
text: so I was gonna probably put it <disfmarker>
speaker: A
text: We can put it in the same place .
speaker: D
text: Yeah , it
speaker: A
text: Just put in another directory .
speaker: G
text: Well , make ano make another directory .
speaker: D
text: I 'll make another directory .
speaker: D
text: Yeah .
speaker: G
text: You don't n m
speaker: D
text: Exactly .
speaker: G
text: Yeah .
speaker: D
text: Yeah .
speaker: G
text: Yeah .
speaker: E
text: And , Andreas , um , sampled ?
speaker: G
text: They are ?
speaker: E
text: I think so .
speaker: E
text: Yeah .
speaker: G
text: OK .
speaker: E
text: Um , so either we should regenerate the original <vocalsound> versions , <comment> <pause> or um , we should just make a note of it .
speaker: G
text: Oh .
speaker: G
text: Beca - Well <disfmarker>
speaker: G
text: OK , because in one directory there 's two versions .
speaker: E
text: Yeah , that 's the first meeting I cut both versions .
speaker: G
text: OK .
speaker: E
text: Just to check which w if there is a significant difference .
speaker: G
text: And so I <disfmarker>
speaker: G
text: but <disfmarker>
speaker: G
text: OK
speaker: G
text: so <disfmarker> but for the other meetings it 's the downsampled version that you have .
speaker: E
text: They 're all downsampled ,
speaker: E
text: yeah .
speaker: G
text: Oh , OK .
speaker: G
text: Oh that 's th important to know ,
speaker: G
text: OK
speaker: G
text: so
speaker: G
text: we should probably <disfmarker> uh <pause> give them the non - downsampled versions .
speaker: E
text: Yeah .
speaker: E
text: So <disfmarker>
speaker: G
text: OK .
speaker: G
text: Alright , then I 'll hold off on that and I 'll wait for you
speaker: G
text: um <disfmarker>
speaker: E
text: Probably by tomorrow
speaker: G
text: gen
speaker: E
text: I can <disfmarker>
speaker: G
text: OK .
speaker: E
text: I 'll send you an email .
speaker: G
text: Alright .
speaker: G
text: OK .
speaker: G
text: Yeah , definitely they should have the full bandwidth version ,
speaker: G
text: yeah . OK .
speaker: E
text: Yeah ,
speaker: E
text: because I mean <disfmarker> I I think Liz decided to go ahead with the <pause> downsampled versions cuz we can <disfmarker> There was no s like , r significant difference .
speaker: G
text: Well , it takes <disfmarker> it takes up less disk space , for one thing .
speaker: E
text: It does take up less disk space ,
speaker: E
text: and apparently it did even better <pause> than the original <disfmarker> than the original versions ,
speaker: G
text: Yeah .
speaker: G
text: Yeah .
speaker: G
text: Right .
speaker: E
text: which you know , is just , probably random .
speaker: G
text: Yeah , it was a small difference
speaker: G
text: but yeah .
speaker: E
text: But , um <pause> they probably w want the originals .
speaker: G
text: Yeah .
speaker: G
text: OK .
speaker: G
text: OK ,
speaker: G
text: good .
speaker: G
text: Good that <disfmarker>
speaker: G
text: Well , it 's a good thing that <disfmarker>
speaker: A
text: OK , I think we 're losing , Don and Andreas at three - thirty ,
speaker: A
text: right ?
speaker: G
text: Yeah .
speaker: E
text: Hey mon hafta booga .
speaker: A
text: OK .
speaker: F
text: So ,
speaker: F
text: that 's why it was good to have Andreas , say these things
speaker: F
text: but <disfmarker>
speaker: F
text: So , we should probably talk about the IBM transcription process stuff that <disfmarker>
speaker: C
text: OK .
speaker: F
text: Hmm .
speaker: C
text: So , um you know that Adam created um , a b a script to generate the beep file ?
speaker: C
text: To then create something to send to IBM .
speaker: C
text: And , um ,
speaker: C
text: you <disfmarker> you should probably talk about that .
speaker: C
text: But <disfmarker> but you were gonna to use the <pause> originally transcribed file
speaker: C
text: because I tightened the time bins
speaker: C
text: and that 's also the one that they had already <vocalsound> in trying to debug the first stage of this .
speaker: C
text: And uh ,
speaker: C
text: my understanding was that ,
speaker: C
text: um <disfmarker>
speaker: C
text: I haven't <disfmarker> <vocalsound> I haven't listened to it yet ,
speaker: C
text: but it sounded very good
speaker: A
text: Mm - hmm .
speaker: C
text: and <disfmarker> and I understand that you guys <vocalsound> were going to have a meeting today , before this meeting .
speaker: A
text: It was just to talk about how to generate it .
speaker: A
text: Um , just so that while I 'm gone , you can regenerate it if you decide to do it a different way .
speaker: C
text: Excellent .
speaker: A
text: So uh , Chuck and Thilo should , now more or less know how to generate the file
speaker: C
text: OK .
speaker: A
text: and , <vocalsound> the other thing Chuck pointed out is that , um , <vocalsound> since this one is hand - marked , <vocalsound> there are discourse boundaries .
speaker: A
text: Right ?
speaker: C
text: Mm - hmm .
speaker: A
text: So <disfmarker> so when one person is speaking , there 's breaks .
speaker: A
text: Whereas Thilo 's won't have that .
speaker: C
text: Oh !
speaker: C
text: OK .
speaker: A
text: So what <disfmarker> what we 're probably gonna do is just write a script , that if two , chunks are very close to each other on the same channel we 'll just merge them .
speaker: C
text: Ah , interesting .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: C
text: Oh , sure .
speaker: C
text: Yeah , sure .
speaker: C
text: Makes sense .
speaker: A
text: So , uh , and that will get around the problem of , the , <vocalsound> you know " one word beep , one word beep , one word beep , one word beep " .
speaker: C
text: Yeah .
speaker: C
text: Ah !
speaker: C
text: Clever .
speaker: C
text: Yes .
speaker: C
text: Clever .
speaker: C
text: Yeah .
speaker: C
text: Excellent .
speaker: D
text: Yeah , in fact after our meeting uh , this morning Thilo came in and said that <vocalsound> um , there could be <pause> other differences between <vocalsound> the uh <pause> already transcribed meeting with the beeps in it and one that has <pause> just r been run through his process .
speaker: C
text: And that 's the purpose .
speaker: C
text: Yeah .
speaker: D
text: So tomorrow , <vocalsound> when we go to make the um <pause> uh , chunked file <vocalsound> for IBM , we 're going to actually compare the two .
speaker: D
text: So he 's gonna run his process on that same meeting ,
speaker: C
text: Great idea !
speaker: D
text: and then we 're gonna do the beep - ify on both , and listen to them and see if we notice any real differences .
speaker: G
text: Beep - ify !
speaker: C
text: OK ,
speaker: C
text: now one thing that prevented us from apply you <disfmarker> you from applying <disfmarker>
speaker: C
text: Exactly .
speaker: C
text: The training <disfmarker>
speaker: C
text: So that is the training meeting .
speaker: D
text: Yeah ,
speaker: D
text: w and we know that .
speaker: C
text: OK .
speaker: D
text: Wel - uh we just wanna if <disfmarker> if there 're any major differences between <vocalsound> doing it on the hand
speaker: C
text: Uh - huh .
speaker: C
text: Oh , interesting .
speaker: C
text: Ah !
speaker: C
text: OK .
speaker: A
text: Hmm .
speaker: C
text: Interesting idea .
speaker: G
text: So this training meeting , uh w un is that uh <pause> some data where we have uh very um , <vocalsound> you know , accurate <pause> time marks ? for <disfmarker>
speaker: C
text: Great .
speaker: C
text: I went back and hand - marked the <pause> ba the bins ,
speaker: C
text: I ment I mentioned that last week .
speaker: G
text: OK ,
speaker: G
text: yeah .
speaker: D
text: But the <disfmarker> but there 's <disfmarker> yeah , but there is this one issue with them in that there 're <disfmarker> <vocalsound> there are time boundaries in there that occur in the middle of speech .
speaker: G
text: Because <disfmarker>
speaker: D
text: So <disfmarker>
speaker: D
text: Like when we went t to
speaker: D
text: um <disfmarker>
speaker: D
text: When I was listening to the original file that Adam had , it 's like you <disfmarker> you hear a word then you hear a beep <vocalsound> and then you hear the continuation of what is the same sentence .
speaker: A
text: That 's on the other channel .
speaker: A
text: That 's because of channel overlap .
speaker: D
text: Well ,
speaker: D
text: and <disfmarker> and so the <disfmarker> th
speaker: C
text: Hmm .
speaker: D
text: So there are these chunks that look like uh <disfmarker> <vocalsound> that have uh <disfmarker>
speaker: A
text: It 's <disfmarker> i
speaker: A
text: I mean that 's not gonna be true of the foreground speaker .
speaker: A
text: That 'll only be if it 's the background speaker .
speaker: D
text: Right .
speaker: D
text: So you 'll <disfmarker> you 'll have a chunk of , you know , channel <vocalsound> A which starts at zero and ends at ten ,
speaker: D
text: and then the same channel starting at eleven ,
speaker: D
text: ending at fifteen ,
speaker: D
text: and then again , starting at sixteen ,
speaker: D
text: ending at twenty .
speaker: D
text: Right ,
speaker: D
text: so that 's three chunks where <vocalsound> actually we w can just make one chunk out of that
speaker: G
text: Mm - hmm .
speaker: D
text: which is A , zero , twenty .
speaker: C
text: Yeah .
speaker: C
text: Sure .
speaker: A
text: That 's what I just said ,
speaker: C
text: Sure .
speaker: A
text: yeah .
speaker: D
text: Yeah .
speaker: D
text: So I just wanted to make sure that it was clear .
speaker: C
text: Yeah ,
speaker: C
text: I thought that was <disfmarker>
speaker: D
text: So <vocalsound> if you were to use these , you have to be careful not to pull out these individual <disfmarker>
speaker: C
text: Yeah .
speaker: G
text: Oh !
speaker: G
text: I mean it <disfmarker>
speaker: G
text: Right ,
speaker: G
text: I mean w I mean what I would <disfmarker> I was interested in is having <disfmarker> <vocalsound> a se having time marks for the beginnings and ends of speech
speaker: G
text: by each speaker .
speaker: A
text: Well , that 's definitely a problem .
speaker: G
text: Uh , because we could use that to fine tune our alignment process
speaker: G
text: to make it more accurate .
speaker: D
text: Yeah .
speaker: A
text: Battery .
speaker: B
text: Battery ?
speaker: D
text: Mm - hmm .
speaker: G
text: So <disfmarker>
speaker: G
text: uh ,
speaker: G
text: it <disfmarker> I don't care that you know , there 's actually abutting segments that we have to join together .
speaker: G
text: That 's fine .
speaker: D
text: OK .
speaker: G
text: But what we do care about is that <vocalsound> the beginnings and ends um <pause> are actually close to the speech <vocalsound> inside of that
speaker: D
text: Yeah ,
speaker: G
text: uh <disfmarker>
speaker: D
text: I think Jane tightened these up by hand .
speaker: G
text: OK ,
speaker: B
text: OK .
speaker: C
text: Yeah .
speaker: G
text: so what is the <disfmarker> sort of how tight are they ?
speaker: F
text: Uh , it looks much better .
speaker: B
text: Yeah .
speaker: B
text: Looks good .
speaker: C
text: They were , um , reasonably tight , but not excruciatingly tight .
speaker: G
text: Oh .
speaker: C
text: That would 've taken more time .
speaker: C
text: I just wanted to get it so tha So that if you have like " yeah " <comment> in a <disfmarker> swimming in a big bin , then it 's <disfmarker>
speaker: G
text: No , no !
speaker: G
text: I don
speaker: G
text: actually I <disfmarker> I <disfmarker>
speaker: A
text: Let me make a note on yours .
speaker: G
text: I <disfmarker> it 's f
speaker: B
text: Yeah .
speaker: G
text: That 's fine
speaker: G
text: because we don't want to <disfmarker>
speaker: G
text: th that 's perfectly fine .
speaker: G
text: In fact it 's good .
speaker: G
text: You always want to have a little bit of pause or nonspeech around the speech , say for recognition purposes .
speaker: G
text: Uh ,
speaker: G
text: but just <disfmarker> just u w you know get an id I just wanted to have an idea of the <disfmarker> <vocalsound> of how much extra you allowed
speaker: G
text: um <disfmarker>
speaker: G
text: so that I can interpret the numbers if I compared that with a forced alignment segmentation .
speaker: G
text: So .
speaker: C
text: I can't answer that ,
speaker: C
text: but <disfmarker> but my main goal was <pause> um , in these areas where you have a three - way overlap <vocalsound> and one of the overlaps involves " yeah " , <vocalsound> and it 's swimming in this huge bin , <vocalsound> I wanted to get it so that it was clo more closely localized .
speaker: G
text: Mm - hmm .
speaker: G
text: Mm - hmm .
speaker: G
text: Right .
speaker: G
text: But are we talking about , I don't know , <pause> a <vocalsound> <pause> tenth of a second ?
speaker: G
text: a <disfmarker> ?
speaker: G
text: You know ?
speaker: G
text: How <disfmarker> how much <disfmarker> how much extra would you allow at most <disfmarker>
speaker: C
text: I <disfmarker> I wanted to <disfmarker>
speaker: C
text: I wanted it to be able to <disfmarker> l he be heard normally ,
speaker: G
text: Mm - hmm .
speaker: C
text: so that if you <disfmarker> if you play <pause> back that bin and have it in the mode where it stops at the boundary , <vocalsound> it sounds like a normal word .
speaker: G
text: OK .
speaker: C
text: It doesn't sound like the person <disfmarker>
speaker: C
text: i it sounds normal .
speaker: C
text: It 's as if the person could 've stopped there .
speaker: G
text: Mm - hmm .
speaker: G
text: OK .
speaker: C
text: And it wouldn't have been an awkward place to stop .
speaker: C
text: Now sometimes you know , it 's <disfmarker> these are involved in places where there was no time .
speaker: C
text: And so , <vocalsound> <vocalsound> there wouldn't be <pause> a gap afterwards because <disfmarker>
speaker: G
text: OK .
speaker: C
text: I mean some cases , there 're some people <pause> um , who <disfmarker> who have very long <pause> segments of discourse where , <vocalsound> you know , they 'll <disfmarker> they 'll breath <pause> and then I put a break .
speaker: G
text: Mm - hmm .
speaker: C
text: But other than that , it 's really pretty continuous
speaker: C
text: and this includes things like going from one sentence into the <disfmarker> u one utterance into the next , one sentence into the next ,
speaker: C
text: um ,
speaker: C
text: w without really stopping .
speaker: C
text: I mean <disfmarker> i they , i
speaker: C
text: you know in writing you have this <vocalsound> two spaces and a big gap
speaker: G
text: Mm - hmm .
speaker: C
text: you know .
speaker: G
text: Right .
speaker: C
text: But <disfmarker> but uh <pause> <vocalsound> i some people are planning
speaker: C
text: and , you know , I mean , a lot <disfmarker> we always are planning <pause> what we 're going to say next .
speaker: G
text: OK .
speaker: C
text: But uh , in which case , the gap between <pause> these two complete syntactic units , <vocalsound> um , which of course n spoken things are not always complete syntactically ,
speaker: C
text: but <disfmarker> <vocalsound> but it would be a shorter p shorter break <vocalsound> than <vocalsound> maybe you might like .
speaker: G
text: Mm - hmm .
speaker: C
text: But the goal there was to <pause> not have <vocalsound> the text be so <disfmarker> so crudely <pause> parsed in a time bin .
speaker: C
text: I mean , because <vocalsound> from a discourse m purpose <pause> it 's <disfmarker> <vocalsound> it 's more <disfmarker> <vocalsound> it 's more useful to be able to see <disfmarker>
speaker: C
text: and also you know , from a speech recognition purpose my impression is that <vocalsound> if you have too long a unit , it 's <disfmarker> it doesn't help you very much either ,
speaker: C
text: cuz of the memory .
speaker: G
text: Well , yeah .
speaker: G
text: That 's fine .
speaker: C
text: So , that means that <vocalsound> the amount of time after something is variable depending partly on context ,
speaker: C
text: but my general goal <vocalsound> when there was <pause> sufficient space , room , pause <pause> after it <pause> to have it be <pause> kind of a natural feeling <pause> gap .
speaker: G
text: OK .
speaker: C
text: Which I c I don't know what it would be quantified as .
speaker: C
text: You know , Wally Chafe says that <vocalsound> um , <vocalsound> in producing narratives , the spurts that people use <vocalsound> tend to be , <vocalsound> uh , that the <disfmarker> the <disfmarker> what would be a pause might be something like two <disfmarker> two seconds .
speaker: G
text: Mmm .
speaker: C
text: And um , that would be , you know one speaker .
speaker: C
text: The discourse <disfmarker> <vocalsound> the people who look at turn taking often do use <disfmarker>
speaker: G
text: Mm - hmm .
speaker: C
text: I was interested that you chose uh , <vocalsound> you know um , <comment> the <disfmarker> you know that you use
speaker: C
text: cuz I think that 's a unit that would be more consistent with sociolinguistics .
speaker: G
text: Well we chose um , you know , half a second
speaker: C
text: Yeah .
speaker: G
text: because <vocalsound> if <disfmarker> if you go much larger , you have a <disfmarker> y you know , your <disfmarker> your statement about how much overlap there is becomes less , <vocalsound> um , precise ,
speaker: G
text: because you include more of actual pause time into what you consider overlap speech .
speaker: C
text: Mm - hmm .
speaker: G
text: Um ,
speaker: G
text: so ,
speaker: G
text: it 's sort of a compromise ,
speaker: G
text: and <disfmarker> <vocalsound> it 's also based <disfmarker>
speaker: B
text: Yeah . <comment> <vocalsound> <vocalsound> Yeah , I also used I think something around zero point five seconds for the speech - nonspeech detector <disfmarker>
speaker: G
text: I mean Liz suggested that value based on <vocalsound> the distribution of pause times that you see in Switchboard and <disfmarker> and other corpora .
speaker: C
text: Mm - hmm .
speaker: G
text: Um <disfmarker>
speaker: G
text: So <disfmarker>
speaker: B
text: for the minimum silence length .
speaker: G
text: Mm - hmm .
speaker: G
text: I see .
speaker: B
text: So .
speaker: G
text: Yeah .
speaker: C
text: Mm - hmm .
speaker: G
text: OK .
speaker: C
text: In any case , this <disfmarker> this uh , meeting <pause> that I hand <disfmarker>
speaker: C
text: I <disfmarker> I hand - adjusted two of them
speaker: C
text: I mentioned before ,
speaker: G
text: Mm - hmm .
speaker: G
text: OK ,
speaker: C
text: and I sent <disfmarker> I sent email ,
speaker: G
text: So <disfmarker> so at some point we will try to fine - tune our forced alignment
speaker: C
text: so <disfmarker>
speaker: C
text: And I sent the <comment> <pause> path .
speaker: G
text: maybe using those as references
speaker: G
text: because you know , what you would do is you would play with different parameters .
speaker: G
text: And to get an object You need an objective <vocalsound> measure of how closely you can align the models to the actual speech .
speaker: G
text: And that 's where your your data would be <pause> very important to have .
speaker: G
text: So , I will <disfmarker>
speaker: G
text: Um <disfmarker>
speaker: B
text: Yeah and hopefully the new meetings <pause> which will start from the channelized version will <disfmarker> will have better time boundaries <pause> and alignments .
speaker: G
text: Mm - hmm .
speaker: G
text: Right .
speaker: C
text: But I like this idea of <disfmarker> uh , for our purposes for the <disfmarker> for the IBM preparation , <vocalsound> uh , n having these <pause> joined together ,
speaker: B
text: Yeah .
speaker: C
text: and uh <disfmarker>
speaker: B
text: Yeah .
speaker: C
text: It makes a lot of sense .
speaker: C
text: And in terms of transcription , it would be easy to do it that way .
speaker: G
text: Yeah .
speaker: C
text: The way that they have with the longer units ,
speaker: G
text: Yeah .
speaker: C
text: not having to fuss with adding these units at this time .
speaker: B
text: Yeah .
speaker: G
text: Right .
speaker: B
text: Whi - which could have one drawback . If there is uh a backchannel in between those three things ,
speaker: C
text: Mm - hmm .
speaker: B
text: the <disfmarker> the n the backchannel will <disfmarker> will occur at the end of <disfmarker> of those three .
speaker: C
text: Yes .
speaker: B
text: And <disfmarker> and in <disfmarker> in the <disfmarker> in the previous version where in the n which is used now , <vocalsound> there , the backchannel would <disfmarker> would be in - between there somewhere ,
speaker: C
text: I see .
speaker: B
text: so .
speaker: C
text: Yeah .
speaker: B
text: That would be more natural
speaker: C
text: Well ,
speaker: B
text: but <disfmarker>
speaker: C
text: that 's <disfmarker> that 's right ,
speaker: C
text: but you know , thi this brings me to the other f stage of this which I discussed with you earlier today ,
speaker: B
text: Yeah .
speaker: C
text: which is <vocalsound> the second stage is <vocalsound> um , w what to do <pause> in terms of the transcribers adjustment of these data .
speaker: C
text: I discussed this with you too .
speaker: C
text: Um , the tr
speaker: C
text: so the idea initially was , we would get <vocalsound> uh , for the new meetings ,
speaker: C
text: so the e EDU meetings , that <vocalsound> Thilo ha has now presegmented all of them for us , on a channel by channel basis .
speaker: C
text: And um ,
speaker: C
text: so , I 've assigned <disfmarker> I 've <disfmarker> I 've assigned them to our transcribers
speaker: C
text: and um ,
speaker: C
text: so far I 've discussed it with one ,
speaker: C
text: with uh <disfmarker>
speaker: C
text: And I had a <pause> about an hour discussion with her about this yesterday ,
speaker: C
text: we went through <vocalsound> uh EDU - one , at some extent .
speaker: C
text: And it occurred to me that <vocalsound> um <disfmarker> that <vocalsound> basically what we have in this kind of a format is <disfmarker> you could consider it as a staggered mixed file ,
speaker: C
text: we had some discussion over the weekend a about <disfmarker> at <disfmarker> at this other meeting that we were all a at <disfmarker>
speaker: C
text: um , <vocalsound> about whether the tran the IBM transcribers should hear a single channel audio , or a mixed channel audio .
speaker: C
text: And um , <vocalsound> in <disfmarker> in a way , by <disfmarker> by having this <disfmarker> this chunk and then the backchannel <vocalsound> after it , it 's like a stagal staggered mixed channel .
speaker: C
text: And um , <vocalsound> it occurred <pause> to me in my discussion with her yesterday that um ,
speaker: C
text: um ,
speaker: C
text: the <disfmarker> <pause> the <disfmarker> the maximal gain , it 's <disfmarker> from the IBM <pause> people , may be in long stretches of connected speech .
speaker: C
text: So it 's basically a whole bunch of words <vocalsound> which they can really do , because of the continuity within that person 's turn .
speaker: C
text: So , what I 'm thinking , and it may be that not all meetings will be good for this , <comment> but <disfmarker> but what I 'm thinking is that <vocalsound> in the EDU meetings , they tend to be <vocalsound> driven by a couple of dominant speakers .
speaker: C
text: And , if the chunked files focused on the dominant speakers , <vocalsound> then , when <disfmarker> when it got s patched together when it comes back from IBM , we can add the backchannels .
speaker: C
text: It seems to me <vocalsound> that <vocalsound> um , you know , the backchannels per - se wouldn't be so hard ,
speaker: C
text: but then there 's this question of the time <pause> @ @ <comment> uh , marking , and whether the beeps would be <vocalsound> uh y y y
speaker: C
text: And I 'm not exactly sure how that <disfmarker> how that would work with the <disfmarker> with the backchannels .
speaker: C
text: And ,
speaker: C
text: so um <disfmarker>
speaker: C
text: And certainly things that are <vocalsound> intrusions of multiple words , <vocalsound> taken out of context and displaced in time from where they occurred , <vocalsound> that would be hard .
speaker: C
text: So , m my <vocalsound> thought is <pause> i I 'm having this transcriber go through <vocalsound> the EDU - one meeting , and indicate a start time <nonvocalsound> f for each dominant speaker , endpoi end time for each dominant speaker ,
speaker: C
text: and the idea that <vocalsound> these units would be generated for the dominant speakers , <vocalsound> and maybe not for the other channels .
speaker: A
text: Yeah the only , um , disadvantage of that is , then it 's hard to use an automatic method to do that .
speaker: A
text: The advantage is that it 's probably faster to do that than it is to use the automated method and correct it .
speaker: A
text: So .
speaker: C
text: Well , it <disfmarker>
speaker: C
text: OK .
speaker: A
text: We 'll just have to see .
speaker: C
text: I think <disfmarker> <vocalsound> I <disfmarker> I think um , you know , the original plan was that the transcriber would adjust the t the boundaries , and all that for all the channels
speaker: C
text: but , <vocalsound> you know , that is so time - consuming ,
speaker: C
text: and since we have a bottleneck here , we want to get IBM things that are usable s as soon as possible ,
speaker: C
text: then this seemed to me it 'd be a way of gett to get them a flood of data ,
speaker: C
text: which would be useful when it comes back to us .
speaker: C
text: And um <disfmarker>
speaker: C
text: Oh also , at the same time she <disfmarker> when she goes through this , she 'll be <vocalsound> uh <disfmarker> If there 's anything that <vocalsound> was encoded as a pause , but really has something transcribable in it , <vocalsound> then she 's going to <vocalsound> uh , make a mark <disfmarker>
speaker: A
text: Yeah .
speaker: C
text: w uh , so you know , so <vocalsound> that <disfmarker> that bin would be marked as it <disfmarker> as double dots
speaker: C
text: and she 'll just add an S .
speaker: C
text: And in the other <disfmarker> in the other case , if it 's marked as speech , <vocalsound> and really there 's nothing transcribable in it , then she 's going to put a s dash ,
speaker: C
text: and I 'll go through and it <disfmarker> and um , you know , with a <disfmarker> <vocalsound> <vocalsound> with a substitution command , get it so that it 's clear that those are the other category .
speaker: C
text: I 'll just , you know , recode them .
speaker: C
text: But um , <vocalsound> um , the transcribable events <pause> that um , I 'm considering in this , <vocalsound> uh , continue to be <vocalsound> laugh , as well as speech , and cough and things like that ,
speaker: C
text: so I 'm not stripping out anything ,
speaker: C
text: just <disfmarker> just you know , being very lenient in what 's considered speech .
speaker: D
text: Jane ?
speaker: C
text: Yeah ?
speaker: D
text: In terms of the <disfmarker> this new procedure you 're suggesting , <vocalsound> um , u what is the <disfmarker>
speaker: A
text: It 's not that different .
speaker: D
text: So I 'm a little confused ,
speaker: D
text: because how do we know where to put beeps ?
speaker: D
text: Is it <disfmarker> i d y is it <disfmarker>
speaker: C
text: Oh , OK .
speaker: C
text: So what it <disfmarker> what it <disfmarker> what it involves is <disfmarker> is really a s uh , <vocalsound> uh , the original pr procedure ,
speaker: A
text: Transcriber will do it .
speaker: C
text: but <vocalsound> only applied to <pause> uh , a certain <pause> strategically chosen <pause> s aspect of the data .
speaker: A
text: We pick the easy parts of the data basically ,
speaker: C
text: So <disfmarker>
speaker: A
text: and transcriber marks it by hand .
speaker: C
text: You got it .
speaker: A
text: And because <disfmarker>
speaker: D
text: But after we 've done Thilo 's thing .
speaker: A
text: No .
speaker: C
text: Yes !
speaker: A
text: Oh , after .
speaker: C
text: Yes !
speaker: A
text: Oh , OK ,
speaker: C
text: Oh yeah !
speaker: A
text: I didn't <disfmarker> I didn't understand that .
speaker: A
text: OK .
speaker: B
text: So ,
speaker: B
text: I 'm @ @ <disfmarker> now I 'm confused .
speaker: C
text: OK .
speaker: C
text: We start with your presegmented version <disfmarker>
speaker: G
text: OK , and I 'm leaving .
speaker: E
text: Yeah , I have to go as well .
speaker: G
text: So , um <disfmarker>
speaker: A
text: OK , leave the mikes on ,
speaker: A
text: and just put them on the table .
speaker: E
text: OK .
speaker: E
text: Thanks .
speaker: C
text: We start with the presegmented version <disfmarker>
speaker: A
text: Let me mark you as no digits .
speaker: B
text: You start with the presegmentation ,
speaker: B
text: r <vocalsound> yeah ?
speaker: C
text: Yeah .
speaker: C
text: And then um , <vocalsound> the transcriber , <vocalsound> instead of going painstakingly through all the channels and moving the boundaries around , and deciding if it 's speech or not , but not transcribing anything .
speaker: C
text: OK ?
speaker: C
text: Instead of doing that , which was our original plan , <vocalsound> the tra They focus on the dominant speaker <disfmarker>
speaker: D
text: Mm - hmm .
speaker: D
text: They just <vocalsound> do that on <pause> the main channels .
speaker: C
text: Yeah .
speaker: C
text: So what they do is they identify who 's the di dominant speaker , and when the speaker starts .
speaker: D
text: OK .
speaker: B
text: Yeah ?
speaker: B
text: OK .
speaker: C
text: So I mean , you 're still gonna <disfmarker>
speaker: C
text: So we 're <disfmarker>
speaker: B
text: And you just <disfmarker>
speaker: C
text: It 's based on your se presegmentation ,
speaker: C
text: that 's the basic <pause> thing .
speaker: B
text: and you just use the s the segments of the dominant speaker then ? For <disfmarker> for sending to <disfmarker> to IBM
speaker: B
text: or <disfmarker> ?
speaker: C
text: Yeah .
speaker: C
text: Exactly .
speaker: D
text: So , now Jane , my question is <vocalsound> when they 're all done adjusting the w time boundaries for the dominant speaker , <comment> have they then also erased the time boundaries for the other ones ?
speaker: C
text: Mm - hmm .
speaker: C
text: Uh No . No , no .
speaker: D
text: So how will we know who <disfmarker>
speaker: C
text: Huh - uh .
speaker: C
text: S
speaker: B
text: Yeah .
speaker: C
text: That 's <disfmarker> that 's why she 's notating the start and end points of the dominant speakers .
speaker: C
text: So , on a <disfmarker> you know , so <vocalsound> i in EDU - one , i as far as I listened to it , you start off with a <disfmarker> a s section by Jerry .
speaker: C
text: So Jerry starts at minute so - and - so ,
speaker: C
text: and goes until minute so - and - so .
speaker: C
text: And then Mark Paskin comes in .
speaker: C
text: And he starts at <vocalsound> minute such - and - such ,
speaker: C
text: and goes on till minute so - and - so .
speaker: C
text: OK .
speaker: C
text: And then <vocalsound> meanwhile , she 's listening to <vocalsound> <pause> both of these guys ' channels ,
speaker: C
text: determining if there 're any cases of misclassification of speech as nothing , and nothing as speech ,
speaker: D
text: Mm - hmm .
speaker: D
text: OK .
speaker: C
text: and <vocalsound> a and adding a tag if that happens .
speaker: D
text: So she does the adjustments on those guys ?
speaker: C
text: But you know , I wanted to say , his segmentation is so good , that <vocalsound> um , the part that I listened to with her yesterday <vocalsound> didn't need any adjustments of the bins .
speaker: B
text: On that meeting .
speaker: D
text: Mm - hmm .
speaker: C
text: So far we haven't .
speaker: C
text: So this is not gonna be a major part of the process ,
speaker: C
text: at least <disfmarker> least not in <disfmarker> not on ones that <disfmarker> that really <disfmarker>
speaker: D
text: So if you don't have to adjust the bins , why not just do what it <disfmarker> for all the channels ?
speaker: C
text: Mm - hmm ?
speaker: D
text: Why not just throw all the channels to IBM ?
speaker: C
text: Well there 's the question o of <pause> whether <disfmarker>
speaker: C
text: Well , OK .
speaker: C
text: She i It 's a question of how much time we want our transcriber to invest here <vocalsound> when she 's gonna have to invest that when it comes back from IBM anyway .
speaker: D
text: Mm - hmm .
speaker: C
text: So if it 's only inserting " mm - hmm "s here and there , then , wouldn't that be something that would be just as efficient to do at this end , instead of having it go through I B M , then be patched together , then be double checked here .
speaker: D
text: Mm - hmm .
speaker: D
text: Right .
speaker: B
text: Yeah .
speaker: B
text: But <disfmarker>
speaker: B
text: But then we could just use the <disfmarker> the output of the detector , and do the beeping on it , and send it to I B
speaker: D
text: Without having her check anything .
speaker: F
text: Right .
speaker: B
text: Yeah .
speaker: C
text: Well , I guess <disfmarker>
speaker: B
text: For some meetings , I 'm <disfmarker> I 'm sure it <disfmarker> i
speaker: A
text: I think we just <disfmarker> we just have to listen to it and see how good they are .
speaker: B
text: n
speaker: C
text: I 'm <disfmarker> I 'm open to that ,
speaker: C
text: it was <disfmarker>
speaker: F
text: Yeah , if it 's working well ,
speaker: F
text: that sounds like a good idea
speaker: B
text: That 's <disfmarker> And some <disfmarker> on some meetings it 's good .
speaker: F
text: since as you say you have to do stuff with the other end anyway .
speaker: B
text: Yeah .
speaker: C
text: Well yea
speaker: C
text: OK , good .
speaker: D
text: Yeah , I mean we have to fix it when it comes back anyhow .
speaker: C
text: I mean the detector , this <disfmarker>
speaker: B
text: Yeah .
speaker: C
text: Now , you were saying that they <disfmarker> they differ in how well they work depending on channel s sys systems and stuff .
speaker: B
text: Yeah .
speaker: B
text: So we should perhaps just select meetings on which the speech - nonspeech detection works well ,
speaker: C
text: But EDU is great .
speaker: B
text: and just use , <vocalsound> those meetings to <disfmarker> to <disfmarker> to send to IBM and , do the other ones .
speaker: A
text: Release to begin with .
speaker: C
text: How interesting .
speaker: F
text: What 's the problem <disfmarker> the l I forget .
speaker: C
text: You know <disfmarker>
speaker: F
text: Is the problem the lapel ,
speaker: F
text: or <disfmarker> or <disfmarker>
speaker: B
text: Uh , it really depends .
speaker: B
text: Um , my <disfmarker> my <disfmarker> my impression is that it 's better for meetings with fewer speakers ,
speaker: B
text: and it 's better for <disfmarker> <vocalsound> for meetings where nobody is breathing .
speaker: F
text: Oh ,
speaker: F
text: the dead meetings .
speaker: B
text: Yeah ,
speaker: B
text: get <disfmarker>
speaker: B
text: That 's it .
speaker: D
text: So in fact this might suggest an alternative sort of a <disfmarker> a c a hybrid between these two things .
speaker: A
text: No , the undead meeting ,
speaker: A
text: yeah .
speaker: C
text: Yeah .
speaker: C
text: Yeah ?
speaker: D
text: So the <disfmarker> the one suggestion is you know we <disfmarker> <vocalsound> we run Thilo 's thing
speaker: D
text: and then we have somebody go and adjust all the time boundaries
speaker: C
text: Yeah ?
speaker: D
text: and we send it to IBM .
speaker: B
text: Yeah .
speaker: D
text: The other one is <vocalsound> we just run his thing and send it to IBM .
speaker: D
text: There 's a <disfmarker> a another possibility if we find that there are some problems ,
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: D
text: and that is <vocalsound> if we go ahead and we <vocalsound> just run his , and we generate the beeps file , then we have somebody listen beeps file .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: D
text: And they listen to each section and say " yes , no " whether that section is
speaker: B
text: And erase <disfmarker>
speaker: B
text: Yeah .
speaker: C
text: Is intelligible .
speaker: D
text: i i intelligible or not .
speaker: D
text: And it just <disfmarker> You know , there 's a little interface which will <disfmarker> for all the " yes " - es it <disfmarker> then that will be the final <vocalsound> beep file .
speaker: B
text: Yeah .
speaker: A
text: Blech .
speaker: C
text: That 's interesting !
speaker: C
text: Cuz that 's <disfmarker> that 's directly related to the e end task .
speaker: A
text: Stress test .
speaker: D
text: Mm - hmm .
speaker: C
text: How interesting !
speaker: D
text: Yeah .
speaker: D
text: I mean it wouldn't be that much fun for a transcriber to sit there , hear it , beep , yes or no .
speaker: B
text: Nope .
speaker: F
text: I <disfmarker> I <disfmarker> I don't know .
speaker: D
text: But it would be quick .
speaker: F
text: It would be <disfmarker> kind of quick
speaker: F
text: but they 're still listening to everything .
speaker: D
text: But there 's no adjusting .
speaker: D
text: And that 's what 's slow .
speaker: D
text: There 's no adjusting of time boundaries .
speaker: C
text: Well , <vocalsound> eh , listening does take time too .
speaker: F
text: Yeah .
speaker: D
text: Yeah .
speaker: F
text: I don't know ,
speaker: F
text: I <disfmarker> I think I 'm <disfmarker> I 'm really tending towards <disfmarker>
speaker: A
text: One and a half times real time .
speaker: F
text: I mean , <vocalsound> what 's the worst that happens ?
speaker: F
text: Do the transcribers <disfmarker>
speaker: F
text: I mean as long as th on the other end they can say there 's <disfmarker> there 's something <disfmarker> conventions so that they say " huh ? "
speaker: D
text: Yeah .
speaker: D
text: Right .
speaker: F
text: and then we can flag those later .
speaker: D
text: They <disfmarker> they <disfmarker>
speaker: D
text: Yeah .
speaker: F
text: i i It <disfmarker> i
speaker: D
text: That 's true .
speaker: D
text: We can just catch it at the <disfmarker> catch everything at this side .
speaker: F
text: Yeah .
speaker: D
text: Well maybe that 's the best way to go ,
speaker: D
text: just <disfmarker>
speaker: C
text: How interesting !
speaker: A
text: I mean it just depends on how <disfmarker>
speaker: C
text: Well EDU <disfmarker>
speaker: B
text: Yeah ,
speaker: B
text: u u u
speaker: A
text: Sorry , go ahead .
speaker: C
text: So I was gonna say , EDU - one is good enough ,
speaker: B
text: Yeah .
speaker: C
text: maybe we could include it in this <disfmarker> in this set of uh , this stuff we send .
speaker: B
text: Yeah there 's <disfmarker> I <disfmarker> I think there are some meetings where it would <disfmarker> would <disfmarker> It 's possible like this .
speaker: A
text: Yeah I <disfmarker> I think , we won't know until we generate a bunch of beep files automatically , listen to them and see how bad they are .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: D
text: Yeah .
speaker: D
text: We won't be able to s include it with this first thing ,
speaker: C
text: Mm - hmm .
speaker: C
text: Hmm .
speaker: A
text: If <disfmarker>
speaker: C
text: Oh , OK .
speaker: D
text: because there 's a part of the process of the beep file which requires knowing the normalization coefficients .
speaker: C
text: Oh , I see .
speaker: D
text: And <disfmarker> <vocalsound> So a
speaker: A
text: That 's not hard to do .
speaker: A
text: Just <disfmarker> it takes <disfmarker> you know , it just takes five minutes rather than , taking a second .
speaker: D
text: OK
speaker: B
text: Yeah .
speaker: D
text: Right ,
speaker: D
text: except I don't think that <disfmarker> the c the instructions for doing that was in that directory ,
speaker: A
text: So . I just hand <disfmarker> hard - coded it .
speaker: D
text: right ?
speaker: D
text: I <disfmarker> I didn't see where you had gener
speaker: A
text: No , but it 's easy enough to do .
speaker: B
text: What <disfmarker>
speaker: F
text: But I <disfmarker> but I have a <disfmarker>
speaker: B
text: Doing the gain ? It 's no problem .
speaker: D
text: n Doing th
speaker: B
text: Adjusting the gain ?
speaker: D
text: No , getting the coefficients ,
speaker: D
text: for each channel .
speaker: C
text: Know what numbers .
speaker: B
text: Yeah , that 's no problem .
speaker: D
text: OK .
speaker: D
text: So we just run that one <disfmarker>
speaker: B
text: We can do that .
speaker: A
text: There are lots of ways to do it .
speaker: A
text: I have one program that 'll do it .
speaker: B
text: Yeah .
speaker: A
text: You can find other programs .
speaker: B
text: I <disfmarker> I used it ,
speaker: D
text: We just run that
speaker: B
text: so .
speaker: A
text: Yep .
speaker: F
text: Yeah .
speaker: B
text: Yeah .
speaker: D
text: J - sound - stat ? OK .
speaker: A
text: Minus D , capital D .
speaker: F
text: But <disfmarker>
speaker: B
text: Yeah .
speaker: F
text: but <disfmarker> but I <disfmarker> I <disfmarker> I have <pause> another suggestion on that , which is , <vocalsound> since , really what this is , is <disfmarker> is <disfmarker> is trying to in the large , send the right thing to them and there is gonna be this <disfmarker> this post - processing step ,
speaker: F
text: um ,
speaker: F
text: why don't we check through a bunch of things by sampling it ?
speaker: D
text: Mm - hmm .
speaker: F
text: Right ?
speaker: F
text: In other words , rather than , um , uh , saying we 're gonna listen to everything <disfmarker>
speaker: A
text: I didn't mean listen to everything ,
speaker: A
text: I meant , just see if they 're any good .
speaker: F
text: Yeah .
speaker: F
text: So y you do a bunch of meetings ,
speaker: F
text: you listen to <disfmarker> to a little bit here and there ,
speaker: D
text: Yeah .
speaker: F
text: if it sounds like it 's almost always right and there 's not any big problem you send it to them .
speaker: D
text: Send it to them .
speaker: B
text: Yeah .
speaker: D
text: OK .
speaker: F
text: And , you know , then they 'll send us back what we <disfmarker> w what <disfmarker> what they send back to us ,
speaker: C
text: Oh , that 'd be great .
speaker: F
text: and we 'll <disfmarker> we 'll fix things up
speaker: F
text: and <vocalsound> some meetings will cost more time to fix up than others .
speaker: A
text: We should <disfmarker>
speaker: A
text: Yeah .
speaker: B
text: Yeah .
speaker: A
text: And we should just double - check with Brian on a few simple conventions on how they should mark things .
speaker: D
text: OK .
speaker: B
text: Sure .
speaker: D
text: When they <disfmarker> when there 's either no speech in there ,
speaker: B
text: Yeah .
speaker: D
text: or <vocalsound> something they don't understand ,
speaker: B
text: Yeah .
speaker: C
text: Yeah .
speaker: D
text: things like that .
speaker: C
text: Mm - hmm .
speaker: F
text: Yeah .
speaker: A
text: Yeah , cuz @ @ uh what I had originally said to Brian was well they 'll have to mark , when they can't distinguish between the foreground and background ,
speaker: A
text: because I thought that was gonna be the most prevalent .
speaker: D
text: Mm - hmm .
speaker: A
text: But if we send them without editing , then we 're also gonna hafta have m uh , notations for words that are cut off ,
speaker: B
text: Yeah .
speaker: D
text: Mm - hmm .
speaker: B
text: Yeah .
speaker: A
text: and other sorts of , uh , acoustic problems .
speaker: D
text: And they may just guess at what those cut - off words are ,
speaker: C
text: They do already .
speaker: C
text: Yeah .
speaker: D
text: but w I mean we 're gonna adjust <disfmarker> everything when we come back <disfmarker>
speaker: A
text: But what <disfmarker> what we would like them to do is be conservative
speaker: A
text: so that they should only write down the transcript if they 're sure .
speaker: B
text: Yeah .
speaker: A
text: And otherwise they should mark it so that we can check .
speaker: B
text: Mark it .
speaker: B
text: Sure .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: D
text: Mm - hmm .
speaker: C
text: Well , we have the unintelligibility <pause> convention .
speaker: C
text: And actually they have one also ,
speaker: A
text: Mm - hmm .
speaker: A
text: Right .
speaker: C
text: which <disfmarker>
speaker: F
text: i Can I maybe have <disfmarker> have an order of <disfmarker>
speaker: F
text: it 's probably in your paper that I haven't looked at lately ,
speaker: F
text: but <disfmarker>
speaker: F
text: Uh , an order of magnitude
speaker: C
text: Certainty .
speaker: F
text: notion of <disfmarker> of how <disfmarker> on a good meeting , how often uh , do you get segments that come in the middle of words and so forth ,
speaker: F
text: and uh <disfmarker> in a bad meeting how <vocalsound> often ?
speaker: B
text: Uh .
speaker: C
text: Was is it in a <disfmarker> in a <disfmarker> what <disfmarker> what is the t
speaker: F
text: Well he 's saying , you know , that the <disfmarker> the EDU meeting was a good <disfmarker> good meeting ,
speaker: C
text: In a good meeting ,
speaker: C
text: what ?
speaker: B
text: Yeah .
speaker: F
text: right ?
speaker: C
text: Yeah .
speaker: F
text: Uh , and so <disfmarker> so <disfmarker> so it was almost <disfmarker> it was almost always doing the right thing .
speaker: C
text: Oh I see ,
speaker: C
text: the characteristics .
speaker: F
text: So I wanted to get some sense of what <disfmarker> what almost always meant .
speaker: F
text: And then , uh in a bad meeting , <vocalsound> or p some meetings where he said oh he 's had some problems , what does that mean ?
speaker: C
text: Uh - huh .
speaker: F
text: So I mean does one of the does it mean one percent and ten percent ?
speaker: C
text: OK .
speaker: F
text: Or does it mean <vocalsound> five percent and fifty percent ?
speaker: C
text: OK .
speaker: F
text: Uh <disfmarker>
speaker: B
text: So <disfmarker>
speaker: F
text: Or <disfmarker> Maybe percentage isn't the right word ,
speaker: C
text: Just
speaker: F
text: but you know how many <disfmarker> how many per minute ,
speaker: B
text: Yeah th
speaker: F
text: or <disfmarker>
speaker: F
text: You know .
speaker: B
text: Yeah ,
speaker: B
text: the <disfmarker> the problem is that , nnn , the numbers Ian gave in the paper is just uh , some frame error rate .
speaker: B
text: So that 's <disfmarker> that 's not really <disfmarker> <vocalsound> What will be effective for <disfmarker> for the transcribers , is <disfmarker>
speaker: B
text: They have to <disfmarker> yeah , in in they have to insure that that 's a real s spurt or something .
speaker: B
text: And <disfmarker> but , <vocalsound> the numbers <disfmarker>
speaker: B
text: Oops .
speaker: B
text: Um <disfmarker>
speaker: C
text: Hmm !
speaker: B
text: Let me think .
speaker: B
text: So the <pause> speech <disfmarker> the amount of speech that is missed by the <pause> detector , for a good meeting , I th is around <pause> or under one percent , I would say .
speaker: B
text: But there can be <disfmarker>
speaker: B
text: Yeah .
speaker: B
text: For <disfmarker>
speaker: B
text: yeah ,
speaker: B
text: but there can be more <disfmarker>
speaker: B
text: There 's <disfmarker> There 's more amount speech <disfmarker>
speaker: B
text: uh , more amount of <disfmarker>
speaker: B
text: Yeah well , the detector says there is speech ,
speaker: B
text: but there is none .
speaker: B
text: So that <disfmarker> that can be a lot when <disfmarker> when it 's really a breathy channel .
speaker: F
text: But I think that 's less of a problem .
speaker: F
text: They 'll just listen .
speaker: B
text: Yeah .
speaker: F
text: It 's just wasted time .
speaker: B
text: Yeah .
speaker: F
text: And th and that 's for a good meeting .
speaker: F
text: Now what about in a meeting that you said we 've <disfmarker> you 've had some more trouble with ?
speaker: B
text: I can't <comment> really <disfmarker> hhh , <comment> <pause> Tsk . <comment> I <pause> don't have really representative numbers , I think .
speaker: B
text: That 's really <disfmarker>
speaker: B
text: I <disfmarker> I did <pause> this on <disfmarker> on four meetings and only five minutes of <disfmarker> of every meet of <disfmarker> of these meetings
speaker: B
text: so , <vocalsound> it 's not <disfmarker> not that representative ,
speaker: B
text: but ,
speaker: B
text: it 's perhaps ,
speaker: B
text: Fff .
speaker: B
text: Um <disfmarker>
speaker: B
text: Yeah , it 's perhaps then <disfmarker> it 's perhaps five percent of something ,
speaker: B
text: which s uh the <disfmarker> the frames <disfmarker> speech frames which are <disfmarker> which are missed ,
speaker: B
text: but um , I can't <disfmarker> can't really tell .
speaker: F
text: Right .
speaker: F
text: So I <disfmarker> <vocalsound> So i Sometime , we might wanna go back and look at it more in terms of <vocalsound> how many times is there a spurt that 's <disfmarker> that 's uh , interrupted ?
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: F
text: Something like that ?
speaker: C
text: The other problem is , that when it <disfmarker> when it uh d i on the breathy ones , where you get <vocalsound> <vocalsound> breathing , uh , inti indicated as speech .
speaker: F
text: And <disfmarker>
speaker: B
text: So <disfmarker>
speaker: C
text: And I guess we could just indicate to the transcribers not to <pause> encode that if they <disfmarker>
speaker: C
text: We could still do the beep file .
speaker: F
text: Yeah again I <disfmarker> I think that that is probably less of a problem
speaker: F
text: because if you 're <disfmarker> if there 's <disfmarker> <vocalsound> If <disfmarker> if a <disfmarker> if a word is <disfmarker> is split , then they might have to listen to it a few times to really understand that they can't quite get it .
speaker: C
text: OK .
speaker: C
text: OK .
speaker: C
text: OK .
speaker: F
text: Whereas if they listen <nonvocalsound> to it and there 's <disfmarker> don't hear any speech I think they 'd probably just listen to it once .
speaker: B
text: But <disfmarker>
speaker: B
text: Yeah .
speaker: F
text: So there 'd <disfmarker> you 'd think there 'd be a <disfmarker> a factor of three or four in <disfmarker> in , uh , cost function ,
speaker: C
text: OK .
speaker: F
text: you know , between them or something .
speaker: B
text: Yeah ,
speaker: B
text: so <disfmarker> but I think that 's <disfmarker> n that really doesn't happen very often that <disfmarker> that <disfmarker> that a word is cut in the middle or something .
speaker: B
text: That 's <disfmarker> that 's really not <disfmarker> not normal .
speaker: F
text: So <disfmarker> so what you 're saying is that nearly always what happens when there 's a problem is that <disfmarker> is that uh , there 's <vocalsound> some uh , uh nonspeech that uh <disfmarker> that is b interpreted as speech .
speaker: B
text: That is marked as speech .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: F
text: Well then , we really should just send the stuff .
speaker: C
text: That would be great .
speaker: F
text: Right ?
speaker: F
text: Because that doesn't do any harm .
speaker: B
text: Yeah ,
speaker: F
text: You know , if they <disfmarker> they hear you know , a dog bark and they say what was the word ,
speaker: B
text: it 's <disfmarker>
speaker: F
text: they <comment> you know , they <disfmarker>
speaker: B
text: Yeah , I als I <disfmarker>
speaker: F
text: Ruff ruff !
speaker: B
text: Yeah I also thought of <disfmarker> there <disfmarker> there are really some channels where it is almost <comment> um , only bre breathing in it .
speaker: F
text: Yeah ?
speaker: B
text: And to <disfmarker> to re - run 's
speaker: B
text: Eh , um . Yeah . I 've got a <disfmarker> a <pause> P - a <pause> method with loops into the cross - correlation with the PZM mike ,
speaker: F
text: Uh - huh .
speaker: B
text: and then to reject everything which <disfmarker> which seems to be breath .
speaker: B
text: So , I could run this on those breathy channels ,
speaker: B
text: and perhaps throw out <disfmarker>
speaker: A
text: That 's a good idea .
speaker: C
text: Wow , that 's a great idea .
speaker: F
text: Yeah .
speaker: F
text: But I think <disfmarker> I th Again , I think that sort of <disfmarker> that that would be good ,
speaker: F
text: and what that 'll do is just cut the time a little further .
speaker: B
text: Yeah .
speaker: D
text: Mm - hmm .
speaker: B
text: Yeah .
speaker: F
text: But I think none of this is stuff that really needs somebody doing these <disfmarker> these uh , uh , explicit markings .
speaker: D
text: Yeah .
speaker: C
text: Excellent .
speaker: C
text: Oh , I 'd be delighted with that ,
speaker: C
text: I <disfmarker> I was very impressed with the <disfmarker> with the result .
speaker: C
text: Yeah .
speaker: F
text: Yeah , cuz the other thing that was concerning me about it was that it seemed kind of specialized to the EDU meeting ,
speaker: F
text: and <disfmarker> and that then when you get a meeting like this or something ,
speaker: B
text: Yeah .
speaker: F
text: and <disfmarker> <vocalsound> and you have a b a bunch of different dominant speakers
speaker: C
text: Oh yeah ,
speaker: C
text: interesting .
speaker: F
text: you know , how are you gonna handle it .
speaker: F
text: Whereas this sounds like a more general solution
speaker: C
text: Oh yeah .
speaker: F
text: is <disfmarker>
speaker: C
text: Oh yeah ,
speaker: C
text: I pr I much prefer this ,
speaker: C
text: I was just trying to find a way <disfmarker>
speaker: F
text: Yeah .
speaker: C
text: Cuz I <disfmarker> I don't think the staggered mixed channel is awfully good as a way of handling overlaps .
speaker: F
text: Uh - huh .
speaker: C
text: But <disfmarker>
speaker: D
text: Well good .
speaker: C
text: but uh <disfmarker>
speaker: D
text: That <disfmarker> that really simplifies thing then .
speaker: C
text: Yeah .
speaker: D
text: And we can just , you know , get the meeting ,
speaker: D
text: process it ,
speaker: D
text: put the beeps file ,
speaker: D
text: send it off to IBM .
speaker: D
text: You know ?
speaker: C
text: Mm - hmm .
speaker: D
text: With very little <pause> work on our side .
speaker: B
text: Yeah .
speaker: B
text: Process it ,
speaker: B
text: hear into it .
speaker: B
text: I would <disfmarker>
speaker: D
text: Do what ?
speaker: B
text: Um , <pause> listen to it ,
speaker: B
text: and then <disfmarker>
speaker: A
text: Or at least sample it .
speaker: D
text: Well , sample it .
speaker: B
text: Yeah .
speaker: F
text: I <disfmarker> I would just use some samples ,
speaker: D
text: Sample it .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: F
text: make sure you don't send them three hours of " bzzz " <comment> or something .
speaker: B
text: Yeah .
speaker: D
text: Yeah .
speaker: D
text: Yeah .
speaker: B
text: No .
speaker: D
text: Right .
speaker: B
text: That won't be good .
speaker: D
text: Yeah .
speaker: C
text: Yeah .
speaker: D
text: Yeah that would be very good .
speaker: B
text: Yeah .
speaker: D
text: And then we can you know <disfmarker>
speaker: F
text: Yeah .
speaker: D
text: That 'll oughta be a good way to get the pipeline going .
speaker: C
text: Oh , I 'd be delighted .
speaker: C
text: Yeah .
speaker: B
text: And there 's <disfmarker> there 's one point which I <comment> uh <disfmarker> <vocalsound> yeah , which <disfmarker> which I r <vocalsound> we covered when I <disfmarker> when I r listened to one of the EDU meetings ,
speaker: F
text: Great .
speaker: B
text: and that 's <vocalsound> that somebody is playing sound from his laptop .
speaker: A
text: Uh - huh
speaker: B
text: And i <vocalsound> the speech - nonspeech detector just assigns randomly the speech to <disfmarker> to one of the channels ,
speaker: B
text: so .
speaker: B
text: Uh - I haven't - I didn't think of <disfmarker> of s of <vocalsound> this before ,
speaker: A
text: What can you do ?
speaker: B
text: but what <disfmarker> what shall we do about s things like this ?
speaker: C
text: Well you were suggesting <disfmarker> You suggested maybe just not sending that part of the meeting .
speaker: A
text: Yep . Mmm .
speaker: C
text: But <disfmarker>
speaker: B
text: But ,
speaker: B
text: sometimes the <disfmarker> <vocalsound> the <disfmarker> the laptop is in the background
speaker: B
text: and some <disfmarker> somebody is <disfmarker> is talking ,
speaker: B
text: and , <vocalsound> that 's really a little bit confusing ,
speaker: B
text: but <disfmarker>
speaker: F
text: That 's life .
speaker: A
text: It 's a little bit confusing .
speaker: B
text: Yeah .
speaker: A
text: I mean , <comment> what 're we gonna do ?
speaker: B
text: Yeah .
speaker: B
text: OK .
speaker: F
text: Yeah .
speaker: A
text: Even a hand - transcription would <disfmarker>
speaker: C
text: Do you <disfmarker>
speaker: A
text: a hand - transcriber would have trouble with that .
speaker: B
text: Yeah ,
speaker: B
text: that 's <disfmarker> that 's a second question ,
speaker: A
text: So .
speaker: B
text: " what <disfmarker> what will different transcribers do with <disfmarker> with the laptop sound ? "
speaker: F
text: What was the l what was the laptop sound ?
speaker: C
text: Would you <disfmarker> would <disfmarker>
speaker: C
text: Yeah , go ahead .
speaker: F
text: I mean was it speech ,
speaker: F
text: or was it <disfmarker>
speaker: B
text: Yeah .
speaker: B
text: It 's speech .
speaker: F
text: Great .
speaker: C
text: Well ,
speaker: C
text: so <disfmarker>
speaker: C
text: I mean <disfmarker>
speaker: C
text: So my standard approach has been if it 's not someone close - miked , then , they don't end up on one of the close - miked channels .
speaker: C
text: They end up on a different channel .
speaker: C
text: And we have any number of channels available ,
speaker: F
text: Uh - huh .
speaker: C
text: I mean it 's an infinite number of channels .
speaker: B
text: Yeah .
speaker: C
text: So just put them on some other channel .
speaker: B
text: But ,
speaker: B
text: when thi when this is sent to <disfmarker> to the I M - eh , I B M transcribers , I don't know if <disfmarker> if they can tell that 's really <disfmarker>
speaker: C
text: Yeah ,
speaker: C
text: that 's right .
speaker: A
text: Yeah cuz there will be no channel on which it is foreground .
speaker: B
text: Yeah .
speaker: B
text: Yeah .
speaker: C
text: Well , they have a convention , in their own procedures , <vocalsound> which is for a background <pause> sound .
speaker: A
text: Uh <disfmarker>
speaker: A
text: Right , but , uh , in general I don't think we want them transcribing the background ,
speaker: A
text: cuz that would be too much work .
speaker: B
text: Yeah .
speaker: A
text: Right ?
speaker: A
text: For it <disfmarker>
speaker: A
text: because in the overlap sections , then they 'll
speaker: D
text: Well I don't think Jane 's saying they 're gonna transcribe it ,
speaker: D
text: but they 'll just mark it as being <disfmarker> there 's some background stuff there ,
speaker: A
text: But that 's gonna be all over the place .
speaker: D
text: right ?
speaker: C
text: Yeah .
speaker: A
text: How w how will they tell the difference between that sort of background and the dormal <disfmarker> normal background of two people talking at once ?
speaker: B
text: Yeah .
speaker: C
text: Oh , I think <disfmarker> I think it 'd be easy to to say " background laptop " .
speaker: D
text: But wait a minute ,
speaker: A
text: How would they know that ?
speaker: D
text: why would they treat them differently ?
speaker: B
text: Yeah .
speaker: C
text: Well because one of them <disfmarker>
speaker: A
text: Because otherwise it 's gonna be too much work for them to mark it .
speaker: A
text: They 'll be marking it all over the place .
speaker: B
text: Yeah .
speaker: C
text: Oh , I s
speaker: C
text: background laptop or , background LT <vocalsound> <vocalsound> wouldn't take any time .
speaker: A
text: Sure ,
speaker: A
text: but how are they gonna tell bet the difference between that and two people just talking at the same time ?
speaker: C
text: And <disfmarker>
speaker: C
text: Oh , you can tell .
speaker: B
text: Yeah .
speaker: C
text: Acoustically , can't you tell ?
speaker: B
text: It 's really good sound ,
speaker: B
text: so <disfmarker>
speaker: C
text: Oh is it ?
speaker: C
text: Oh !
speaker: F
text: Well , I mean ,
speaker: F
text: isn't there a category something like uh , " sounds for someone for whom there is no i close mike " ?
speaker: B
text: Yeah that would be very important ,
speaker: C
text: Yeah .
speaker: A
text: But how do we d how do we do that for the I B M folks ?
speaker: B
text: yeah .
speaker: A
text: How can they tell that ?
speaker: D
text: Well we may just have to do it when it gets back here .
speaker: A
text: Yes ,
speaker: A
text: that 's my opinion as well .
speaker: B
text: Yeah .
speaker: A
text: So we don't do anything for it <disfmarker> with it .
speaker: C
text: OK .
speaker: D
text: Yeah .
speaker: C
text: That sounds good .
speaker: C
text: That sounds good .
speaker: D
text: Yeah .
speaker: A
text: And they 'll just mark it however they mark it ,
speaker: A
text: and we 'll correct it when it comes back .
speaker: B
text: So th
speaker: F
text: Yeah .
speaker: C
text: OK .
speaker: B
text: there was a category for @ @ <comment> speech .
speaker: A
text: Yeah ,
speaker: A
text: the default .
speaker: C
text: Yeah ,
speaker: C
text: s a
speaker: B
text: OK .
speaker: A
text: No , not default .
speaker: C
text: Well , as it comes back , we have a uh <disfmarker> when we can use the channelized interface for encoding it , then it 'll be easy for us to handle .
speaker: B
text: Yeah .
speaker: C
text: But <disfmarker> <vocalsound> but if <disfmarker> if out of context , they can't tell if it 's a channeled speak uh , you know , a close - miked speaker or not , <vocalsound> then that would be confusing to them .
speaker: B
text: OK .
speaker: A
text: Right .
speaker: B
text: OK .
speaker: C
text: I don't know ,
speaker: C
text: I <disfmarker> it doesn't <disfmarker>
speaker: C
text: I don't <disfmarker>
speaker: C
text: Either way would be fine with me ,
speaker: C
text: I don't really care .
speaker: F
text: Yeah .
speaker: F
text: So .
speaker: F
text: Shall we uh , do digits and get out of here ?
speaker: C
text: I have o I have one question .
speaker: A
text: Yep .
speaker: C
text: Do you think we should send the um <disfmarker> that whole meeting to them and not worry about pre - processing it ?
speaker: F
text: Yes ma '
speaker: C
text: Or <disfmarker>
speaker: C
text: Uh , what I mean is <vocalsound> we <disfmarker> we should <vocalsound> leave the <vocalsound> part with the audio in the uh , beep file that we send to IBM for that one ,
speaker: C
text: or should we <vocalsound> start after the <disfmarker> that part of the meeting is over
speaker: F
text: Which part ?
speaker: C
text: in what we send .
speaker: C
text: So , the part where they 're using sounds from their <disfmarker> from their laptops .
speaker: B
text: With <disfmarker>
speaker: B
text: with the laptop sound ,
speaker: B
text: or <disfmarker> ?
speaker: C
text: w If we have speech from the laptop should we just uh , excise that from what we send to IBM ,
speaker: B
text: just <disfmarker>
speaker: C
text: or should we <vocalsound> i give it to them and let them do with it what they can ?
speaker: D
text: I think we should just <disfmarker>
speaker: D
text: it <disfmarker> it 's gonna be too much work if we hafta <vocalsound> worry about that I think .
speaker: C
text: OK ,
speaker: C
text: that 'd be nice to have a <disfmarker> a uniform procedure .
speaker: D
text: Yeah , I think if we just <disfmarker> m send it all to them .
speaker: D
text: you know .
speaker: C
text: Good .
speaker: A
text: Worry about it when we get back .
speaker: D
text: Let <disfmarker>
speaker: C
text: And see how well they do .
speaker: D
text: Yeah , worry about it when we get back in .
speaker: F
text: Yeah .
speaker: C
text: And give them freedom to <disfmarker> <vocalsound> to indicate if it 's just not workable .
speaker: D
text: Yeah .
speaker: C
text: Yeah ,
speaker: F
text: Yeah .
speaker: C
text: OK ,
speaker: F
text: Cuz , I wouldn't <disfmarker> don't think we would mind <pause> having that <pause> transcribed , if they did it .
speaker: C
text: excellent .
speaker: A
text: I think <disfmarker>
speaker: C
text: Yeah ,
speaker: A
text: As I say , we 'll just have to listen to it and see how horrible it is .
speaker: D
text: Yeah , e
speaker: C
text: yeah .
speaker: B
text: Yeah .
speaker: C
text: OK .
speaker: A
text: Sample it , rather .
speaker: C
text: Alright .
speaker: D
text: Yeah .
speaker: B
text: I think that <disfmarker> that will be a little bit of a problem
speaker: C
text: That 's great .
speaker: B
text: as it really switches around between <vocalsound> two different channels , I think .
speaker: A
text: Mm - hmm ,
speaker: B
text: What <disfmarker> what I would <disfmarker>
speaker: A
text: and <disfmarker> and they 're very <disfmarker> it 's very audible ? on the close - talking channels ?
speaker: B
text: Yeah .
speaker: A
text: Oh well .
speaker: F
text: Yeah .
speaker: A
text: I mean , it 's the same problem as the lapel mike .
speaker: B
text: Yeah .
speaker: A
text: But <disfmarker>
speaker: C
text: Oh , interesting .
speaker: B
text: Comparable ,
speaker: B
text: yeah .
speaker: F
text: Yeah .
speaker: C
text: OK ,
speaker: C
text: alright .
speaker: B
text: OK .
speaker: F
text: Let 's do digits .
speaker: C
text: Digits .
speaker: C
text: OK , so we read the transcript number first ,
speaker: C
text: right ?
speaker: A
text: Are we gonna do it altogether or separately ?
speaker: B
text: So <disfmarker>
speaker: B
text: What time is it ?
speaker: F
text: Uh , <vocalsound> why don't we do it together ,
speaker: C
text: Uh , quarter to four .
speaker: B
text: Oh , OK .
speaker: F
text: that 's <disfmarker> that 's a nice fast way to do it .
speaker: C
text: Mm - hmm .
speaker: F
text: One , two , three ,
speaker: F
text: go !
speaker: C
text: It 's kind of interesting if there 're any more errors in these , <vocalsound> than we had the first set .
speaker: A
text: Nnn , yeah ,
speaker: A
text: I think there probably will be .
speaker: B
text: Yeah .
speaker: D
text: Do you guys plug your ears when you do it ?
speaker: A
text: I do .
speaker: B
text: No .
speaker: C
text: I usually do .
speaker: D
text: I do .
speaker: C
text: I didn't this time .
speaker: B
text: I don't .
speaker: D
text: You don't ?
speaker: F
text: I haven't been ,
speaker: B
text: No .
speaker: D
text: How can you do that ?
speaker: F
text: no .
speaker: D
text: I <disfmarker> I <disfmarker>
speaker: F
text: Uh , concentration .
speaker: B
text: Perhaps there are <vocalsound> lots of errors in it
speaker: D
text: Gah !
speaker: D
text: You hate to have your ears plugged ?
speaker: A
text: Total concentration . Are you guys ready ?
speaker: F
text: Yeah .
speaker: D
text: Really ?

Meeting summary:
text: The main topics of the agenda were a paper submitted to Eurospeech and the organising of the recording transcriptions to be done by IBM.
text: The results presented in the former show a significant percentage of overlapping speech even without counting in backchanneling.
text: Additionally, the high error rate in the recognition of such overlapping speech by the SRI recogniser was minimised simply by changing the scoring method used.
text: Finally, a strong correlation between pauses and interruptions was confirmed.
text: All these measurements were based on the sample of available transcripts.
text: Other features, like prosody, will be studied in the near future.
text: An FTP directory containing such experimental data is being set up for the benefit of other researchers.
text: Regarding the transcriptions to be carried out by IBM, the discussion mainly concerned the format of the recordings that should be sent to them.
text: Suggestions included sending only the channels with the dominant speakers for transcription, but it was finally agreed on sending the original files with minimal modifications, as there will be extensive in-house post-processing.
text: Within this discussion, the rationale behind the coding of the time bins according to the flow of discourse was also explained.
text: The files made available in the FTP directory will be the original ones (before down-sampling), as these seem to be wanted by other parties.
text: Moreover, as files may have been modified through different processing, tests will be carried out in order to ensure the generation of beep files in a consistent way.
text: Also towards this goal, some of the time bins will need to be merged.
text: On the other hand, the two meetings where time bins have been hand-coded in detail will be used to fine-tune the forced alignments.
text: Recordings will be sent to IBM for transcription.
text: Before that, the files will be automatically pre-segmented into speech/non-speech bins and the beeps will be inserted.
text: In order to make things easier for the transcribers, breathy channels, which are erroneously marked as speech, will be re-classified correctly with other methods.
text: All this pre-processing will have to be evaluated first by checking a sample of the output files.
text: Other issues, like whether and how synthesised speech off a laptop needs be transcribed, will be resolved during the in-house post-processing of the transcriptions.
text: There is a slight worry about the acceptance of the paper submitted to Eurospeech as the deadline was exceeded.
text: As to the content of the paper, the overlap statistics have not been normalised against the number of participants in the conversation, although the dependency is probably going to be a weak one.
text: Additionally, the correlation between pauses in speech and interruptions does not provide a cause-and-effect link for these phenomena.
text: The preparation of files for transcription by IBM is facing some minor difficulties, as some features (hand-coded time boundaries, multiplicity of channels etc) may complicate the generation of beep files.
text: Besides this, the automatic pre-segmentation has been deemed to be good, but there are still no specific measurements to verify this.
text: The pre-segmentation tool also classifies synthesised speech used in a recording as "normal speech" and assigns a random channel to it.
text: The transcribers at IBM may not be able to differentiate between the two.
text: A paper has been submitted to Eurospeech, which also includes a section on new corpora.
text: The statistics in the paper are based on the transcripts of two meeting and two telephone conversation corpora.
text: In the first two, the overlapped words vary between 9% and 18%.
text: The telephone conversation results were in-between and very similar to each other.
text: On the other hand, the automatic recognition errors affected by overlaps were reduced dramatically by focusing on regions with the foreground speech.
text: Furthermore, it was shown that after spurts, backchannels, disfluencies and discourse markers, the likelihood of interruption by other speakers was much higher.
text: Files with the recordings, as well as some experimental data will be available for other researchers in an FTP directory that is being set up.
text: Parts of the recordings will have to be beeped out by a script that has already been developed.
text: Finally, EDU meetings already recorded have now been pre-segmented and assigned to the transcribers at ICSI.