Meeting transcript:
speaker: C
text: So , uh <disfmarker>
speaker: B
text: Alright .
speaker: F
text: Um , so I wanted to discuss digits briefly , but that won't take too long .
speaker: C
text: Oh good .
speaker: C
text: Right .
speaker: C
text: OK , agenda items ,
speaker: C
text: Uh , we have digits ,
speaker: C
text: What else we got ?
speaker: A
text: New version of the presegmentation .
speaker: C
text: New version of presegmentation .
speaker: B
text: Um , do we wanna say something about the , an update of the , uh , transcript ?
speaker: G
text: Yeah , why don't you summarize the <disfmarker>
speaker: C
text: Update on transcripts .
speaker: G
text: And I guess that includes some <disfmarker> the filtering for the , the ASI refs , too .
speaker: B
text: Mmm .
speaker: C
text: Filtering for what ?
speaker: G
text: For the references that we need to go from the <disfmarker> the <pause> fancy transcripts to the sort of <nonvocalsound> brain - dead .
speaker: B
text: It 'll <disfmarker> it 'll be <disfmarker> basically it 'll be a re - cap of a meeting that we had jointly this morning .
speaker: C
text: Uh - huh .
speaker: G
text: With Don , as well .
speaker: B
text: Mm - hmm .
speaker: C
text: Got it .
speaker: C
text: Anything else more pressing than those things ?
speaker: C
text: So <disfmarker> So , why don't we just do those .
speaker: C
text: You said yours was brief , so <disfmarker>
speaker: F
text: OK .
speaker: F
text: OK well , the , w uh as you can see from the numbers on the digits we 're almost done .
speaker: F
text: The digits goes up to <pause> about four thousand .
speaker: F
text: Um , and so , uh , we probably will be done with the TI - digits in , um , another couple weeks . um , depending on how many we read each time .
speaker: F
text: So there were a bunch that we skipped .
speaker: F
text: You know , someone fills out the form and then they 're not at the meeting and so it 's blank .
speaker: F
text: Um , but those are almost all filled in as well .
speaker: F
text: And so , once we 're <disfmarker> it 's done it would be very nice to train up a recognizer and actually start working with this data .
speaker: D
text: So we 'll have a corpus that 's the size of TI - digits ?
speaker: F
text: And so <disfmarker>
speaker: F
text: One particular test set of TI - digits .
speaker: D
text: Test set , OK .
speaker: F
text: So , I <disfmarker> I extracted , Ther - there was a file sitting around which people have used here as a test set .
speaker: F
text: It had been randomized and so on
speaker: F
text: and that 's just what I used to generate the order . of these particular ones .
speaker: D
text: Oh ! Great .
speaker: D
text: Great .
speaker: F
text: Um <disfmarker>
speaker: C
text: So , I 'm impressed by what we could do , Is take the standard training set for TI - digits , train up with whatever , you know , great features we think we have , uh for instance , and then test on uh this test set .
speaker: C
text: And presumably uh it should do reasonably well on that ,
speaker: C
text: and then , presumably , we should go to the distant mike , and it should do poorly .
speaker: D
text: Yeah .
speaker: F
text: Right .
speaker: C
text: And then we should get really smart over the next year or two , and it <disfmarker> that should get better .
speaker: F
text: And inc increase it by one or two percent , yeah .
speaker: C
text: Yeah , <vocalsound> Yeah .
speaker: F
text: Um , but , in order to do that we need to extract out the actual digits .
speaker: C
text: Right .
speaker: F
text: Um , so that <disfmarker> the reason it 's not just a transcript is that there 're false starts , and misreads , and miscues and things like that .
speaker: F
text: And so I have a set of scripts and X Waves where you just select the portion , hit R ,
speaker: F
text: um , it tells you what the next one should be , and you just look for that .
speaker: F
text: You know , so it <disfmarker> it 'll put on the screen , " The next set is six nine , nine two two " .
speaker: F
text: And you find that , and , hit the key and it records it in a file in a particular format .
speaker: C
text: So is this <disfmarker>
speaker: F
text: And so the <disfmarker> the question is , should we have the transcribers do that or should we just do it ?
speaker: F
text: Well , some of us .
speaker: F
text: I 've been do I 've done , eight meetings , something like that , just by hand .
speaker: F
text: Just myself , rather .
speaker: F
text: So it will not take long .
speaker: F
text: Um <disfmarker>
speaker: C
text: Uh , what <disfmarker> what do you think ?
speaker: B
text: My feeling is that
speaker: B
text: we discussed this right before coffee
speaker: B
text: and I think it 's a <disfmarker> it 's a fine idea partly because , um , it 's not un unrelated to their present skill set ,
speaker: B
text: but it will add , for them , an extra dimension , it might be an interesting break for them .
speaker: B
text: And also it is contributing to the , uh , c composition of the transcript
speaker: B
text: cuz we can incorporate those numbers directly and it 'll be a more complete transcript .
speaker: B
text: So I 'm <disfmarker> I think it 's fine , that part .
speaker: F
text: There is <disfmarker> there is <disfmarker>
speaker: C
text: So you think it 's fine to have the transcribers do it ?
speaker: B
text: Mm - hmm .
speaker: C
text: Yeah , OK .
speaker: F
text: There 's one other small bit , which is just entering the information which at s which is at the top of this form , onto the computer , to go along with the <disfmarker> where the digits are recorded automatically .
speaker: D
text: Good .
speaker: C
text: Yeah .
speaker: F
text: And so it 's just , you know , typing in name , times <disfmarker> time , date , and so on .
speaker: F
text: Um , which again either they can do , but it is , you know , firing up an editor , or , again , I can do .
speaker: F
text: Or someone else can do .
speaker: B
text: And , that , you know , I 'm not , that <disfmarker> that one I 'm not so sure if it 's into the <disfmarker> the , things that , I , wanted to use the hours for ,
speaker: B
text: because the , the time that they 'd be spending doing that they wouldn't be able to be putting more words on .
speaker: C
text: Mmm .
speaker: B
text: But that 's really your choice , it 's your <disfmarker>
speaker: D
text: So are these two separate tasks that can happen ?
speaker: D
text: Or do they have to happen at the same time before <disfmarker>
speaker: F
text: No they don't have <disfmarker> this <disfmarker> you have to enter the data before , you do the second task , but they don't have to happen at the same time .
speaker: F
text: So it 's <disfmarker> it 's just I have a file whi which has this information on it , and then when you start using my scripts , for extracting the times , it adds the times at the bottom of the file .
speaker: D
text: OK .
speaker: F
text: And so , um , I mean , it 's easy to create the files and leave them blank , and so actually we could do it in either order .
speaker: D
text: Oh , OK .
speaker: F
text: Um , it 's <disfmarker> it 's sort of nice to have the same person do it just as a double - check , to make sure you 're entering for the right person .
speaker: F
text: But , either way .
speaker: C
text: Yeah .
speaker: C
text: Yeah just by way of uh , uh , a uh , order of magnitude , uh , um , we 've been working with this Aurora , uh data set .
speaker: C
text: And , uh , the best score , on the , nicest part of the data , that is , where you 've got training and test set that are basically the same kinds of noise and so forth , uh , is about ,
speaker: C
text: uh <disfmarker>
speaker: C
text: I think the best score was something like five percent , uh , error , per digit .
speaker: C
text: So , that <disfmarker>
speaker: F
text: Per digit .
speaker: A
text: Per digit .
speaker: C
text: You 're right .
speaker: C
text: So if you were doing <pause> ten digit , uh , recognition , <vocalsound> you would really be in trouble .
speaker: D
text: Mm - hmm .
speaker: C
text: So <disfmarker> So the <disfmarker> The point there , and this is uh car noise uh , uh things , but <disfmarker> but real <disfmarker> real situation ,
speaker: C
text: well , " real " ,
speaker: C
text: Um , the <disfmarker> uh there 's one microphone that 's close , that they have as <disfmarker> as this sort of thing , close versus distant .
speaker: C
text: Uh but in a car ,
speaker: C
text: instead of <disfmarker> instead of having a projector noise it 's <disfmarker> it 's car noise .
speaker: C
text: Uh but it wasn't artificially added to get some <disfmarker> some artificial signal - to - noise ratio .
speaker: C
text: It was just people driving around in a car .
speaker: C
text: So , that 's <disfmarker> that 's an indication ,
speaker: C
text: uh that was with , many sites competing , and this was the very best score and so forth ,
speaker: C
text: so . More typical numbers like
speaker: D
text: Although the models weren't , that good ,
speaker: D
text: right ?
speaker: D
text: I mean , the models are pretty crappy ?
speaker: C
text: You 're right .
speaker: C
text: I think that we could have done better on the models ,
speaker: C
text: but the thing is that we got <disfmarker> this <disfmarker> this is the kind of typical number , for all of the , uh , uh , things in this task , all of the , um , languages .
speaker: C
text: And so I <disfmarker> I think we 'd probably <disfmarker> the models would be better in some than in others .
speaker: D
text: Hmm .
speaker: C
text: Um , so , uh . Anyway , just an indication once you get into this kind of realm even if you 're looking at connected digits it can be pretty hard .
speaker: B
text: Hmm .
speaker: B
text: It 's gonna be fun to see how we , compare at this .
speaker: C
text: Yeah .
speaker: D
text: How did we do on the TI - digits ?
speaker: B
text: Very exciting . s @ @ .
speaker: F
text: Well the prosodics are so much different
speaker: F
text: s it 's gonna be , strange .
speaker: F
text: I mean the prosodics are not the same as TI - digits , for example .
speaker: C
text: Yeah .
speaker: F
text: So I 'm <disfmarker> I 'm not sure how much of effect that will have .
speaker: G
text: What do you mean , the prosodics ?
speaker: D
text: H how do <disfmarker>
speaker: F
text: Um , just what we were talking about with grouping .
speaker: F
text: That with these , the grouping , there 's no grouping at all , and so it 's just <disfmarker> the only sort of discontinuity you have is at the beginning and the end .
speaker: G
text: So what are they doing in Aurora ,
speaker: G
text: are they reading actual phone numbers ,
speaker: F
text: Aurora I don't know .
speaker: F
text: I don't know what they do in Aurora .
speaker: G
text: or , a <disfmarker> a digit at a time , or <disfmarker> ?
speaker: C
text: Uh , I 'm not sure how <disfmarker>
speaker: G
text: Cuz it 's <disfmarker>
speaker: C
text: no , no I mean it 's connected <disfmarker> it 's connected , uh , digits ,
speaker: G
text: Connected .
speaker: C
text: yeah .
speaker: G
text: So there 's also the <disfmarker> not just the prosody but the cross <disfmarker> the cross - word modeling is probably quite different .
speaker: C
text: But .
speaker: F
text: But <disfmarker> Right .
speaker: F
text: But in TI - digits , they 're reading things like zip codes and phone numbers and things like that ,
speaker: D
text: H How
speaker: G
text: Right .
speaker: F
text: so it 's gonna be different .
speaker: D
text: do we do on TI - digits ?
speaker: F
text: I don't remember .
speaker: F
text: I mean , very good ,
speaker: F
text: right ?
speaker: C
text: Yeah , I mean we were in the .
speaker: F
text: One and a half percent , two percent , something like that ?
speaker: C
text: Uh , I th no I think we got under a percent ,
speaker: F
text: Oh really ?
speaker: C
text: but it was <disfmarker> but it 's <disfmarker> but I mean . The very best system that I saw in the literature was a point two five percent or something that somebody had at <disfmarker> at Bell Labs , or . Uh , but . But , uh , sort of pulling out all the stops .
speaker: F
text: OK .
speaker: B
text: s @ @ . It s strikes me that there are more <disfmarker> each of them is more informative because it 's so , random ,
speaker: F
text: Alright .
speaker: D
text: Hmm .
speaker: C
text: But I think a lot of systems sort of get half a percent , or three - quarters a percent ,
speaker: F
text: Right .
speaker: C
text: and we 're <disfmarker> we 're in there somewhere .
speaker: F
text: But that <disfmarker> I mean it 's really <disfmarker> it 's <disfmarker> it 's close - talking mikes , no noise , clean signal , just digits , I mean , every everything is good .
speaker: C
text: Yeah .
speaker: G
text: It 's the beginning of time in speech recognition .
speaker: F
text: Yes , exactly .
speaker: C
text: Yeah .
speaker: F
text: And we 've only recently got it to anywhere near human .
speaker: G
text: It 's like the , single cell , you know , it 's the beginning of life ,
speaker: D
text: Pre - prehistory .
speaker: G
text: yeah .
speaker: F
text: And it 's still like an order of magnitude worse than what humans do .
speaker: G
text: Right .
speaker: C
text: Yeah .
speaker: F
text: So .
speaker: C
text: When <disfmarker> When they 're wide awake , yeah .
speaker: F
text: Yeah .
speaker: C
text: Um ,
speaker: F
text: After coffee .
speaker: C
text: after coffee , you 're right .
speaker: C
text: Not after lunch .
speaker: F
text: OK , so , um , what I 'll do then is I 'll go ahead and enter , this data .
speaker: F
text: And then , hand off to Jane , and the transcribers to do the actual extraction of the digits .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: C
text: One question I have that <disfmarker> that I mean , we wouldn't know the answer to now but might , do some guessing , but I was talking before about doing some model modeling of arti uh , uh , marking of articulatory , features , with overlap and so on .
speaker: F
text: Hmm .
speaker: C
text: And , and , um ,
speaker: C
text: On some subset .
speaker: C
text: One thought might be to do this uh , on <disfmarker> on the digits , or some piece of the digits .
speaker: C
text: Uh , it 'd be easier , uh , and so forth .
speaker: C
text: The only thing is I 'm a little concerned that maybe the kind of phenomena , in w i i
speaker: C
text: The reason for doing it is because the <disfmarker> the argument is that certainly with conversational speech , the stuff that we 've looked at here before , um , just doing the simple mapping , from , um , the phone , to the corresponding features that you could look up in a book , uh , isn't right .
speaker: C
text: It isn't actually right .
speaker: C
text: In fact there 's these overlapping processes where some voicing some up and then some , you know , some nasality is <disfmarker> comes in here , and so forth .
speaker: C
text: And you do this gross thing saying " Well I guess it 's this phone starting there " .
speaker: C
text: So , uh , that 's the reasoning .
speaker: C
text: But , It could be that when we 're reading digits , because it 's <disfmarker> it 's for such a limited set , that maybe <disfmarker> maybe that phenomenon doesn't occur as much .
speaker: C
text: I don't know .
speaker: C
text: Di - an anybody <disfmarker> ? <pause> Do you have any <disfmarker> ? <pause> Anybody have any opinion about that ,
speaker: B
text: and that people might articulate more ,
speaker: B
text: and you that might end up with more <disfmarker> a closer correspondence .
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: F
text: Yeah <disfmarker> that 's <disfmarker> I <disfmarker> I agree .
speaker: F
text: That <disfmarker> it 's just <disfmarker>
speaker: D
text: Sort of less predictability ,
speaker: D
text: and <disfmarker> You hafta <disfmarker>
speaker: B
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: G
text: Well it 's definitely true that , when people are , reading , even if they 're re - reading what , they had said spontaneously , that they have very different patterns .
speaker: F
text: It 's a <disfmarker> Well <disfmarker> Would , this corpus really be the right one to even try that on ?
speaker: G
text: Mitch showed that , and some , dissertations have shown that .
speaker: C
text: Right .
speaker: G
text: So the fact that they 're reading , first of all , whether they 're reading in a room of , people , or rea you know , just the fact that they 're reading will make a difference .
speaker: C
text: Yeah .
speaker: G
text: And , depends what you 're interested in .
speaker: C
text: See , I don't know .
speaker: C
text: So , may maybe the thing will be do <disfmarker> to take some very small subset , I mean not have a big , program , but take a small set , uh , subset of the conversational speech and a small subset of the digits ,
speaker: C
text: and <pause> look and <disfmarker> and just get a feeling for it .
speaker: C
text: Um , just take a look . Really .
speaker: B
text: H That could <disfmarker> could be an interesting design , too , cuz then you 'd have the com the comparison of the , uh , predictable speech versus the less predictable speech
speaker: C
text: Cuz I don't think anybody is , I at least , I don't know , of anybody , uh ,
speaker: C
text: well , I don't know , <vocalsound> the answers .
speaker: D
text: Hey .
speaker: C
text: Yeah .
speaker: B
text: and maybe you 'd find that it worked in , in the , case of the pr of the , uh , non - predictable .
speaker: C
text: Yeah .
speaker: D
text: Hafta think about , the particular acoustic features to mark , too , because , I mean , some things , they wouldn't be able to mark , like , uh , you know , uh , tense lax .
speaker: C
text: Mm - hmm .
speaker: D
text: Some things are really difficult .
speaker: D
text: You know ,
speaker: D
text: just listening .
speaker: F
text: M I think we can get Ohala in to , give us some advice on that .
speaker: B
text: Well .
speaker: D
text: Yeah .
speaker: B
text: Also I thought you were thinking of a much more restricted set of features , that <disfmarker>
speaker: C
text: Yeah , but I <disfmarker> I <disfmarker> I <disfmarker> I was , like he said , <vocalsound> I was gonna bring John in and ask John what he thought .
speaker: B
text: Yeah , sure .
speaker: B
text: Sure .
speaker: B
text: Yeah .
speaker: C
text: Right .
speaker: C
text: But I mean you want <disfmarker> you want it be restrictive but you also want it to <disfmarker> to <disfmarker> to have coverage .
speaker: F
text: Right .
speaker: C
text: You know i you should . It should be such that if you , if you , uh , if you had o um , all of the features , determined that you <disfmarker> that you were uh ch have chosen , that that would tell you , uh , in the steady - state case , uh , the phone .
speaker: B
text: Yeah
speaker: C
text: So , um .
speaker: B
text: OK .
speaker: F
text: Even , I guess with vowels that would be pretty hard ,
speaker: F
text: wouldn't it ?
speaker: F
text: To identify actually , you know , which one it is ?
speaker: B
text: It would seem to me that the points of articulation would be m more , g
speaker: B
text: uh , I mean that 's <disfmarker> I think about articulatory features , I think about , points of articulation , which means , uh , rather than vowels .
speaker: F
text: Yeah .
speaker: D
text: Points of articulation ?
speaker: D
text: What do you mean ?
speaker: B
text: So , is it , uh , bilabial or dental or is it , you know , palatal .
speaker: C
text: Mm - hmm .
speaker: B
text: Which <disfmarker> which are all like where <disfmarker> where your tongue comes to rest .
speaker: F
text: Uvular .
speaker: D
text: Place of ar place of articulation .
speaker: C
text: Place , place .
speaker: B
text: Place .
speaker: C
text: Yeah .
speaker: A
text: Place .
speaker: B
text: Thank you , what <disfmarker> whatev whatever I s said , that 's <disfmarker>
speaker: D
text: OK .
speaker: C
text: Yeah .
speaker: B
text: I really meant place .
speaker: D
text: OK , I see .
speaker: C
text: Yeah .
speaker: C
text: OK we got our jargon then , OK .
speaker: B
text: Yeah .
speaker: C
text: Uh .
speaker: G
text: Well it 's also , there 's , really a difference between , the pronunciation models in the dictionary , and , the pronunciations that people produce .
speaker: G
text: And , so , You get , some of that information from Steve 's work on the <disfmarker> on the labeling
speaker: C
text: Right .
speaker: F
text: Right .
speaker: G
text: and it really ,
speaker: G
text: I actually think that data should be used more .
speaker: G
text: That maybe , although I think the meeting context is great , that he has transcriptions that give you the actual phone sequence .
speaker: G
text: And you can go from <disfmarker> not from that to the articulatory features , but that would be a better starting point for marking , the gestural features , then , data where you don't have that ,
speaker: G
text: because , we <disfmarker> you wanna know , both about the way that they 're producing a certain sound , and what kinds of , you know what kinds of , phonemic , differences you get between these , transcribed , sequences and the dictionary ones .
speaker: C
text: Well you might be right that mi might be the way at getting at , what I was talking about ,
speaker: C
text: but the particular reason why I was interested in doing that was because I remember , when that happened , and , John Ohala was over here and he was looking at the spectrograms of the more difficult ones .
speaker: C
text: Uh , he didn't know what to say , about , what is the sequence of phones there .
speaker: C
text: They came up with some compromise .
speaker: C
text: Because that really wasn't what it look like .
speaker: G
text: Right .
speaker: C
text: It didn't look like a sequence of phones
speaker: F
text: Right .
speaker: C
text: it look like this blending thing happening here and here and here .
speaker: G
text: Right .
speaker: F
text: Yeah , so you have this feature here , and , overlap , yeah .
speaker: D
text: There was no name for that .
speaker: C
text: Yeah .
speaker: G
text: But <disfmarker> Right .
speaker: C
text: Yeah .
speaker: G
text: But it still is <disfmarker> there 's a <disfmarker> there are two steps .
speaker: G
text: One <disfmarker> you know , one is going from a dictionary pronunciation of something , like , " gonna see you tomorrow " ,
speaker: F
text: And <disfmarker> Or " gonta " .
speaker: C
text: Right .
speaker: C
text: Yeah .
speaker: G
text: it could be " going to " or " gonna " or " gonta s " you know .
speaker: C
text: Right .
speaker: G
text: And , yeah .
speaker: G
text: " Gonna see you tomorrow " , uh , " guh see you tomorrow " .
speaker: G
text: And , that it would be nice to have these , intermediate , or these <disfmarker> some <disfmarker> these reduced pronunciations that those transcribers had marked or to have people mark those as well .
speaker: C
text: Mm - hmm .
speaker: G
text: Because , it 's not , um , that easy to go from the , dictionary , word pronuncia the dictionary phone pronunciation , to the gestural one without this intermediate or a syllable level kind of , representation .
speaker: F
text: Well I don't think Morgan 's suggesting that we do that , though .
speaker: C
text: Do you mean ,
speaker: A
text: Yeah .
speaker: C
text: Yeah , I mean , I I I 'm jus at the moment of course we 're just talking about what , to provide as a tool for people to do research who have different ideas about how to do it .
speaker: C
text: So for instance , you might have someone who just has a wor has words with states , and has uh <disfmarker> uh , comes from articulatory gestures to that .
speaker: C
text: And someone else , might actually want some phonetic uh intermediate thing .
speaker: C
text: So I think it would be <disfmarker> be best to have all of it if we could .
speaker: C
text: But <pause> um ,
speaker: F
text: But <disfmarker> What I 'm imagining is a score - like notation , where each line is a particular feature .
speaker: C
text: Yeah .
speaker: F
text: Right ,
speaker: F
text: so you would say , you know , it 's voiced through here , and so you have label here , and you have nas nasal here ,
speaker: C
text: Yeah .
speaker: F
text: and , they <disfmarker> they could be overlapping in all sorts of bizarre ways that don't correspond to the timing on phones .
speaker: C
text: I mean this is the kind of reason why <disfmarker>
speaker: C
text: I remember when at one of the Switchboard , workshops , that uh when we talked about doing the transcription project , Dave Talkin said , " can't be done " .
speaker: F
text: Right .
speaker: C
text: He was <disfmarker> he was , what <disfmarker> what he meant was that this isn't , you know , a sequence of phones ,
speaker: C
text: and when you actually look at Switchboard that 's , not what you see , and , you know . And . It ,
speaker: F
text: And in <disfmarker> in fact the inter - annotator agreement was not that good ,
speaker: F
text: right ?
speaker: F
text: On the harder ones ?
speaker: C
text: yeah I mean it was
speaker: G
text: It depends how you look at it , and
speaker: G
text: I <disfmarker> I understand what you 're saying about this , kind of transcription exactly ,
speaker: C
text: Yeah .
speaker: G
text: because I 've seen <disfmarker> you know , where does the voicing bar start and so forth .
speaker: C
text: Yeah .
speaker: G
text: All I 'm saying is that , it is useful to have that <disfmarker> the transcription of what was really said , and which syllables were reduced .
speaker: G
text: Uh , if you 're gonna add the features
speaker: G
text: it 's also useful to have some level of representation which is , is a reduced <disfmarker> it 's a pronunciation variant , that currently the dictionaries don't give you
speaker: C
text: Mm - hmm .
speaker: G
text: because if you add them to the dictionary and you run recognition , you , you add confusion .
speaker: C
text: Right .
speaker: G
text: So people purposely don't add them .
speaker: C
text: Right .
speaker: G
text: So it 's useful to know which variant was <disfmarker> was produced , at least at the phone level .
speaker: D
text: So it would be <disfmarker> it would be great if we had , either these kind of , labelings on , the same portion of Switchboard that Steve marked , or , Steve 's type markings on this data , with these .
speaker: G
text: Right .
speaker: G
text: That 's all , I mean .
speaker: G
text: Exactly .
speaker: C
text: Yeah .
speaker: G
text: Exactly .
speaker: C
text: Yeah , no I <disfmarker> I don't disagree with that .
speaker: G
text: And Steve 's type is fairly <disfmarker> it 's not that slow ,
speaker: G
text: uh , uh ,
speaker: G
text: I dunno exactly what the , timing was , but .
speaker: C
text: Yeah u I don't disagree with it
speaker: C
text: the on the only thing is that , What you actually will end <disfmarker> en end up with is something ,
speaker: C
text: i it 's all compromised ,
speaker: C
text: right ,
speaker: C
text: so , the string that you end up with isn't , actually , what happened .
speaker: C
text: But it 's <disfmarker> it 's the best compromise that a group of people scratching their heads could come up with to describe what happened .
speaker: G
text: Mm - hmm .
speaker: D
text: And it 's more accurate than , phone labels .
speaker: C
text: But . And it 's more accurate than the <disfmarker> than the dictionary or , if you 've got a pronunciation uh lexicon that has three or four ,
speaker: F
text: The word .
speaker: D
text: Yeah .
speaker: C
text: this might be have been the fifth one that you tr that you pruned or whatever ,
speaker: D
text: So it 's like a continuum .
speaker: G
text: Right .
speaker: G
text: Right .
speaker: D
text: It 's <disfmarker> you 're going all the way down ,
speaker: C
text: so sure .
speaker: G
text: Right .
speaker: G
text: That 's what I meant is <disfmarker>
speaker: D
text: yeah .
speaker: C
text: Yeah .
speaker: G
text: an and in some places it would fill in , So <disfmarker> the kinds of gestural features are not everywhere .
speaker: C
text: Yeah .
speaker: F
text: Well <disfmarker>
speaker: D
text: Right .
speaker: G
text: So there are some things that you don't have access to either from your ear or the spectrogram ,
speaker: D
text: Mm - hmm .
speaker: G
text: but you know what phone it was and that 's about all you can <disfmarker> all you can say .
speaker: D
text: Right .
speaker: G
text: And then there are other cases where , nasality , voicing <disfmarker>
speaker: D
text: It 's basically just having , multiple levels of <disfmarker> of , information and marking , on the signal .
speaker: G
text: Right .
speaker: G
text: Right .
speaker: C
text: Yeah .
speaker: G
text: Right .
speaker: F
text: Well the other difference is that the <disfmarker> the features , are not synchronous ,
speaker: F
text: right .
speaker: F
text: They overlap each other in weird ways .
speaker: D
text: Mm - hmm .
speaker: D
text: Mm - hmm .
speaker: F
text: So it 's not a strictly one - dimensional signal .
speaker: C
text: Right .
speaker: F
text: So I think that 's sorta qualitatively different .
speaker: G
text: Right .
speaker: G
text: You can add the features in , uh , but it 'll be underspecified .
speaker: B
text: Hmm .
speaker: G
text: Th - there 'll be no way for you to actually mark what was said completely by features .
speaker: F
text: Well not with our current system but you could imagine designing a system , that the states were features , rather than phones .
speaker: G
text: And i if you 're <disfmarker>
speaker: G
text: Well , we <disfmarker> we 've probably have a <vocalsound> separate , um , discussion of , uh <disfmarker> of whether you can do that .
speaker: B
text: That 's <disfmarker> Well , <pause> isn't that <disfmarker> I thought that was , well but that <disfmarker> wasn't that kinda the direction ?
speaker: F
text: Yeah .
speaker: B
text: I thought
speaker: C
text: Yeah , so I mean , what , what <disfmarker> where this is , I mean , I I want would like to have something that 's useful to people other than those who are doing the specific kind of research I have in mind ,
speaker: C
text: so it should be something broader .
speaker: C
text: But , The <disfmarker> but uh where I 'm coming from is , uh , we 're coming off of stuff that Larry Saul did with <disfmarker> with , um , uh , John Dalan and Muzim Rahim in which , uh , they , uh , have , um , a m a multi - band system that is , uh , trained through a combination of gradient learning an and EM , to <pause> um , estimate , uh , <vocalsound> the , uh , value for m for <disfmarker> for a particular feature .
speaker: C
text: OK .
speaker: C
text: And this is part of a larger , image that John Dalan has about how the human brain does it in which he 's sort of imagining that , individual frequency channels are coming up with their own estimate , of <disfmarker> of these , these kinds of <disfmarker> something like this .
speaker: C
text: Might not be , you know , exact features that , Jakobson thought of or something .
speaker: C
text: But I mean you know some , something like that .
speaker: C
text: Some kind of low - level features , which are not , fully , you know , phone classification .
speaker: C
text: And the <disfmarker> the <disfmarker> th this particular image , of how thi how it 's done , is that , then given all of these estimates at that level , there 's a level above it , then which is <disfmarker> is making , some kind of sound unit classification such as , you know , phone
speaker: C
text: and <disfmarker> and , you know . You could argue what , what a sound unit should be , and <disfmarker> and so forth .
speaker: C
text: But that <disfmarker> that 's sort of what I was imagining doing ,
speaker: C
text: um , and <disfmarker> but it 's still open within that whether you would have an intermediate level in which it was actually phones , or not .
speaker: C
text: You wouldn't necessarily have to .
speaker: C
text: Um , but , Again , I wouldn't wanna , wouldn't want what we <disfmarker> we produced to be so , know , local in perspective that it <disfmarker> it was matched , what we were thinking of doing one week ,
speaker: C
text: And <disfmarker> and , and , you know , what you 're saying is absolutely right .
speaker: C
text: That , that if we , can we should put in , uh , another level of , of description there if we 're gonna get into some of this low - level stuff .
speaker: D
text: Well , you know , um <disfmarker> I mean if we 're talking about , having the , annotators annotate these kinds of features , it seems like ,
speaker: D
text: You know , you <disfmarker>
speaker: D
text: The <disfmarker> the question is , do they do that on , meeting data ?
speaker: D
text: Or do they do that on , Switchboard ?
speaker: F
text: That 's what I was saying ,
speaker: F
text: maybe meeting data isn't the right corpus .
speaker: B
text: W Well it seems like you could do both .
speaker: B
text: I mean , I was thinking that it would be interesting , to do it with respect to , parts of Switchboard anyway , in terms of ,
speaker: C
text: Mm - hmm .
speaker: B
text: uh <disfmarker> partly to see , if you could , generate first guesses at what the articulatory feature would be , based on the phone representation at that lower level .
speaker: C
text: Mm - hmm .
speaker: B
text: It might be a time gain .
speaker: B
text: But also in terms of comparability of , um ,
speaker: C
text: Mm - hmm .
speaker: D
text: Well cuz the yeah , and then also , if you did it on Switchboard , you would have , the full continuum of transcriptions .
speaker: B
text: what you gain
speaker: B
text: Yep .
speaker: D
text: You 'd have it , from the lowest level , the ac acoustic features , then you 'd have the , you know , the phonetic level that Steve did ,
speaker: B
text: Mm - hmm .
speaker: G
text: Yeah that <disfmarker> that 's all I was thinking about .
speaker: D
text: and ,
speaker: G
text: it is telephone band , so , the bandwidth might be <disfmarker>
speaker: D
text: yeah .
speaker: B
text: And you could tell that <disfmarker>
speaker: D
text: It 'd be a complete , set then .
speaker: B
text: And you get the relative gain up ahead .
speaker: C
text: It 's so it 's a little different .
speaker: G
text: Yeah .
speaker: C
text: So I mean i we 'll see wha how much we can , uh , get the people to do , and how much money we 'll have and all this sort of thing ,
speaker: B
text: Mm - hmm .
speaker: B
text: Mm - hmm .
speaker: D
text: But it <disfmarker> it might be good to do what Jane was saying uh , you know , seed it , with , guesses about what we think the features are , based on , you know , the phone or Steve 's transcriptions or something . to make it quicker .
speaker: C
text: but ,
speaker: C
text: Might be do both .
speaker: F
text: Alright , so based on the phone transcripts they would all be synchronous , but then you could imagine , nudging them here and there .
speaker: D
text: Adjusting ?
speaker: D
text: Yeah , exactly .
speaker: D
text: Scoot the voicing over a little , because <disfmarker>
speaker: B
text: Yeah .
speaker: F
text: Right .
speaker: C
text: Well I think what <disfmarker> I mean I 'm <disfmarker> I 'm a l little behind in what they 're doing , now , and , uh , the stuff they 're doing on Switchboard now .
speaker: C
text: But I think that , Steve and the gang are doing , something with an automatic system first and then doing some adjustment .
speaker: C
text: As I re as I recall .
speaker: C
text: So I mean that 's probably the right way to go anyway , is to <disfmarker> is to start off with an automatic system with a pretty rich pronunciation dictionary that , that , um , you know , tries , to label it all .
speaker: C
text: And then , people go through and fix it .
speaker: B
text: So in <disfmarker> in our case you 'd think about us s starting with maybe the regular dictionary entry ,
speaker: B
text: and then ?
speaker: C
text: Well , regular dictionary , I mean , this is a pretty rich dictionary .
speaker: B
text: Or <pause> would we <disfmarker>
speaker: C
text: It 's got , got a fair number of pronunciations in it
speaker: D
text: Or you could start from the <disfmarker> if we were gonna , do the same set , of sentences that Steve had , done , we could start with those transcriptions .
speaker: B
text: But <disfmarker>
speaker: B
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: G
text: That 's actually what I was thinking , is tha <disfmarker>
speaker: B
text: So I was thinking <disfmarker>
speaker: F
text: Right .
speaker: D
text: Yeah .
speaker: G
text: the problem is when you run , uh , if you run a regular dictionary , um , even if you have variants , in there , which most people don't , you don't always get , out , the actual pronunciations ,
speaker: D
text: Yeah .
speaker: G
text: so that 's why the human transcriber 's giving you the <disfmarker> that pronunciation ,
speaker: B
text: Yeah .
speaker: C
text: Actually maybe they 're using phone recognizers .
speaker: B
text: Oh .
speaker: G
text: and so y
speaker: G
text: they <disfmarker> they <disfmarker> I thought that they were <disfmarker>
speaker: C
text: Is that what they 're doing ?
speaker: F
text: They are .
speaker: G
text: we should catch up on what Steve is ,
speaker: C
text: Oh , OK .
speaker: G
text: uh <disfmarker> I think that would be a good i good idea .
speaker: C
text: Yeah .
speaker: C
text: Yeah , so I think that i i we also don't have , I mean ,
speaker: C
text: we 've got a good start on it ,
speaker: C
text: but we don't have a really good , meeting , recorder or recognizer or transcriber or anything yet ,
speaker: C
text: so .
speaker: G
text: Yeah .
speaker: C
text: So , I mean another way to look at this is to , is to , uh , do some stuff on Switchboard which has all this other , stuff to it .
speaker: C
text: And then , um , As we get , further down the road and we can do more things ahead of time , we can , do some of the same things to the meeting data .
speaker: D
text: Mm - hmm .
speaker: B
text: OK .
speaker: D
text: Yeah .
speaker: B
text: And I 'm <disfmarker> and these people might <disfmarker> they <disfmarker> they are , s most of them are trained with IPA .
speaker: C
text: Yeah
speaker: B
text: They 'd be able to do phonetic - level coding , or articulatory .
speaker: D
text: Are they busy for the next couple years , or <disfmarker> ?
speaker: B
text: Well , you know , I mean they , they <disfmarker> they 're interested in continuing working with us ,
speaker: B
text: so <disfmarker> I mean <disfmarker> I , and this would be up their alley , so , we could <disfmarker> when the <disfmarker> when you d meet with , with John Ohala and find , you know what taxonomy you want to apply , then , they 'd be , good to train onto it .
speaker: C
text: Yeah .
speaker: C
text: Yeah .
speaker: C
text: Anyway , this is , not an urgent thing at all ,
speaker: B
text: Yeah .
speaker: C
text: just it came up .
speaker: D
text: It 'd be very interesting though , to have <pause> that data .
speaker: G
text: Yeah .
speaker: F
text: I wonder , how would you do a forced alignment ?
speaker: B
text: I think so , too .
speaker: G
text: Might <disfmarker>
speaker: B
text: Interesting idea .
speaker: F
text: To <disfmarker> to <disfmarker> I mean , you 'd wanna iterate , somehow .
speaker: F
text: Yeah .
speaker: F
text: It 's interesting thing to think about .
speaker: G
text: It might be <disfmarker>
speaker: D
text: Hmm .
speaker: G
text: I was thinking it might be n
speaker: F
text: I mean you 'd <disfmarker> you 'd want models for spreading .
speaker: D
text: Of the f acoustic features ?
speaker: F
text: Yeah .
speaker: D
text: Mm - hmm .
speaker: C
text: Mm - hmm .
speaker: C
text: Yeah .
speaker: G
text: Well it might be neat to do some , phonetic , features on these , nonword words .
speaker: G
text: Are <disfmarker> are these kinds of words that people never <disfmarker> the " huh "s and the " hmm "s and the " huh " <vocalsound> and the uh <disfmarker>
speaker: G
text: These k No , I 'm serious .
speaker: G
text: There are all these kinds of <pause> functional , uh , elements .
speaker: G
text: I don't know what you call <pause> them .
speaker: G
text: But not just fill pauses but all kinds of ways of <pause> interrupting <comment> and so forth .
speaker: F
text: Uh - huh .
speaker: G
text: And some of them are , <vocalsound> yeah , " uh - huh "s , and " hmm "s , and , " hmm ! "
speaker: G
text: " hmm " <comment> " OK " , " uh " <comment> Grunts ,
speaker: G
text: uh ,
speaker: G
text: that might be interesting .
speaker: B
text: He 's got lip <disfmarker> <pause> lipsmacks .
speaker: G
text: In the meetings .
speaker: C
text: We should move on .
speaker: B
text: Yeah .
speaker: C
text: Uh , new version of , uh , presegmentation ?
speaker: A
text: Uh , oh yeah , um , <vocalsound> I worked a little bit on the <disfmarker> on the presegmentation to <disfmarker> to get another version which does channel - specific , uh , speech - nonspeech detection .
speaker: A
text: And , what I did is I used some normalized features which , uh , look in into the <disfmarker> which is normalized energy , uh , energy normalized by the mean over the channels and by the , minimum over the , other .
speaker: A
text: within each channel .
speaker: A
text: And to <disfmarker> to , mm , to , yeah , to normalize also loudness and <disfmarker> and modified loudness and things and that those special features actually are in my feature vector .
speaker: F
text: Oh .
speaker: A
text: And , and , therefore to be able to , uh , somewhat distinguish between foreground and background speech in <disfmarker> in the different <disfmarker> in <disfmarker> each channel .
speaker: A
text: And , eh , I tested it on <disfmarker> on three or four meetings and it seems to work , well yeah , fairly well , I <disfmarker> I would say .
speaker: A
text: There are some problems with the lapel mike .
speaker: F
text: Of course .
speaker: A
text: Yeah .
speaker: F
text: Wow that 's great .
speaker: A
text: Uh , yeah .
speaker: A
text: And .
speaker: F
text: So I <disfmarker> I understand that 's what you were saying about your problem with , minimum .
speaker: A
text: Yeah .
speaker: A
text: And .
speaker: A
text: Yeah , and <disfmarker> and I had <disfmarker> I had , uh , specific problems with .
speaker: F
text: I get it .
speaker: F
text: So new use ninetieth quartile , rather than , minimum .
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: Wow .
speaker: A
text: Yeah <disfmarker> yeah , then <disfmarker> I <disfmarker> I did some <disfmarker> some <disfmarker> some things like that ,
speaker: B
text: Interesting .
speaker: A
text: as there <disfmarker> there are some <disfmarker> some problems in , when , in the channel , there <disfmarker> they <disfmarker> the the speaker doesn't <disfmarker> doesn't talk much or doesn't talk at all .
speaker: A
text: Then , the , yeah , there are <disfmarker> there are some problems with <disfmarker> with <disfmarker> with n with normalization , and , then , uh , there the system doesn't work at all .
speaker: A
text: So , I 'm <disfmarker> I 'm glad that there is the <disfmarker> the digit part , where everybody is forced to say something ,
speaker: C
text: Right .
speaker: A
text: so , that 's <disfmarker> that 's great for <disfmarker> for my purpose .
speaker: A
text: And , the thing is I <disfmarker> I , then the evaluation of <disfmarker> of the system is a little bit hard , as I don't have any references .
speaker: F
text: Well we did the hand <disfmarker>
speaker: F
text: the one by hand .
speaker: A
text: Yeah , that 's the one <disfmarker> one wh where I do the training on so I can't do the evaluation on
speaker: A
text: So the thing is , can the transcribers perhaps do some , some <disfmarker> some meetings in <disfmarker> in terms of speech - nonspeech in <disfmarker> in the specific channels ?
speaker: F
text: Uh .
speaker: D
text: Well won't you have that from their transcriptions ?
speaker: B
text: Well , I have <disfmarker>
speaker: B
text: Well , OK , so , now we need <disfmarker>
speaker: F
text: No , cuz we need is really tight .
speaker: A
text: Yeah .
speaker: B
text: so , um ,
speaker: B
text: I think I might have done what you 're requesting , though I did it in the service of a different thing .
speaker: A
text: Oh , great .
speaker: B
text: I have thirty minutes that I 've more tightly transcribed with reference to individual channels .
speaker: A
text: OK .
speaker: A
text: OK , that 's great .
speaker: A
text: That 's great
speaker: B
text: And I could <disfmarker> And <disfmarker>
speaker: A
text: for me . Yeah , so .
speaker: F
text: Hopefully that 's not the same meeting that we did .
speaker: B
text: And <disfmarker>
speaker: B
text: No , actually it 's a different meeting .
speaker: F
text: Good .
speaker: B
text: So , um , e so the , you know , we have the , th they transcribe as if it 's one channel with these <disfmarker> with the slashes to separate the overlapping parts .
speaker: A
text: OK .
speaker: B
text: And then we run it through <disfmarker> then it <disfmarker> then I 'm gonna edit it and I 'm gonna run it through channelize which takes it into Dave Gelbart 's form format .
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: And then you have , all these things split across according to channel ,
speaker: B
text: and then that means that , if a person contributed more than once in a given , overlap during that time bend that <disfmarker> that two parts of the utterance end up together , it 's the same channel ,
speaker: B
text: and then I took his tool , and last night for the first thirty minutes of one of these transcripts , I , tightened up the , um , boundaries on individual speakers ' channels ,
speaker: A
text: OK .
speaker: A
text: OK .
speaker: B
text: cuz his <disfmarker> his interface allows me to have total flexibility in the time tags across the channels .
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: And <pause> um , so .
speaker: D
text: So , current <disfmarker> This week .
speaker: A
text: so , yeah <disfmarker> yeah , that <disfmarker> that <disfmarker> that 's great , but what would be nice to have some more meetings , not just one meeting to <disfmarker> to be sure that <disfmarker> that , there is a system ,
speaker: B
text: Yes .
speaker: B
text: Might not be what you need .
speaker: F
text: Yeah , so if we could get a couple meetings done with that level of precision I think that would be a good idea .
speaker: A
text: OK .
speaker: B
text: Oh , OK .
speaker: A
text: Yeah .
speaker: B
text: Uh , how <disfmarker> how m much
speaker: B
text: time <disfmarker> so the meetings vary in length ,
speaker: B
text: what are we talking about in terms of the number of minutes you 'd like to have as your <disfmarker> as your training set ?
speaker: A
text: It seems to me that it would be good to have , a few minutes from <disfmarker> from different meetings ,
speaker: A
text: so .
speaker: A
text: But I 'm not sure about how much .
speaker: B
text: OK , now you 're saying different meetings because of different speakers or because of different audio quality or both or <disfmarker> ?
speaker: A
text: Both <disfmarker>
speaker: A
text: both .
speaker: B
text: OK .
speaker: A
text: Different <disfmarker> different number of speakers , different speakers , different <pause> conditions .
speaker: C
text: Yeah , we don't have that much variety in meetings yet ,
speaker: C
text: uh , I mean we have this meeting and the feature meeting and we have a couple others that we have uh , couple examples of . But <disfmarker> but , uh ,
speaker: A
text: Yeah , m
speaker: A
text: Yeah .
speaker: B
text: Mm - hmm .
speaker: E
text: Even probably with the gains <pause> differently will affect it , you mean <disfmarker>
speaker: A
text: Uh , not really as <disfmarker>
speaker: C
text: Poten - potentially .
speaker: E
text: Oh , cuz you use the normalization ?
speaker: A
text: uh , because of the normalization , yeah .
speaker: E
text: OK .
speaker: C
text: Oh , OK .
speaker: A
text: Yeah .
speaker: G
text: We can try running <disfmarker>
speaker: G
text: we haven't done this yet because , um , uh , Andreas an is <disfmarker> is gonna move over the SRI recognizer .
speaker: G
text: i basically I ran out of machines at SRI ,
speaker: G
text: cuz we 're running the evals
speaker: A
text: OK .
speaker: G
text: and I just don't have machine time there .
speaker: G
text: But , once that 's moved over , uh , hopefully in a <disfmarker> a couple days , then , we can take , um , what Jane just told us about as , the presegmented , <vocalsound> <nonvocalsound> the <disfmarker> the segmentations that you did , at level eight or som <comment> at some , threshold that Jane , tha <pause> right , and try doing , forced alignment . um , on the word strings .
speaker: F
text: Oh , shoot !
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: The pre presegment
speaker: A
text: Yeah .
speaker: B
text: yeah .
speaker: A
text: With the recognizer ?
speaker: A
text: Yeah .
speaker: G
text: And if it 's good , then that will <disfmarker> that may give you a good boundary .
speaker: G
text: Of course if it 's good , we don't <disfmarker> then we 're <disfmarker> we 're fine ,
speaker: A
text: Yeah .
speaker: A
text: M
speaker: G
text: but , I don't know yet whether these , segments that contain a lot of pauses around the words , will work or not .
speaker: A
text: I <disfmarker> I would quite like to have some manually transcribed references for <disfmarker> for the system , as I 'm not sure if <disfmarker> if it 's really good to compare with <disfmarker> with some other automatic , found boundaries .
speaker: G
text: Yeah .
speaker: G
text: Right .
speaker: B
text: Well , no , if we were to start with this and then tweak it h manually , would that <disfmarker> that would be OK ?
speaker: A
text: Yeah .
speaker: G
text: Right .
speaker: A
text: Yeah <pause> sure .
speaker: G
text: They might be OK .
speaker: B
text: OK .
speaker: G
text: It <disfmarker> you know it really depends on a lot of things ,
speaker: A
text: Yeah .
speaker: G
text: but , I would have maybe a transciber , uh , look at the result of a forced alignment and then adjust those .
speaker: A
text: Yeah .
speaker: A
text: To a adjust them , or ,
speaker: A
text: yeah .
speaker: A
text: Yeah , yeah .
speaker: G
text: That might save some time .
speaker: G
text: If they 're horrible it won't help at all ,
speaker: A
text: Yeah , great .
speaker: G
text: but they might not be horrible .
speaker: A
text: Yeah .
speaker: G
text: So <disfmarker> but I 'll let you know when we , uh , have that .
speaker: A
text: OK , great .
speaker: B
text: How many minutes would you want from <disfmarker>
speaker: B
text: I mean , we could <pause> easily , get a section , you know , like say a minute or so , from every meeting that we have so f from the newer ones that we 're working on , everyone that we have .
speaker: B
text: And then ,
speaker: B
text: should provide this .
speaker: A
text: If it 's not the first minute of <disfmarker> of the meeting , that <disfmarker> that 's OK with me ,
speaker: A
text: but , in <disfmarker> in the first minute , uh , Often there are some <disfmarker> some strange things going on which <disfmarker> which aren't really , well , for , which <disfmarker> which aren't re re really good .
speaker: A
text: So . What <disfmarker> what I 'd quite like , perhaps , is , to have , some five minutes of <disfmarker> of <disfmarker> of different meetings ,
speaker: A
text: so .
speaker: B
text: Somewhere not in the very beginning , five minutes , OK .
speaker: A
text: Yeah .
speaker: B
text: And , then I wanted to ask you just for my inter information ,
speaker: B
text: then , would you , be trai
speaker: B
text: cuz I don't quite unders
speaker: B
text: so , would you be training then , um , the segmenter so that , it could , on the basis of that , segment the rest of the meeting ?
speaker: B
text: So , if I give you like <pause> five minutes is the idea that this would then be applied to , uh , to , providing tighter time <pause> bands ?
speaker: A
text: I <disfmarker> I could do a <disfmarker> a retraining with that , yeah .
speaker: B
text: Wow , interesting .
speaker: A
text: That 's <disfmarker> but <disfmarker> but I hope that I <disfmarker> I don't need to do it .
speaker: B
text: OK .
speaker: B
text: Uh - huh .
speaker: A
text: So , uh it c can be do in an unsupervised way .
speaker: B
text: Excellent .
speaker: A
text: So .
speaker: B
text: Excellent , OK .
speaker: A
text: I 'm <disfmarker> I 'm not sure ,
speaker: A
text: but , for <disfmarker> for <disfmarker> for those three meetings whi which I <disfmarker> which I did , it seems to be , quite well ,
speaker: A
text: but , there are some <disfmarker> some <disfmarker> as I said some problems with the lapel mike ,
speaker: A
text: but , perhaps we can do something with <disfmarker> with cross - correlations to , to get rid of the <disfmarker> of those .
speaker: A
text: And .
speaker: A
text: Yeah .
speaker: A
text: That 's <disfmarker> that 's what I <disfmarker> that 's my <pause> future work .
speaker: A
text: Well <disfmarker> well what I want to do is to <disfmarker> to look into cross - correlations for <disfmarker> for removing those , false overlaps .
speaker: B
text: Wonderful .
speaker: G
text: Are the , um , wireless , different than the wired , mikes , at all ?
speaker: G
text: I mean , have you noticed any difference ?
speaker: A
text: I 'm <disfmarker> I 'm not sure , um , if <disfmarker> if there are any wired mikes in those meetings , or , uh , I have <disfmarker> have to loo have a look at them
speaker: A
text: but , I 'm <disfmarker> I 'm <disfmarker> I think there 's no difference between ,
speaker: G
text: So it 's just the lapel versus everything else ?
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: OK , so then , if that 's five minutes per meeting we 've got like twelve minutes , twelve meetings , roughly , that I 'm <disfmarker> that I 've been working with , then <disfmarker>
speaker: C
text: Of <disfmarker> of <disfmarker> of the meetings that you 're working with , how many of them are different , tha
speaker: A
text: No .
speaker: C
text: are there any of them that are different than , these two meetings ?
speaker: B
text: Well <disfmarker> oh wa in terms of the speakers or the conditions or the ?
speaker: C
text: Yeah , speakers .
speaker: C
text: Sorry .
speaker: C
text: So .
speaker: B
text: Um , we have different combinations of speakers .
speaker: A
text: Yeah , that <disfmarker>
speaker: B
text: I mean , just from what I 've seen , uh , there are some where , um , you 're present or not present ,
speaker: B
text: and , then <disfmarker> then you have the difference between the networks group and this group
speaker: A
text: Yeah , I know , some of the NSA meetings , yeah .
speaker: C
text: Yeah .
speaker: C
text: So I didn't know in the group you had if you had <disfmarker>
speaker: A
text: Yeah .
speaker: C
text: so you have the networks meeting ?
speaker: B
text: Yep , we do .
speaker: A
text: Yeah .
speaker: C
text: Do you have any of Jerry 's meetings in your , pack , er ,
speaker: B
text: Um , no .
speaker: C
text: No ?
speaker: B
text: We could ,
speaker: B
text: I mean you <disfmarker> you recorded one last week or so .
speaker: B
text: I could get that new one in this week <disfmarker> I get that new one in .
speaker: F
text: Yep .
speaker: G
text: We 're gonna be recording them every <pause> Monday ,
speaker: F
text: u
speaker: C
text: Yeah .
speaker: C
text: Cuz I think he really needs variety ,
speaker: G
text: so <disfmarker>
speaker: C
text: and <disfmarker> and having as much variety for speaker certainly would be a big part of that I think .
speaker: B
text: Great .
speaker: A
text: Yeah .
speaker: A
text: Yeah .
speaker: B
text: OK , so if I ,
speaker: B
text: OK , included <disfmarker> include ,
speaker: B
text: OK , then , uh , if I were to include all together samples from twelve meetings that would only take an hour
speaker: B
text: and I could get the transcribers to do that
speaker: B
text: right <disfmarker>
speaker: B
text: I mean , what I mean is , that would be an hour sampled , and then they 'd transcribe those <disfmarker> that hour ,
speaker: B
text: right ?
speaker: B
text: That 's what I should do ?
speaker: C
text: Yeah .
speaker: C
text: And .
speaker: C
text: Right .
speaker: C
text: Ye - But you 're <disfmarker> y
speaker: A
text: That 's <disfmarker> that 's .
speaker: B
text: I don't mean transcribe
speaker: B
text: I mean <disfmarker> I mean adjust .
speaker: B
text: So they get it into the multi - channel format and then adjust the timebands so it 's precise .
speaker: C
text: So that should be faster than the ten times kind of thing ,
speaker: B
text: Absolutely .
speaker: C
text: yeah .
speaker: B
text: I did <disfmarker> I did , um , uh , so , last night I did , uh ,
speaker: B
text: Oh gosh ,
speaker: B
text: well , last night , I did about half an hour in , three hours , which is not , terrific ,
speaker: C
text: Yeah .
speaker: B
text: but , um ,
speaker: C
text: Yeah .
speaker: B
text: anyway , it 's an hour and a half per <disfmarker>
speaker: C
text: Well , that 's probably .
speaker: A
text: So .
speaker: B
text: Well , I can't calculate on my , <vocalsound> on my feet .
speaker: A
text: Do the transcribers actually start wi with , uh , transcribing new meetings , or <pause> are they ?
speaker: B
text: Well , um they 're still working <disfmarker> they still have enough to finish that I haven't assigned a new meeting ,
speaker: A
text: OK .
speaker: B
text: but the next , m m
speaker: B
text: I was about to need to assign a new meeting
speaker: B
text: and I was going to take it from one of the new ones ,
speaker: A
text: OK .
speaker: B
text: and I could easily give them Jerry Feldman 's meeting ,
speaker: B
text: no problem .
speaker: B
text: And , then <disfmarker>
speaker: A
text: OK .
speaker: G
text: So they 're really running out of , data , prett I mean that 's good .
speaker: B
text: Mm - hmm .
speaker: B
text: Uh , that first set .
speaker: G
text: Um , OK .
speaker: C
text: They 're running out of data unless we s make the decision that we should go over and start , uh , transcribing the other set .
speaker: G
text: So <disfmarker>
speaker: C
text: There <disfmarker> the first <disfmarker> the first half .
speaker: B
text: And so I was in the process of like editing them but this is wonderful news .
speaker: A
text: Yeah .
speaker: A
text: OK .
speaker: C
text: Alright .
speaker: B
text: We funded the experiment with , uh <disfmarker>
speaker: B
text: also we were thinking maybe applying that that to getting the ,
speaker: B
text: Yeah , that 'll be , very useful to getting the overlaps to be more precise all the way through .
speaker: C
text: So this , blends nicely into the update on transcripts .
speaker: B
text: Yes , it does .
speaker: C
text: OK .
speaker: B
text: So , um , <comment> um , Liz , and <disfmarker> and Don , and I met this morning , in the BARCO room , with the lecture hall ,
speaker: G
text: Yeah , please .
speaker: G
text: Go ahead .
speaker: G
text: And this afternoon .
speaker: B
text: and this afternoon ,
speaker: B
text: it drifted into the afternoon , <comment> <vocalsound> uh , concerning this issue of , um , the , well there 's basically the issue of the interplay between the transcript format and the processing that , they need to do for , the SRI recognizer .
speaker: B
text: And , um , well , so , I mentioned the process that I 'm going through with the data ,
speaker: B
text: so , you know , I get the data back from the transcri Well , s uh , metaphorically , get the data back from the transcriber ,
speaker: B
text: and then I , check for simple things like spelling errors and things like that .
speaker: B
text: And , um , I 'm going to be doing a more thorough editing , with respect to consistency of the conventions .
speaker: B
text: But they 're <disfmarker> they 're generally very good .
speaker: B
text: And , then , I run it through , uh , the channelize program to get it into the multi - channel format , OK .
speaker: B
text: And <pause> the , what we discussed this morning , I would summarize as saying that , um , these units that result , in a <disfmarker> a particular channel and a particular timeband , at <disfmarker> at that level , um , vary in length .
speaker: B
text: And , um , <nonvocalsound> their recognizer would prefer that the units not be overly long .
speaker: B
text: But it 's really an empirical question , whether the units we get at this point through , just that process I described might be sufficient for them .
speaker: B
text: So , as a first pass through , a first chance without having to do a lot of hand - editing , what we 're gonna do , is , I 'll run it through channelize , give them those data after I 've done the editing process and be sure it 's clean .
speaker: B
text: And I can do that , pretty quickly , with just , that minimal editing , without having to hand - break things .
speaker: C
text: Mm - hmm .
speaker: B
text: And then we 'll see if the units that we 're getting , uh , with the <disfmarker> at that level , are sufficient .
speaker: B
text: And maybe they don't need to be further broken down .
speaker: B
text: And if they do need to be further broken down then maybe it just be piece - wise , maybe it won't be the whole thing .
speaker: B
text: So , that 's <disfmarker> that 's what we were discussing , this morning as far as I <disfmarker> Among <disfmarker>
speaker: G
text: Right .
speaker: B
text: also we discussed some adaptational things ,
speaker: G
text: Then lots of <disfmarker>
speaker: G
text: Right .
speaker: B
text: so it 's like ,
speaker: B
text: uh <disfmarker> You know I hadn't , uh , incorporated , a convention explicitly to handle acronyms , for example ,
speaker: B
text: but if someone says , PZM it would be nice to have that be directly interpretable from , the transcript what they said ,
speaker: C
text: Mm - hmm .
speaker: B
text: or Pi - uh Tcl <disfmarker> TCL I mean .
speaker: B
text: It 's like
speaker: B
text: y it 's <disfmarker> and so , um , I 've <disfmarker> I 've incorporated also convention , with that
speaker: B
text: but that 's easy to handle at the post editing phase ,
speaker: B
text: and I 'll mention it to , transcribers for the next phase
speaker: B
text: but that 's OK .
speaker: B
text: And then , a similar conv uh , convention for numbers .
speaker: B
text: So if they say one - eighty - three versus one eight three .
speaker: B
text: Um , and also I 'll be , um , encoding , as I do my post - editing , the , things that are in curly brackets , which are clarificational material .
speaker: B
text: And eh to incorporate , uh , keyword , at the beginning .
speaker: B
text: So , it 's gonna be either a gloss or it 's gonna be a vocal sound like a , laugh or a cough , or , so forth .
speaker: B
text: Or a non - vocal sound like a doors door - slam , and that can be easily done with a , you know , just a <disfmarker> one little additional thing in the , in the general format .
speaker: G
text: Yeah we j we just needed a way to , strip , you know , all the comments , all the things th the <disfmarker> that linguist wants but the recognizer can't do anything with .
speaker: G
text: Um , but to keep things that we mapped to like reject models , or , you know , uh , mouth noise , or , cough .
speaker: G
text: And then there 's this interesting issue Jane brought up
speaker: G
text: which I hadn't thought about before
speaker: G
text: but I was , realizing as I went through the transcripts , that there are some noises like ,
speaker: G
text: um ,
speaker: G
text: well the <disfmarker> good example was an inbreath , where a transcriber working from , the mixed , signal , doesn't know whose breath it is ,
speaker: F
text: Right .
speaker: G
text: and they 've been assigning it to someone that may or may not be correct .
speaker: G
text: And what we do is , if it 's a breath sound , you know , a sound from the speaker , we map it , to , a noise model , like a mouth - noise model in the recognizer ,
speaker: G
text: and , yeah , it probably doesn't hurt that much once in a while to have these ,
speaker: G
text: but , if they 're in the wrong channel , that 's , not a good idea .
speaker: G
text: And then there 's also , things like door - slams that 's really in no one 's channel ,
speaker: G
text: they 're like <disfmarker> it 's in the room .
speaker: F
text: Right .
speaker: A
text: Yeah .
speaker: G
text: And <pause> uh , Jane had this nice , uh , idea of having , like an extra , uh couple tiers ,
speaker: F
text: An extra channel .
speaker: B
text: Yeah .
speaker: G
text: yeah .
speaker: B
text: I 've been <disfmarker> I 've been adding that to the ones I 've been editing .
speaker: G
text: And we were thinking , that is useful also when there 's uncertainties .
speaker: G
text: So if they hear a breath and they don't know who breath it is it 's better to put it in that channel than to put it in the speaker 's channel
speaker: G
text: because maybe it was someone else 's breath ,
speaker: G
text: or <disfmarker> Uh ,
speaker: G
text: so I think that 's a good <disfmarker> you can always clean that up , post - processing .
speaker: B
text: Yeah .
speaker: G
text: So a lot of little details ,
speaker: G
text: but I think we 're , coming to some kinda closure , on that .
speaker: G
text: So the idea is then , uh , Don can take , uh , Jane 's post - processed channelized version , and , with some scripts , you know , convert that to <disfmarker> to a reference for the recognizer
speaker: G
text: and we can , can run these .
speaker: G
text: So <pause> when that 's , ready <disfmarker> you know , as soon as that 's ready , and as soon as the recognizer is here we can get , twelve hours of force - aligned and recognized data .
speaker: G
text: And , you know , start , working on it ,
speaker: B
text: And <disfmarker>
speaker: G
text: so we 're , I dunno a coup a week or two away I would say from ,
speaker: G
text: uh , if <disfmarker> if that process is automatic once we get your post - process , transcript .
speaker: B
text: Mm - hmm .
speaker: B
text: And that doesn't <disfmarker> the amount of editing that it would require is not very much either .
speaker: B
text: I 'm just hoping that the units that are provided in that way , <nonvocalsound> will be sufficient
speaker: B
text: cuz I would save a lot of , uh , time , dividing things .
speaker: G
text: Yeah , some of them are quite long .
speaker: G
text: Just from <disfmarker>
speaker: G
text: I dunno
speaker: G
text: how long were <disfmarker>
speaker: G
text: you did one ?
speaker: E
text: I saw a couple , <vocalsound> around twenty seconds ,
speaker: E
text: and that was just without looking too hard for it ,
speaker: E
text: so , I would imagine that there might be some that are longer .
speaker: G
text: Right .
speaker: B
text: Well n
speaker: B
text: One question ,
speaker: B
text: e w would that be a single speaker or is that multiple speakers overlapping ?
speaker: E
text: No . No , but if we 're gonna segment it ,
speaker: E
text: like if there 's one speaker in there , that says " OK " or something , right in the middle , it 's gonna have a lot of dead time around it ,
speaker: G
text: Right . It 's not the <disfmarker> it 's not the fact that we can't process a twenty second segment , it 's the fact that , there 's twenty seconds in which to place one word in the wrong place
speaker: E
text: so it 's not <disfmarker>
speaker: E
text: Yeah .
speaker: G
text: You know , if <disfmarker> if someone has a very short utterance there ,
speaker: B
text: Yeah .
speaker: G
text: and that 's where , we , might wanna have this individual , you know , ha have your pre pre - process input .
speaker: A
text: Yep .
speaker: A
text: Yeah .
speaker: A
text: Sure .
speaker: G
text: And I just don't know ,
speaker: A
text: I <disfmarker> I <disfmarker> I thought that perhaps the transcribers could start then from the <disfmarker> those mult multi - channel , uh , speech - nonspeech detections , if they would like to .
speaker: B
text: That 's very important .
speaker: G
text: I have to run it .
speaker: G
text: Right .
speaker: B
text: In <disfmarker> in doing the hand - marking ?
speaker: A
text: Yeah .
speaker: B
text: Yeah that 's what I was thinking , too .
speaker: G
text: Right .
speaker: G
text: So that 's probably what will happen ,
speaker: B
text: Yeah .
speaker: G
text: but we 'll try it this way and see .
speaker: A
text: Yeah .
speaker: G
text: I mean it 's probably good enough for force - alignment .
speaker: G
text: If it 's not then we 're really <disfmarker> then we def definitely
speaker: A
text: Yeah .
speaker: G
text: uh , but for free recognition I 'm <disfmarker> it 'll probably not be good enough .
speaker: G
text: We 'll probably get lots of errors because of the cross - talk , and , noises and things .
speaker: A
text: Yep .
speaker: C
text: Good
speaker: C
text: s I think that 's probably our agenda , or starting up there .
speaker: B
text: Oh I wanted to ask one thing ,
speaker: C
text: Yeah ? K .
speaker: B
text: the microphones <disfmarker> the new microphones ,
speaker: B
text: when do we get , uh ?
speaker: F
text: Uh , they said it would take about a week .
speaker: B
text: Oh , exciting . K .
speaker: B
text: K .
speaker: C
text: K .
speaker: D
text: You ordered them already ?
speaker: F
text: Mm - hmm .
speaker: D
text: Great .
speaker: G
text: So what happens to our old microphones ?
speaker: C
text: They go where old microphones go .
speaker: F
text: Um <disfmarker>
speaker: G
text: Do we give them to someone ,
speaker: G
text: or <disfmarker> ?
speaker: F
text: Well the only thing we 're gonna have extra , for now ,
speaker: G
text: We don't have more receivers ,
speaker: G
text: we just have <disfmarker>
speaker: F
text: Right , we don
speaker: G
text: Right .
speaker: F
text: so the only thing we 'll have extra now is just the lapel .
speaker: F
text: Not <disfmarker> not the , bodypack ,
speaker: F
text: just the lapel .
speaker: G
text: Just the lapel itself .
speaker: F
text: Um , and then one of the <disfmarker> one of those .
speaker: F
text: Since , what I decided to do , on Morgan 's suggestion , was just get two , new microphones , um , and try them out .
speaker: G
text: Mm - hmm .
speaker: F
text: And then , if we like them we 'll get more .
speaker: G
text: OK .
speaker: C
text: Yeah .
speaker: F
text: Since they 're <disfmarker> they 're like two hundred bucks a piece ,
speaker: F
text: we won't , uh , at least try them out .
speaker: D
text: So it 's a replacement for this headset mike ?
speaker: F
text: Yep . Yep .
speaker: C
text: Yeah .
speaker: F
text: And they 're gonna do the wiring for us .
speaker: D
text: What 's the , um , style of the headset ?
speaker: F
text: It 's , um , it 's by Crown ,
speaker: F
text: and it 's one of these sort of mount around the ear thingies ,
speaker: F
text: and , uh , when I s when I mentioned that we thought it was uncomfortable he said it was a common problem with the Sony .
speaker: F
text: And this is how apparently a lot of people are getting around it .
speaker: D
text: Hmm .
speaker: F
text: And I checked on the web , and every site I went to , raved about this particular mike .
speaker: F
text: It 's apparently comfortable and stays on the head well ,
speaker: F
text: so we 'll see if it 's any good .
speaker: F
text: But , uh , I think it 's promising .
speaker: B
text: You said it was used by aerobics instructors ?
speaker: F
text: Yep . Yep , so it was <disfmarker> it was advertised for performers
speaker: E
text: Hmm .
speaker: B
text: That says a lot .
speaker: C
text: For the recor for the record Adam is not a paid employee or a consultant of Crown .
speaker: F
text: and <disfmarker>
speaker: F
text: Excuse me ?
speaker: B
text: Oh .
speaker: F
text: Excuse me ?
speaker: G
text: Right .
speaker: C
text: I said " For the record Adam is <disfmarker> is not a paid consultant or employee of Crown " .
speaker: F
text: That 's right .
speaker: G
text: However , he may be solicited after these meetings are distributed .
speaker: F
text: Well we 're using the Crown P Z
speaker: G
text: Don't worry about finishing your dissertation .
speaker: C
text: Yeah .
speaker: F
text: These are Crown
speaker: F
text: aren't they ?
speaker: F
text: The P Z Ms are Crown ,
speaker: C
text: Right .
speaker: F
text: aren't they ?
speaker: C
text: Yeah .
speaker: F
text: Yeah , I thought they were .
speaker: C
text: You bet . You bet .
speaker: F
text: And they work very well .
speaker: G
text: Yes .
speaker: C
text: So if we go to a workshop about all this <disfmarker> this it 's gonna be a meeting about meetings about meetings .
speaker: C
text: OK .
speaker: C
text: So .
speaker: F
text: And then it <disfmarker> we have to go to the planning session for that workshop .
speaker: C
text: Oh , yeah , what <disfmarker> Which 'll be the meeting about the meeting about the meeting .
speaker: D
text: Oh , god .
speaker: F
text: Cuz then it would be a meeting about the meeting about the meeting about meetings .
speaker: C
text: Yeah ?
speaker: C
text: Just start saying " M four " .
speaker: C
text: Yeah , OK .
speaker: F
text: Yeah .
speaker: F
text: M to the fourth .
speaker: C
text: Should we do the digits ?
speaker: F
text: Yep , go for it .
speaker: C
text: OK .
speaker: A
text: S <pause> s
speaker: F
text: Pause between the lines , remember ?
speaker: E
text: Excuse me .
speaker: F
text: OK .
speaker: C
text: OK .
speaker: G
text: Huh .

Meeting summary:
text: The Berkeley Meeting Recorder group discussed the collection status for a set of connected digits recordings that are nearly complete and ready to be trained on a recognizer.
text: Anticipated results were discussed in reference to results obtained for other digits corpora, i.e. Aurora and TI-digits.
text: The group also considered the prospect of performing fine-grained acoustic-phonetic analyses on a subset of Meeting Recorder digits or Switchboard data.
text: Pre-segmentation manipulations that allow for the segmentation of channel-specific speech/non-speech portions of the signal and the distinction of foreground versus background speech were discussed.
text: Finally, speaker fe008 and fe016 reported on new efforts to adapt transcriptions to the needs of the SRI recognizer, including conventions for encoding acronyms, numbers, ambient noise, and unidentified inbreaths.
text: The group decided to delegate the extraction of digits to the transcriber pool.
text: A tentative decision was also made to delegate transcribers with the task of labelling a subset of digits or Switchboard data for fine-grained acoustic-phonetic features.
text: Speaker fe008 will run selected Meeting Recorder data through channelize and determine whether the resulting units are of a sufficient length.
text: With respect to encoding more fine-grained acoustic information in transcriptions, the question was posed: which features should be marked?
text: Speaker mn014 reported problems pre-segmenting speech recorded via the lapel microphones.
text: Normalization of the energy measured across and within channels is problematic when performed for speakers who say little or nothing during meetings.
text: The evaluation of pre-segmented data is difficult without tightly transcribed time references to the individual channels from which the speech was derived.
text: The SRI recognizer requires that multi-channel format units not be too large, indicating that some additional pre-processing of unit lengths may be necessary.
text: A test set of Meeting Recorder digits is nearly complete.
text: Future work will include training this data on a recognizer, and feeding the recognizer with corresponding far-field microphone data.
text: It was noted that the results of experiments testing similar digits corpora have yielded high error rates, indicating that similar problems may be expected for the set of Meeting Recoreder digits.
text: The group discussed the prospect of performing fine-grained acoustic-phonetic analyses on a subset of digits or Switchboard data.
text: It was suggested that prior to the use of data-driven methods, knowledge-driven approaches should be used to 'seed' the data with sub-phonemic features, either manually, or using a rich pronunciation dictionary.
text: A new version of the pre-segmentation tool that segments channel-specific speech/non-speech portions of the signal has been developed and tested.
text: Future pre-segmentation work will include normalizing other features, such as loudness, enabling the distinction of foreground versus background speech.
text: Speaker mn014 will also look at cross-correlations for removing false overlaps.
text: New efforts were reported to adapt transcriptions to the needs of the SRI recognizer, including conventions for encoding acronyms, numbers, ambient noise, and unidentified inbreaths.
text: With the arrival of the SRI recognizer, 12 hours of forced aligned, recognized data can be expected.