But all all I know is that it seems like every time I am up here after a meeting , and I start it , it works fine . And if I 'm up here and I start it and we 're all sitting here waiting to have a meeting , it gives me that error message and I have not yet sat down with been able to get that error message in a point where I can sit down and find out where it 's occurring in the code . professor d: So  so the  , the new procedural change that just got suggested , which I think is a good idea is that  , we do the digit recordings at the end . And that way , if we 're recording somebody else 's  meeting , and a number of the participants have to run off to some other meeting and don't have the time , then they can run off . It 'll mean we 'll get somewhat fewer  , sets of digits , but  , I think that way we 'll cut into people 's time , if someone 's on strict time  , less .  , so , let 's see , we were having a discussion the other day , maybe we should bring that up , about  , the nature of the data that we are collecting .  @ @ that  , we should have a fair amount of data that is  , collected for the same meeting , so that we can ,  I don't know . Wh - what what were some of the points again about that ? Is it phd f: well , OK , I 'll back up . phd f: at the previous at last week 's meeting , this meeting I was griping about wanting to get more data and I I talked about this with Jane and Adam , and was thinking of this mostly just so that we could do research on this data  , since we 'll have a new this new student di does wanna work with us , phd a: Well , great . phd f: And he 's already funded part - time , so we 'll only be paying him for sort of for half of the normal part - time , phd a: What a deal . grad b: And what 's he interested in , specifically ? phd f: So he 's comes from a signal - processing background , but I liked him a lot cuz he 's very interested in higher level things , like language , and disfluencies and all kinds of eb maybe prosody , grad b:   Anyway , I thought OK , maybe we should have enough data so that if he starts he 'd be starting in January , next semester that we 'd have , you know , enough data to work with . phd f: But , Jane and Adam brought up a lot of good points that just posting a note to Berkeley people to have them come down here has some problems in that you m you need to make sure that the speakers are who you want and that the meeting type is what you want , and so forth . So , I thought about that and I think it 's still possible , but I 'd rather try to get more regular meetings of types that we know about , and hear , then sort of a mish - mosh of a bunch of one one - time grad b: One offs ? phd f: Yeah , just because it would be very hard to process the data in all senses , both to get the ,  to figure out what type of meeting it is and to do any kind of higher level work on it , like well , I was talking to Morgan about things like summarization , or what 's this meeting about .  it 's very different if you have a group that 's just giving a report on what they did that week , versus coming to a decision and so forth . Then I was  , talking to Morgan about some new proposed work in this area , sort of a separate issue from what the student would be working on where I was thinking of doing some kind of summarization of meetings or trying to find cues in both the utterances and in the utterance patterns , like in numbers of overlaps and amount of speech , sort of raw cues from the interaction that can be measured from the signals and from the diff different microphones that point to sort of hot spots in the meeting , or things where stuff is going on that might be important for someone who didn't attend to listen to . And in that  , regard , I thought we definitely w will need it 'd b it 'd be nice for us to have a bunch of data from a few different domains , or a few different kinds of meetings . So this this meeting is one of them , although I 'm not sure I can participate if I You know , I would feel very strange being part of a meeting that you were then analysing later for things like summarization . phd f: and then there are some others that menti that Morgan mentioned , like the front - end meeting and maybe a networking group meeting . phd f: But basically , for anything where you 're trying to get a summarization of some kind of meeting meaning out of the meeting , it would be too hard to have fifty different kinds of meetings where we didn't really have a good grasp on what does it mean to summarize , grad b: Yeah . phd f: but rather we should have different meetings by the same group but hopefully that have different summaries . And then we need a couple that of We don't wanna just have one group because that might be specific to that particular group , but @ @ three or four different kinds . So , in general , I was thinking more data but also data where we hold some parameters constant or fairly similar , grad b:   phd f: like a meeting about of people doing a certain kind of work where at least half the participants each time are the same . grad b:  professor d: Now , let l l let me just give you the other side to that cuz I ca because I I don't disagree with that , but I think there is a complimentary piece to it too . professor d: As many people here a a and talking about the kind of thing that you were just talking about it would have  too few people from my point of view . So ,  I think I would also very much like us to have a fair amount of really random scattered meetings , of somebody coming down from campus , and and  , phd c:   professor d: sure , if we can get more from them , fine , postdoc e:   professor d: but if we only get one or two from each group , that still could be useful acoustically just because we 'd have close and distant microphones with different people . postdoc e: Can I can I say about that that the the issues that I think Adam and I raised were more a matter of advertising so that you get more native speakers . Because I think if you just say an And in particular , my suggestion was to advertise to linguistics grad students because there you 'd have so people who 'd have proficiency enough in English that that  , it would be useful for for purposes You know . postdoc e: But you know , I think I 've been I 've I I 've gathered data from undergrads at on campus and if you just post randomly to undergrads I think you 'd get such a mixed bag that it would be hard to know how much conversation you 'd have at all . And and the English you 'd have The language models would be really hard to build professor d: Well , you want to i postdoc e: because it would not really be it would be an interlanguage rather than than a professor d: Well , OK , first place , I I I don't think we 'd just want to have random people come down and talk to one another , I think there should be a meeting that has some goal and point cuz I I think that 's what we 're investigating , postdoc e: OK . phd f: It has to be a a pre - existing meeting , like a meeting that would otherwise happen anyway . professor d: So I was I was thinking more in terms of talking to professors  , and and and  , senior  , d and  , doctoral students who are leading projects and offering to them that they have their hold their meeting down here . The second point is  I think that for some time now , going back through BeRP I think that we have had speakers that we 've worked with who had non - native accents and I th I think that postdoc e: Oh , oh . postdoc e: No , it 's more a matter of  , proficiency , e e just simply fluency . postdoc e: I deal with people on on campus who I think sometimes people , undergraduates  in computer science  , have language skills that make , you know that their their fluency and writing skills are not so strong . professor d: You 're just talking about postdoc e: Well , e I just think , grad b: We all had the same thought . postdoc e: but you know , it 's like when you get into the graduate level , no problem . professor d: But grad b: Well , I think that ,  I think that the only thing we should say in the advertisement is that the meeting should be held in English . And and I think if it 's a pre - existing meeting and it 's held in English , I I think it 's probably OK if a few of the people don't have  , g particularly good English skills . postdoc e: OK , now can I can I say the other aspect of this from my perspective which is that  , there 's there 's this this issue , you have a corpus out there , it should be used for for multiple things cuz it 's so expensive to put together . postdoc e: And if people want to approach  , i so I know e e You know this The idea of computational linguistics and probabilistic grammars and all may not be the focus of this group , professor d:  - huh . postdoc e: but the idea of language models , which are fund you know generally speaking  , you know , t t terms of like the amount of benefit per dollar spent or an hour invested in preparing the data , professor d:   postdoc e: if you have a choice between people who are pr more proficient in  , i more fluent , more more close to being academic English , then it would seem to me to be a good thing . I postdoc e: Because otherwise y you don't have the ability to have  , so if if you have a bunch of idiolects that 's the worst possible case . If you have people who are using English as a as an interlanguage because they they don't  , they can't speak in their native languages and but their interlanguage isn't really a match to any existing , language model , professor d:  - huh . professor d: Well , that 's pretty much what you 're going to have in the networking group . But the thing is , I think that these people are of high enough level in their in their language proficiency that professor d: I see . postdoc e: I I 'm I 'm just thinking that we have to think at a at a higher level view , could we have a language model , a a grammar a grammar , basically , that  , wo would be a a possibility . postdoc e: So y so if you wanted to bring in a model like Dan Jurafsky 's model , an and do some top - down stuff , it to help th the bottom - up and merge the things or whatever , it seems like  , I don't see that there 's an argument professor d:   postdoc e: I 'm I what I think is that why not have the corpus , since it 's so expensive to put together , useful for the widest range of of central corp things that people generally use corpora for and which are , you know , used in computational linguistics . professor d: OK , well , i i let 's let 's see what we can get .  , it it I think that if we 're aiming at at  , groups of graduate students and professors and so forth who are talking about things together , and it 's from the Berkeley campus , probably most of it will be OK , postdoc e: Yes , that 's fine . And my point in m in my note to Liz was I think that undergrads are an iff iffy population . grad b: Well , not to mention the fact that I would be hesitant certainly to take anyone under eighteen , probably even an anyone under twenty - one . professor d: Oh , you age - ist ! grad b: What 's that ? Well , age - ist . Well , Morgan , you were mentioning that Mari may not use the k equipment from IBM if they found something else , cuz there 's a professor d: They 're they 're yeah , they 're d they 're  assessing whether they should do that or y do something else , hopefully over the next few weeks . phd f: Cuz  , one remote possibility is that if we st if we inherited that equipment , if she weren't using it , could we set up a room in the linguistics department ? And and  , there there may be a lot more or or in psych , or in comp wherever , in another building where we could  , record people there . I think we 'd have a better chance grad b: I think we 'd need a real motivated partner to do that . But if there were such a  it 's a remote possibility , then  , you know , one of us could you know , go up there and record the meeting or something rather than bring all of them down here . phd f: So it 's just a just a thought if they end up not using the the hardware . professor d: Well , the other thing Yeah ,  the other thing that I was hoping to do in the first place was to turn it into some kind of portable thing so you could wheel it around .  , and grad b: Well , I know that space is really scarce on at least in CS . phd f: But you may not need a separate room , you know , grad b: That 's true . phd f: the idea is , if they have a meeting room and they can guarantee that the equipment will be safe and so forth , and if one of us is up there once a week to record the meeting or something grad b: True . professor d: Well , maybe John would let us put it into the phonology lab or something . grad b: Yeah , I think it would be interesting because then we could regularly get another meeting . phd c: But I I I think you need , another portable thing a another portable equipment to to do , eh , more e easier the recording process , eh , out from ICSI . phd c: Eh , if you you want to to record , eh , a seminar or a class , eh , in the university , you you need It - it would be eh eh very difficult to to put , eh , a lot of , eh , head phones eh in different people when you have to to record only with , eh , this kind of , eh , d device . grad b: Yeah , but I think if we if we wanna just record with the tabletop microphones , that 's easy . grad b: Right ? That 's very easy , phd c: Ye - Yeah , yeah . professor d: Actually , that 's a int that raises an interesting point that came up in our discussion that 's maybe worth repeating . We realized that , when we were talking about this that , OK , there 's these different things that we want to do with it . So , it 's true that we wanna be selective in some ways , the way that you were speaking about with , not having an interlingua and  , these other issues . But on the other hand , it 's not necessarily true that we need all of the corpus to satisfy all of it . So , a a as per the example that we wanna have a fair amount that 's done with a small n recorded with a small , typ number of types of meetings But we can also have another part that 's , just one or two meetings of each of a of a range of them and that 's OK too .  , i We realized in discussion that the other thing is , what about this business of distant and close microphones ?  , we really wanna have a substantial amount recorded this way , that 's why we did it . But what about For th for these issues of summarization , a lot of these higher level things you don't really need the distant microphone . phd f: Right , I c I think there 's grad b: And you don't really need the close microphone , you mean . phd f: Yea - yeah yeah , you actually don't really even need any fancy microphone . postdoc e: Which one did you mean ? professor d: You d You don't ne it doesn't you just need some microphone , somewhere . professor d: but  phd f: use  , but I think that any data that we spend a lot of effort to collect , professor d: Yeah . phd f: you know , each person who 's interested in  , we have a cou we have a bunch of different , slants and perspectives on what it 's useful for , they need to be taking charge of making sure they 're getting enough of the kind of data that they want . phd f: And So in my case , I think there w there is enough data for some kinds of projects and not enough for others . phd f: And so I 'm looking and thinking , " Well I 'd be glad to walk over and record people and so forth if it 's to help th in my interest . phd f: And other people need to do that for themselves , h or at least discuss it so that we can find some optimal professor d: Right . professor d: But I think that I 'm raising that cuz I think it 's relevant exactly for this idea up there that if you think about , " Well , gee , we have this really complicated setup to do , " well maybe you don't . professor d: Maybe if if If really all you want is to have a a a recording that 's good enough to get a  , a transcription from later , you just need to grab a tape recorder and go up and make a recording . professor d: we we could have a fairly We could just get a DAT machine and phd f: Well , I agree with Jane , though , on the other hand that phd c: Yeah . phd f: So that might be true , you may say for instance , summarization , or something that sounds very language oriented . You may say well , " Oh yeah , you just do that from transcripts of a radio show . phd f: But what you what I was thinking is long term what would be neat is to be able to pick up on  Suppose you just had a distant microphone there and you really wanted to be able to determine this . phd f: So I do think that long term you should always try to satisfy the greatest number of of interests and have this parallel information , which is really what makes this corpus powerful . phd f: Otherwise , you know , lots of other sites can propose individual studies , so professor d:  but I I think that the  i We can't really underestimate the difficulty shouldn't really u underestimate the difficulty of getting a setup like this up . professor d: And so ,  it took quite a while to get that together and to say , " Oh , we 'll just do it up there , " phd f: OK . professor d: If you 're talking about something simple , where you throw away a lot of these dimensions , then you can do that right away . Talking about something that has all of these different facets that we have here , it won't happen quickly , it won't be easy , and there 's all sorts of issues about th you know keeping the equipment safe , or else hauling it around , and all sorts of o phd f: So then maybe we should try to bring people here . professor d: I think the first priority should be to pry to get try to get people to come here . phd f: that 's that 's OK , so professor d: We 're set up for it . phd f: Yeah , I And I think we can get people to come here , that But the issue is you definitely wanna make sure that the kind of group you 're getting is the right group so that you don't waste a lot of your time and the overhead in bringing people down . professor d: Yeah , they have to do their digits or they don't get they don't get their food . professor d: Yeah grad b: Should I pursue that ? phd f: Oh , definitely , yeah . grad b: So I 'm not sure whether they 'll still be so willing to volunteer , but I 'll send an email and ask . phd f: I 'd love to get people that are not linguists or engineers , cuz these are both weird grad b: Right . professor d: The the The oth the other h phd f: well , I know , I shouldn't say that . The o the o the other The other thing is , that we we talked about is give to them  , burn an extra CD - ROM . professor d: and give them So if they want a basically and audio record of their phd f: Well , I thought that was I thought he meant , " Give them a music CD , " like they g Then he said a CD of the of their speech professor d: Oh . phd f: and I guess it depends of what kind of audience you 're talking to , but You know , I personally would not want a CD of my meeting , grad b: Mmm . Of the meeting ? phd f: but maybe yeah , maybe you 're professor d: If you 're having some planning meeting of some sort and  you 'd like phd f: right . professor d: We 're saying , " Look , you know , you 're gonna get this . It 's actually p It 's probably gonna be pretty useless to you , grad b: Yep . professor d: but you 'll ge appreciate , you know , where it 's useful and where it 's useless , phd f: Right . professor d: and then , we 're gonna move this technology , so it 'll become useful . phd a: What if you could tell them that you 'll give them the the transcripts when they come back ? postdoc e: Alth phd f: But we might need a little more to incentivize them , that 's all . postdoc e: I hav I have to  raise a little eensy - weensy concern about doing th giving them the CD immediately , because of these issues of , you know , this kind of stuff , where maybe You know ? professor d: Good point . professor d: So we can so we can postdoc e: We could burn it after it 's been cleared with the transcript stage . phd f: If It should be the same CD - ROM that we distribute publically , grad b: That 's a good point . phd f: right ? professor d: Although it 's phd f: Otherwise they 're not allowed to play it for anyone . postdoc e: Yeah , that 's right , say " Yeah , well , I got this CD , and , Your Honor , I " grad b: Yeah . So that was that topic , and then  , I guess another topic would be where are we in the whole disk resources question for grad b: We are slowly slowly getting to the point where we have  enough sp room to record meetings . So I  did a bunch of archiving , and still doing a bunch of archiving , I I 'm in the midst of doing the P - files from  , Broadcast News . phd c: Eleven ? grad b: And it 'll take another eleven to do the clone . phd a: Where did you copy it to ? grad b: Well , it 's Abbott . professor d: Sk - It 's copying from one place on Abbott to another place on Abbott ? grad b: Tape . phd a: Ah ! grad b: So I 'm archiving it , and then I 'm gonna delete the files . postdoc e: One thing The good news about that that is that once once it 's archived , it 's pretty quick to get back . professor d: Is it ? postdoc e: it it it The other direction is fast , but this direction is really slow . phd a: Generating a clone ? postdoc e: Yeah , that 's a good point . phd a: Oh ! Hunh ! professor d: S postdoc e: Now , what will  Is the plan to g to So stuff will be saved , it 's just that you 're relocating it ?  , so we 're gonna get more disk space ? Or did I ? grad b: No , the the these are the P - files from Broadcast News , which are regeneratable regeneratable postdoc e: OK . grad b: And so they they were two gigabytes per file and we had six of them or something . professor d: Or maybe six ? grad b: The SUN , ha  , takes more disks than the Andatico one did . The SUN rack takes Th - One took four and one took six , or maybe it was eight and twelve . professor d: How many How much phd a: Is there a difference in price or something ? grad b: Well , what happened is that we we bought all our racks and disks from Andatico for years , according to Dave , and Andatico got bought by another company and doubled their prices . I 've been looking at the , Aurora data and , first first look at it , there were basically three directories on there that could be moved . One was called Aurora , one was Spanish , which was Carmen 's Spanish stuff , and the other one was , SPINE . phd a: And so , I wrote to Dan and he was very concerned that the SPINE stuff was moving to a non - backed - up disk . So , I realized that well , probably not all of that should be moved , just the CD - ROM type data , the the static data . So I moved that , and then  , I asked him to check out and see if it was OK . I told him he could delete it if he wanted to , I haven't checked today to see if he 's deleted it or not . And then Carmen 's stuff , I realized that when I had copied all of her stuff to XA , I had copied stuff there that was dynamic data . professor d: So , but ,  y you 're figuring you can record another five meetings or something with the space that you 're clearing up from the Broadcast News , but , we have some other disks , some of which you 're using for Aurora , but are we g do we have some other other space now ? grad b: Yep . So , so , we have space on the current disk right now , where Meeting Recorder is , and that 's probably enough for about four meetings . phd a: OK , I but the stuff I 'm moving from Aurora is on the DC disk that we grad b: I don't remember . Yeah ,  we were at a hundred percent and then we dropped down to eighty - six for reasons I don't understand . And then with Broadcast News , that 's five or six more meetings , so , you know , we have a couple weeks .  , so , yeah , I think I think we 're OK , until we get the new disk . phd a: So should ,  One question I had for you was , we need we sh probably should move the Aurora an and all that other stuff off of the Meeting Recorder disk . Is there another backed - up disk that you know of that would ? grad b: We should put it onto the Broadcast News one . grad b: But , so we could ' jus just do that at the end of today , once the archive is complete , and I 've verified it . professor d: OK , @ @ So , then I guess th the last thing I 'd had on my my agenda was just to hear hear an update on what what Jose has been doing , phd c:  - huh . professor d: so phd c: I have , eh , The result of my work during the last days . Eh , and the the last , eh , days , eh , I work , eh , in my house , eh , in a lot of ways and thinking , reading eh , different things about the the Meeting Recording project . phd c: But for me , eh is interesting because , eh , eh , here 's i is the demonstration of the overlap , eh , problem . phd c: It 's a real problem , a frequently problem  , because you have overlapping zones eh , eh , eh , all the time . phd c: Eh , by a moment I have , eh , nnn , the , eh , n I I did a mark of all the overlapped zones in the meeting recording , with eh , a exact mark . Oh , you did that by hand ? phd c: Heh ? That 's eh , yet b b Yeah , by b b by hand by hand because , eh , eh " Why . " grad b: Can I see that ? Can I get a copy ? professor d: Oh . phd c: My my idea is to work phd a: Wow ! phd c: I I I do I don I don't @ @ I don't know , eh , if , eh , it will be possible because I I I haven't a lot eh , enough time to to to work .  , only just eh , six months , as you know , but , eh , my idea is , eh , is very interesting to to work in in the line of , eh , automatic segmenter . phd c: Eh but eh , eh , in my opinion , we need eh , eh , a reference eh session to t to to evaluate the the the tool . And so are you planning to do that or have you done that already ? phd c: And No , no , with i grad b: Have you done that or are you planning to do that ? phd c: Sorry ? No , I I plan to do that . Darn ! phd c: I plan I plan , but eh , eh , the idea is the is the following . I I will I will eh , talk about eh , in the in the blackboard about the my ideas . phd c: Eh , eh This information eh , with eh , exactly time marks eh , for the overlapping zones eh overlapping zone , and eh , a speaker a a pure speech eh , eh , speaker zone .  , eh zones eh of eh speech of eh , one speaker without any any eh , noise eh , any any acoustic event eh that eh , eh , w eh , is not eh , speech , real speech . And , I need t true eh , silence for that , because my my idea is to to study the nnn the the set of parameters eh , what , eh , are more m more discriminant to eh , classify . The idea is to eh to use eh , I 'm not sure to eh yet , but eh my idea is to use a a cluster eh algorithm or , nnn , a person strong in neural net algorithm to eh to eh study what is the , eh , the property of the different feat eh feature , eh , to classify eh speech and overlapping eh speech . phd c: And my idea is eh , it would be interesting to to have eh , a control set . And my control set eh , will be the eh , silence , silence without eh , any any noise . postdoc e: Which means that we 'd still You 'd hear the grad b: Yeah , fans . phd c: Eh , I  eh , noise eh , eh claps eh , tape clips , eh , the difference eh , professor d:   phd c: eh , eh , event eh , which , eh , eh , has , eh eh , a hard effect of distorti spectral distortion in the in the eh speech . grad b: So so you intend to hand - mark those and exclude them ? professor d:   phd c: Yeah , I have mark in in in in that Not in all in all the the file , grad b:   phd c: only eh , eh , nnn , mmm , I have eh , ehm I don't remind what is the the the the quantity , but eh , I I have marked enough speech on over and all the overlapping zones . I have , eh , two hundred and thirty , more or less , overlapping zones , and is similar to to this information , grad b: Whew !   phd c: because with the program , I cross the information of  , of Jane with eh , my my segmentation by hand . phd c: And the the idea is , eh , I I will use , eh , I want My idea is , eh , to eh to classify . phd c: I I need eh , the exact eh , mark of the different , eh , eh , zones because I I want to put , eh , for eh , each frame a label indicating . I I I put , eh , eh , for each frame a label indicating what is th the type , what is the class , eh , which it belong . phd c: Eh , the class you will overlapping speech " overlapping " is a class , eh , " speech " @ @ the class that 's grad b: Nonspeech . phd a: These will be assigned by hand ? phd c: a I I I ha I h I I put the mark by hand , phd a: Based on the  - huh . phd c: because , eh , my idea is , eh , in in the first session , I need , eh , I I need , eh , to be sure that the information eh , that , eh , I I will cluster , is is right . Because , eh , eh , if not , eh , I will I will , eh , return to the speech file to analyze eh , what is the problems , grad b: Well , training , and validation . And I I 'd prefer I would prefer , the to to have , eh , this labeled automatically , but , eh , eh , fro th I need truth . So , the difference between the top two , i So so I start at the bottom , so " silence " is clear . By " speech " do you mean speech by one sp by one person only ? phd c: Speech Yeah . postdoc e: So this is un OK , and then and then the top includes people speaking at the same time , or or a speaker and a breath overlapping , someone else 's breath , or or clicking , overlapping with speech So , that that 's all those possibilities in the top one . phd c: Eh , in the first moment , because , eh , eh , I I have information , eh , of the overlapping zones , eh , information about if the , eh , overlapping zone is , eh , from a speech , clear speech , from a one to a two eh speaker , or three speaker , or is is the zone where the breath of a speaker eh , overlaps eh , onto eh , a speech , another , especially speech . postdoc e: So it 's basi it 's basically speech wi som with with something overlapping , which could be speech but doesn't need to be . phd c: No , no , es especially eh , overlapping speech from , eh , different eh , eh , speaker . Eh professor d: No , but there 's but , I think she 's saying " Where do you In these three categories , where do you put the instances in which there is one person speaking and other sounds which are not speech ? " phd c: Ah ! professor d: Which category do you put that in ? postdoc e: Yeah , that 's right . Yeah , he here I I put eh speech from eh , from , eh , one speaker without , eh , eh , any any any events more . postdoc e: Oh ! professor d: Right , so where do you put speech from one speaker that does have a nonspeech event at the same time ? phd c: Where ? Where What is the class ? professor d: Which catege which category ? postdoc e: Like a c phd c: No . phd c: For for the by the @ @ no , @ @ because I I I I want to limit the the nnn , the the study . grad b: Yeah , so that 's what he was saying before , is that he excluded those . phd c: " Why ? Why ? What 's the reason ? " because i it 's the first study . In the in the future , the the idea is to to extend the class , phd a: Is is phd c: to consider all the all the information , you you mentioned before professor d: Yeah . phd c: but eh , the the first idea Because eh , I don't know what hap what will happen with the study . i it 's pure phd a: What if there was a door - slam or something ? phd c: No , no , it 's pure silence . professor d: What you Well w I I think what you m I think what you mean is that it 's nonspeech segments that don't have impulsive noises . professor d: Right ? Cuz you 're calling what you 're calling " event " is somebody coughing or clicking , or rustling paper , or hitting something , which are impulsive noises . Right ? phd c: h here yet , yet I I I I I think I I think , eh , there are that some kind of noises that , eh , don't don't wanted to to be in that , eh , in that control set . phd c: But I prefer , I prefer at at the first , eh , the the silence with eh , this eh this kind of the of eh of noise . professor d: Right , it 's  , it 's " Background " might be might be a better word than " silence " . phd c: And , with this information The idea is eh , eh , nnn , I have a label for for each , eh , frame and , eh with a cluster eh algorithm I and postdoc e: Well , we needed to get the categories , yeah . And eh I am going to prepare a test bed , eh , well , eh , a a set of feature structure eh , eh , models . phd c: I have to to test , but eh I phd a: You have your own ? phd c: Yeah , yeah , yeah . Is a modified version of of of a pitch tracker , eh , from , eh , Standar - eh Stanford University in Stanford ? No . phd a: Oh ! What 's it written in ? phd c: Eh , em , I I I don't remember what is the the name of the of the author , because I I have several I have eh , eh , em , eh , library tools , from eh , Festival and of from Edinburgh eh , from Cambridge , eh , and from our department . phd c: And And I have to because , in general the pitch tracker , doesn't work very well and grad b: Bad . This this is And th the idea is to to , eh , to obtain , eh , for example , eh , eh diff eh , eh , different well , no , a great number of eh FEC for example , eh , eh , twenty - five , eh , thirty thirty parameters , eh , for for each one . And in a first eh , nnn , step in the investi in the research in eh , my idea is try to , eh , to prove , what is the performance of the difference parameter , eh to classify the different , eh , what is the the the the front - end approach to classify eh , the different , eh , frames of each class eh and what is the the , nnn , nnn , nnn , eh , what is the , the error eh , of the data grad b: Supervised clustering . phd c: and the second is try to eh , to use some ideas eh , similar to the linear discriminant analysis . phd c: Eh ? Eh , similar , because the the idea is to to study what is the contribution of eh , each parameter to the process of classify correctly the different the different parameters . What sort of classifier ar ? phd c: Eh , the the the classifier is nnn by the moment is eh is eh , similar , nnn , that the classifier used eh , in a quantifier vectorial quantifier is eh , used to to eh , some distance to to put eh , a vector eh , in in a class different . grad b: Unimodal ? phd c: Is Yeah ? W with a model , is is only to cluster using a eh , @ @ or a similarity . grad b: So is it just one cluster per phd c: A another possibility it to use eh a netw netw a neural network . phd c: But eh what 's the p What is my idea ? What 's the problem I I I I see in in in if you you use the the neural network ? If w when this kind of eh , mmm , cluster , clustering algorithm to can test , to can eh observe what happened you you can't you can't eh , eh put up with your hand in the different parameter , grad b: Right , you can't analyse it . phd c: but eh If you use a neural net is is a good idea , but eh you don't know what happened in the interior of the neural net . professor d: Well , actually , you can do sensitivity analyses which show you what the importance of the different parce pieces of the input are . professor d: It 's hard to w w what you It 's hard to tell on a neural net is what 's going on internally . professor d: But it 's actually not that hard to analyse it and figure out the effects of different inputs , especially if they 're all normalized . professor d: Well , this isn't tru if if if you really wonder what different if if phd c: Yeah . phd c: But professor d: Yeah , then a decision tree is really good , but the thing is here he 's he 's not he 's not like he has one you know , a bunch of very distinct variables , like pitch and this he 's talking about , like , a all these cepstral coefficients , and so forth , grad b: Right . professor d: in which case a a any reasonable classifier is gonna be a mess , and it 's gonna be hard to figure out what what  phd c: And grad b: Right . professor d: I  , I think the other thing that one  , this is , I think a good thing to do , to sort of look at these things at least See what I 'd I 'd Let me tell you what I would do . Instead of taking all the MFCC 's , or all the PLP 's or whatever , I would just take a couple . professor d: OK ? Like like C - one , C - two , something like that , so that you can visualize it . professor d: OK , so before you do build up any kind of fancy classifiers , just take a look in two dimensions , at how these things are split apart . professor d: That I think will give you a lot of insight of what is likely to be a useful feature when you put it into a more complicated classifier . professor d: And the second thing is , once you actually get to the point of building these classifiers , @ @ what this lacks so far is the temporal properties . So if you 're just looking at a frame and a time , you don't know anything about , you know , the structure of it over time , and so you may wanna build @ @ build a Markov model of some sort  , or or else have features that really are based on  on on some bigger chunk of time . But don't  anyway , this is my suggestion , is don't just , you know , throw in twenty features at it , the deltas , and the delta del and all that into some classifier , even even if it 's K - nearest - neighbors , you still won't know phd c: Yeah . professor d: what it 's doing , even You know it 's  , I think to know what it 's to have a better feeling for what it 's grad b: Yep . professor d: look at at som some picture that shows you , " Here 's These things  ,  are offer some separation . " And , in LPC , the thing to particularly look at is , I think is something like , the residual phd c: Yeah . S postdoc e: Can I ask ? It strikes me that there 's another piece of information  , that might be useful and that 's simply the transition . So , w if you go from a transition of silence to overlap versus a transition from silence to speech , there 's gonna be a b a big informative area there , it seems to me . phd c: I eh the the Meeting Recorder project , for me , has eh , two eh , w has eh several parts , several p objective professor d:   But eh , at the first , in the acoustic , eh , eh , parts of the project , eh I think you eh we have eh two main eh objective . And for that , if you don't use , eh , eh , a speech recognizer , eh broad class , or not broad class to to try to to to label the different frames , I think the Ike criterion or BIC criterion eh will be enough to detect the change . When you you have , eh , eh s eh the transition of speech or or silence eh to overlap zone , this criterion is enough with probably with , eh , this kind of , eh , eh the the the more eh use eh use eh used eh em normal , regular eh parameter MF - MFCC . But eh eh I I understand that you your objective is to eh classify , to know that eh that zone not is only a new zone in the in the file , that eh you have eh , but you have to to to know that this is overlap zone . because in the future you will eh try to to process that zone with a non - regular eh eh speech recognizer model , I suppose . phd c: you you will pretend to to to process the overlapping z eh zone with another kind of algorithm professor d:   phd c: because it 's very difficult to to to obtain the transcription from eh using eh eh a regular , normal speech recognizer . phd c: A model to detect more acc the mor most accurately possible that is p  , will be possible the , eh the mark , the change and another another model will @ @ or several models , to try s but eh several model eh robust models , sample models to try to classify the difference class . grad b: I 'm I 'm I 'm sorry , I didn't understand you what you said . What what model ? postdoc e:  phd c: Eh , the the classifiers of the of the n to detect the different class to the different zones before try to to recognize , eh with eh to transcribe , with eh a speech recognizer . phd c: And my idea is to use eh , for example , a neural net postdoc e: So p phd c: with the information we obtain from this eh this eh study of the parameter with the selected parameter to try to eh to put the class of each frame . phd c: you you eh , eh have obtained in the first eh , step with the for example , BIC eh , eh criterion compare model postdoc e:   phd c: And You I don't - u professor d: OK , but , I I think in any event we 're agreed that the first step is phd c: i postdoc e: Yeah . professor d: Because what we had before for for  , speaker change detection did not include these overlaps . professor d: So the first thing is for you to to build up something that will detect the overlaps . professor d: Right ? So again , I think the first thing to do to detect the overlaps is to look at these  , in in in in grad b: Features ? phd c: Yeah . professor d: Well , I again , the things you 've written up there I think are way too way too big . professor d: OK ? If you 're talking about , say , twelfth twelfth - order  MFCC 's or something like that it 's just way too much . All you 'll be able to do is put it into a classifier and see how well it does . professor d: Whereas I think if you have things if you pick one or two dimensional things , or three of you have some very fancy display , and look at how the the different classes separate themselves out , you 'll have much more insight about what 's going on . professor d: Well , you 'll you 'll get a feeling for what 's happening , you know , phd c: Yeah . professor d: so if you look at Suppose you look at first and second - order cepstral coefficients for some one of these kinds of things and you find that the first - order is much more effective than the second , and then you look at the third and there 's not and not too much there , you may just take first and second - order cepstral coefficients , phd c: Yeah . professor d: right ? And with LPC , I think LPC per se isn't gonna tell you much more than than than the other , maybe .  , and  on the other hand , the LPC residual , the energy in the LPC residual , will say how well ,  the low - order LPC model 's fitting it , which should be pretty poorly for two two or more people speaking at the same time , and it should be pretty well , for w for for one . professor d: And so I i again , if you take a few of these things that are are prob  promising features and look at them in pairs , I think you 'll have much more of a sense of " OK , I now have  , doing a bunch of these analyses , I now have ten likely candidates . phd c: but eh , eh eh eh eh I don't know it is the first eh way to to do that and I would eh like to to know what eh , your opinion . Eh all this study in the f in the first moment , I I w I I will pretend to do with eh eh equalizes speech . grad b: With postdoc e: With what ? With what ? grad b: Right . phd c: Eh , why ? Because eh the spectral distortion is more eh a lot eh clearer , very much clearer if we compare with the PDA . phd c: fff ! Because the n the noise eh to sp the signal - to - noise relation is eh is is low . phd c: I don't know eh  i i that eh the the result of the of the study eh with eh with eh this eh this speech , the mix speech eh will work exactly with the eh PDA files . phd c: eh What , I  , what what is the effect of the low ' signal to to to noise relation , you know , eh with professor d: N u We Well , I think I think I think it 's not a it 's not at all unreasonable . It makes sense to start with the simpler signal because if you have features which don't aren't even helpful in the high signal - to - noise ratio , then there 's no point in putting them into the low signal ratio , one would think , anyway . professor d: And so , if you can get @ @  again , my prescription would be that you would , with a mixed signal , you would take a collection of possible  , features look at them , look at how these different classes that you 've marked , separate themselves , and then collect ,  in pairs , and then collect ten of them or something , and then proceed with a bigger classifier . professor d: And then if you can get that to work well , then you go to the other signal . And then , and you and you know , they won't work as well , but how m you know , how much grad b: Right . Because it I think it would be interesting to see if some features work well with close mixed , and And don't professor d:  . professor d: That 's well , the It it 's it 's true that it also , it could be useful to do this exploratory analysis where you 're looking at scatter plots and so on in both cases . phd c: I I I I think that the the eh parameter we found , eh , eh worked with both eh , speech file , postdoc e: That 's good . phd c: but eh what is the the the relation of eh of the performance when eh you use eh the , eh eh speech file the PDA speech files . Is eh is not easy eh to to solve , because if you I I I have seen the the the speech file from eh PDA , and s some parts is very difficult because you you don't see the spectrum the spectrogram . phd c: Is very difficult to apply eh , eh a parameter to detect change when you don't see . Well , that that that 's another reason why very simple features , things like energy , and things things like harmonicity , and residual energy are  , yeah are are better to use than very complex ones because they 'll be more reliable . phd a: Yeah , I maybe this is a dumb question , but w I thought it would be I thought it would be easier if you used a PDA professor d: Nah . phd a: because can't you , couldn't you like use beam - forming or something to detect speaker overlaps ?  grad b: Well , if you used the array , rather than the signal from just one . professor d: Yeah , no , you you 're you 're right grad b: But that 's professor d: that In fact , if we made use of the fact that there are two microphones , you do have some location information . which we don't have with the one and and so that 's phd a: Is that not allowed with this project ? professor d: well , no , we we don't have any rules , r really . professor d: I think I I think I think it 's it 's it 's a it 's an additional interesting question . professor d: I think you wanna know whether you can do it with one , because you know it 's not necessarily true that every device that you 're trying to do this with will have two . professor d: if , on the other hand , we show that there 's a huge advantage with two , well then that could be a real point . professor d: But , we don't n even know yet what the effect of detecting having the ability to detect overlaps is . postdoc e: There there is a complication though , and that is if a person turns their back to the to the PDA , then some of the positional information goes away ? phd c: Yeah . professor d: Well , it it it does , i it d it does , but the the the issue is that that phd a: No , it 's not it 's not that so much as postdoc e: And then , And if they 're on the access on the axis of it , that was the other thing I was thinking . postdoc e: He You mentioned this last time , that that if if you 're straight down the midline , then then the r the left - right 's gonna be different , grad b: Yeah , we hav need to put it on a little turntable , phd c: I I I I I th grad b: and phd a: Well , it 's phd c: Yeah . postdoc e: It seems to me that that it 's not a p  , you know , it 's this the topograph the topology of it is is a little bit complicated . phd a: I don't I don't know ho phd c: I I I think Sorry . I I I think because the the the distance between the two microph eh , microphone , eh , in the PDA is very near . But it 's  from my opinion , it 's an interesting idea to to try to study the binaural eh problem eh , with information , because I I found difference between the the speech from from each micro eh , in the PDA . It - it 's not amplitude , postdoc e: Oh yeah ! Oh I agree ! And we use it ourselves . postdoc e: But I 'm just I 'm just saying that the way we 're seated around a table , is not the same with respect to each to each person with respect to the PDA , phd c: No . postdoc e: so we 're gonna have a lot of differences with ref respect to the speaker . phd c: But professor d: That 's So so i @ @ I think the issue is , " Is there a clean signal coming from only one direction ? " phd a: Right . professor d: If it 's not coming from just one direction , if it if th if there 's a broader pattern , it means that it 's more likely there 's multiple people speaking , phd c: Yeah . phd a: So it 's sort of like how how confused is it about where the beam is . professor d: Yeah , is there a narrow Is there a narrow beam pattern or is it a a distributed beam pattern ? So if there 's a distributed beam pattern , then it looks more like it 's it 's  , multiple people . OK , it just it just seemed to me that  , that this isn't the ideal type of separation .  , I I think it 's I can see the value o professor d: Oh , ideal would be to have the wall filled with them , but  But the thing is just having two mikes If you looked at that thing on on Dan 's page , it was When when there were two people speaking , and it looked really really different . phd a: Did - Sorry , b  I 'm not sure what Dan 's page is that you mean . professor d: You take the signal from the two microphones and you cros and you cross - correlate them with different lags . So when one person is speaking , then wherever they happen to be at the point when they 're speaking , then there 's a pretty big maximum right around that point in the l in in the lag . professor d: So if at whatever angle you are , at some lag corresponding to the time difference between the two there , you get this boost in the in in the cross - correlation value function . phd a: So so if there 's two grad b: And if there are multiple people talking , you 'll see two peaks . postdoc e: Well , let me ask you , if if both people were over there , it would be less effective than if one was there and one was across , catty - corner ? phd c: Yeah . The - the Oh , I 'm sorry , postdoc e: No ? professor d: if they 're right next to one another ? phd a: If I was if I was here and Morgan was there and we were both talking , it wouldn't work . professor d: i i postdoc e: Next next one over n over on this side of the P PDA . postdoc e: Versus you versus you know , and we 're catty - corner across the table , and I 'm farther away from this one and you 're farther away from that one . grad b: Or or even if , like , if people were sitting right across from each other , you couldn't tell the difference either . Yeah , so it 's postdoc e: And so my point was just that it 's it 's gonna be differentially differentially varia valuable . postdoc e: it 's not to say  , I certainly think it 's extremely val And we we humans n n depend on you know , these these binaural cues . professor d: But it 's almost but it 's almost a I think what you 're talking about i there 's two things . professor d: There 's a sensitivity issue , and then there 's a pathological error  issue . professor d: If someone just happens to be sitting right there then we won't get good information from it . and i and if there So it And if it 's the two of you guys on the same side professor d: if they 're if they 're close , it 's just a question of the sensitivity . professor d: So if the sensitivity is good enough and we just we just don't have enough , experience with it to know how postdoc e: Yeah . postdoc e: Oh I 'm not I 'm not trying to argue against using it , by any means . I just wanted to point out that that weakness , that it 's topo topologically impossible to get it perfect for everybody . professor d: the other thing you can do  , if  , i We 're assuming that it would be a big deal just to get somebody convince somebody to put two microphones in the PDA . And then you know then you 're sort of Yeah , then then you pretty much could cover phd a: Once you got two postdoc e: Interesting . phd a: Well what about just doing it from these mikes ? postdoc e: Interesting . phd c: It will be more interesting to study the PZM because the the the separation I I think professor d:  @ @ But - but that 's  , we can we 'll be all of this is there for us to study . professor d: But but but the thing is , one of the at least one of the things I was hoping to get at with this is what can we do with what we think would be the normal situation if some people get together and one of them has a PDA . phd a: That 's what I was asking about , what are the constraints ? phd c: Yeah . professor d: Well , that 's that 's the constraint of one question that I think both Adam and I were were were interested in . professor d: but you know if you can instrument a room , this is really minor league compared with what some people are doing , right ? Some people at at  , yeah , at Brown and and and and at   and at Cape , grad b: Big micro @ @ arrays . phd a: Didn't they have something at Cape ? professor d: they both have these , you know , big arrays on the wall . And you know , if you could do that , you 've got microphones all over the place grad b: Very finely . professor d: you know p tens of microphones , and and  phd a: Oh ! I saw a demo . professor d: And if you do that then you can really get very nice  kind of selectivity phd a: Yeah . grad b: Oh , I saw one that was like a hundred microphones , a ten by ten array . phd a: And you could In a noisy room , they could have all kinds of noises and you can zoom right in on somebody . grad b: It was all in software and they and you could pick out an individual beam and listen to it . professor d: But , the reason why I haven't focused on that as the fir my first concern is because  , I 'm interested in what happens for people , random people out in some random place where they 're p having an impromptu discussion . And you can't just always go , " well , let 's go to this heavily instrumented room that we spent tens of thousands of dollars to se to set up " . phd a: No , what you need to do is you 'd have a little fabric thing that you unroll and hang on a wall . phd a: It has all these mikes and it has a plug - in jack to the PDA . grad b: But I think professor d: The other thing actually , that gets at this a little bit of something else I 'd like to do , is what happens if you have two P D grad b: Yep . professor d: and they communicate with each other ? And then You know , they 're in random positions , the likelihood that  , basically there wouldn't be any l likely to be any kind of nulls , if you even had two . grad b: Though All sorts of interesting things you can do with that , postdoc e: Interesting . grad b: not only can you do microphone arrays , but you can do all sorts of  multi - band as well . postdoc e: Ah ! phd a: I still like my rug on the wall idea , so if anybody patents that , then grad b: But I think postdoc e: Well , you could have strips that you stick to your clothing . phd a: Hats ? grad b: In terms of the research th research , it 's really it 's whatever the person who is doing the research wants to do .  , I i I i I would actually kind of like us to wind it down , see if we can still get to the end of the , birthdays thing there . professor d: So grad b: Well , I had a couple things that I did wanna bring out . grad b: One is , do we need to sign new these again ? postdoc e: Well , it 's slightly different . phd a: Are they new ? postdoc e: Cuz it it 's slightly different . professor d: Oh , this morning we didn't sign anything cuz we said that if anybody had signed it already , we didn't have to . grad b: Yeah , I I should 've checked with Jane first , but the ch the form has changed . grad b: I had some things I wanted to talk about with the thresholding stuff I 'm doing . postdoc e: I had to make one grad b: But , if we 're in a hurry , we can put that off . postdoc e: Well , should I  I have some results to present , but  I guess we won't have time to do that this time . But it seems like  the anonymization is  , is also something that we might wanna discuss in greater length .  , wha what postdoc e: If if we 're about to wind down , I think what I would prefer is that we  , delay the anonymization thing till next week , and I would like to present the results that I have on the overlaps . @ @ It sounds like u  , there were there were a couple technical things people would like to talk about . Why don't we just take a couple minutes to to briefly do them , and then and then and then and then and then we grad b: OK , go ahead , Jane . postdoc e: I 'd Oh , I 'd prefer to have more time for my results . postdoc e: And I think the anonymization , if y if you want to proceed with that now , I just think that that 's that 's a discussion which also n really deserves a lo a you know , more that just a minute . postdoc e: I really do think that , because you raised a couple of possibilities yourself , you and I have discussed it previously , and there are different ways that people approach it , e and I think we should grad b: Alright . We 're we 're just We 're getting enough data now that I 'd sort of like to do it now , before I get overwhelmed with once we decide how to do it postdoc e: Well , OK . I I 'll give you the short version , but I do think it 's an issue that we can't resolve in five minutes . postdoc e: OK , so the the short thing is  , we have  , tape recording  , sorry , digitized recor recordings . postdoc e: Now , in terms of like the transcript , the question becomes what symbol are you gonna put in there for everybody 's name , and whether you 're gonna put it in the text where he says " Hey Roger " or are we gonna put that person 's anonymized name in instead ? grad b: No , because then that would give you a mapping , and you don't wanna have a mapping . postdoc e: OK , so first decision is , we 're gonna anonymize the same name for the speaker identifier and also in the text whenever the speaker 's name is mentioned . Because that would give you a mapping between the speaker 's real name and the tag we 're using , and we don't want postdoc e: I I don't think you understood what I what I said . postdoc e: So  , so in within the context of an utterance , someone says " So , Roger , what do you think ? " OK . Then , it seems to me that Well , maybe I  it seems to me that if you change the name , the transcript 's gonna disagree with the audio , and you won't be able to use that . grad b: We don't we wanna we ha we want the transcript to be " Roger " . grad b: Because if we made the the transcript be the tag that we 're using for Roger , someone who had the transcript and the audio would then have a mapping between the anonymized name and the real name , and we wanna avoid that . postdoc e: OK , well , but then there 's this issue of if we 're gonna use this for a discourse type of thing , then and , you know , Liz was mentioning stuff in a previous meeting about gaze direction and who 's who 's the addressee and all , then to have " Roger " be the thing in the utterance and then actually have the speaker identifier who was " Roger " be " Frank " , that 's going to be really confusing and make it pretty much useless for discourse analysis . postdoc e: Now , if you want to , you know , in some cases , I I I know that Susan Ervin - Tripp in some of hers , actually did do  , a filter of the s signal where the person 's name was mentioned , except professor d: Yeah Yeah , once you get to the publication you can certainly do that . postdoc e: And and I cer and I So , the question then becomes one level back .  , how important is it for a person to be identified by first name versus full name ? Well , on the one hand , it 's not a full identity , we 're taking all these precautions ,  and they 'll be taking precautions , which are probably even the more important ones , to they 'll be reviewing the transcripts , to see if there 's something they don't like OK . On the other hand , this is a small this is a small pool , and people who say things about topic X e who are researchers and well - known in the field , they 'll be identifiable and simply from the from the first name . However , taking one step further back , they 'd be identifiable anyway , even if we changed all the names . postdoc e: So , is it really ,  You know ? grad b: Ugh ! postdoc e: Now , in terms of like so I I did some results , which I 'll report on n next time , which do mention individual speakers by name . Now , it would be very possible for me to take those data put them in a in a study , and just change everybody 's name for the purpose of the publication . And someone who looked professor d: You can go , you know , " Z "  , for instance .  , yeah , t it doesn't  , I 'm not knowledgeable about this , but it certainly doesn't bother me to have someone 's first name in in the in the transcript . postdoc e: Yeah , and and in the form that they sign , it does say " your first name may arise in the course of the meetings " . So again , th the issue is if you 're tracking discourse things , you know , if someone says , " Frank said this " and then you wanna connect it to something later , you 've gotta have this part where that 's " Frank colon " . grad b: Yeah , shoot ! professor d: Right ? postdoc e: Yeah , and and you know , even more i i  , immediate than that just being able to ,  Well , it just seems like to track track from one utterance to the next utterance who 's speaking and who 's speaking to whom , cuz that can be important . postdoc e: S i You know , " You raised the point , So - and - so " , it 's be kind of nice to be able to know who " you " was . postdoc e: And ac and actually you remember furthermore , you remember last time we had this discussion of how you know , I was sort of avoiding mentioning people 's names , professor d: Yeah , I was too . Well , if we 're going to step in after the fact and change people 's names in the transcript , we 've basically done something one step worse . Well , I would sug I I don't wanna change the names in the transcript , phd c: Yeah . grad b: but that 's because I 'm focused so much on the acoustics instead of on the discourse , and so I think that 's a really good point . L let me just back up this to make a a brief comment about the , what we 're covering in the meeting .  I realize when you 're doing this that   , I didn't realize that you had a bunch of things that you wanted to talk about . So I think what would be helpful would be  , i and I 'll I 'll mention this to to Liz and Andreas too , that  , before the meeting if anybody could send me , any any , agenda items that they were interested in and I 'll I 'll take the role of organizing them  , into into the agenda , postdoc e: OK . I 've no desire to to make it up , but if if no one 's told me things , then I 'm just proceeding from my my guesses , and and  , and i ye yeah , I I 'm sorry it ended up with your out your time to  , I 'm just always asking Jose what he 's doing , you know , and and so it 's There 's  , there 's obviously other things going on . grad b: How will we how would the person who 's doing the transcript even know who they 're talking about ? Do you know what I 'm saying ? phd a: " The person who 's doing the transcript " The IBM people ? grad b: Yeah .  , so so how is that information gonna get labeled anyway ? postdoc e: How do you mean , who what they 're who they 're talking about ? grad b: so if I 'm saying in a meeting , " oh and Bob , by the way , wanted wanted to do so - and - so " , postdoc e: How do you mean ? phd a: They 're just gonna write " Bob " on it or do @ @ grad b: if you 're doing Yeah , @ @ they 're just gonna write " Bob " . If you 're if you 're doing discourse analysis , postdoc e: They won't be able to change it themselves . professor d: What ar how are they gonna do any of this ? grad b: Yeah , really . postdoc e: Well , I I 'm betting we 're gonna have huge chunks that are just totally un untranscribable by them . professor d: they 're gonna say speaker - one , or speaker - two or speaker  I I phd a: They can't do that . phd c: Yeah , I think grad b: Well , the current one they don't do speaker identity . phd c:  grad b: because in NaturallySpeaking , or , excuse me , in ViaVoice , it 's only one person . I think that My understanding from Yen Is it Yen - Ching ? Is that how you pronounce her name ? professor d:  Yu - Ching , Yu - Ching . postdoc e: Oh ,  Yu - Ching ? Yu - Ching ? grad b: y Yu - Ching . postdoc e: was that  , they will that they will adopt the part of the conventions that that we discussed , where they put speaker identifier down . But , you know , h they won't know these people , so I think it 's Well , they 'll they 'll adopt some convention but we haven't specified to them So they 'll do something like speaker - one , speaker - two , is what I bet , but I 'm betting there 'll be huge variations in the accuracy of of their labeling the speakers . professor d: And it and it may very well be  , since they 're not going to sit there and and and worry ab about , it being the same speaker , they may very well go the eh the the first se the first time it changes to another speaker , that 'll be speaker - two . professor d: And the next time it 'll be speaker - three even if it 's actually speaker - one . grad b: Yeah we we can probably regenerate it pretty easily from the close - talking mikes . phd c:  postdoc e: Yes , I was thinking , the temp the time values of when it changes . grad b: The p It 's a good point , " which what do you do for discourse tracking ? " phd c: Because y y you don't know to know , eh you don't need to know what i what is the iden identification of the of the speakers . If if if if someone says , " what what is Jose doing ? " and then Jose says something , you need to know that that was Jose responding . postdoc e: Unless we adopt a different set of norms which is to not id to make a point of not identifying people by name , which then leads you to be more contextually ex explicit . You know ?  , so when we did this las last week , I felt that you know , now , Andreas may , @ @  , he he i sometimes people think of something else at the same time and they miss a sentence or something , and and because he missed something , then he missed the r the initial introduction of who we were talking about , and was was unable to do the tracking . postdoc e: But I felt like most of us were doing the tracking and knew who we were talking about and we just weren't mentioning the name . phd a: But , you know , like , at the beginning of this meeting Or , you I think said , you know , or s Liz , said something about  , " is Mari gonna use the equipment ? "  , how would you say that ? postdoc e: Yeah ? phd a: you have to really think , you know , about what you 're saying bef grad b: if you wanted to anonymize . Yeah , is professor d: " Is you know who up in you know where ? " phd a: Yeah . professor d: Right ? Use the phd a: I think it would be really hard if we made a policy where we didn't say names , plus we 'd have to tell everybody else . grad b: Yeah , darn !  , what I was gonna say is that the other option is that we could bleep out the names . phd a: I I think the I think I don't know , my own two cents worth is that you don't do anything about what 's in the recordings , you only anonymize to the extent you can , the speakers have signed the forms and all . grad b: Well , but that but that as I said , that that that works great for the acoustics , but it it hurts you a lot for trying to do discourse . grad b: Because you don't have a map of who 's talking versus their name that they 're being referred to . phd a: I thought we were gonna get it labelled speaker - one , speaker - two grad b: Sure but , h then you have to know that Jose is speaker - one and phd a: Why do you have to know his name ? professor d: OK , so suppose someone says , " well I don't know if I really heard what  , what Jose said . professor d: So  u phd a: Oh , I see , you wanna associated the word " Jose " in the dialogue with the fact that then he responded . professor d: And so , if we pass out the data to someone else , and it says " speaker - five " there , we also have to pass them this little guide that says that speaker - five is Jose , grad b: And that violates our privacy . professor d: and if were gonna do that we might as well give them " Jose " say it was " Jose " . postdoc e: Now , I I think that we have these two phases in the in the data , which is the one which is o our use , University of Washington 's use , IBM , SRI . postdoc e: And within that , it may be that it 's sufficient to not  change the to not incorporate anonymization yet , but always , always in the publications we have to . postdoc e: And I think also , when we take it that next step and distribute it to the world , we have to . But I but I don that 's that 's a long way from now and and it 's a matter of between now and then of d of deciding how grad b: Making some decisions ? postdoc e: i i it You know , it may be s that we we 'll need to do something like actually X out that part of the  the audio , and just put in brackets " speaker - one " . phd c: the ? ? grad b: You know , what we could do also is have more than one version of release . professor d: I I think that we we have a need to have a consistent licensing policy of some sort , and postdoc e: But I also think a consistent licensing policy is important . phd a: Well , one thing to to take into consideration is w are there any  For example , the people who are funding this work , they want this work to get out and be useful for discourse . phd a: If we all of a sudden do this and then release it to the public and it 's not longer useful for discourse , you know grad b: Well , depending on how much editing we do , you might be able to still have it useful . grad b: But , n excuse me , but you could bleep out just the names . professor d: She No , but she 's saying , from the argument before , she wants to be able to say if someone said " Jose " in their in their thing , and then connect to so to what he said later , then you need it . But in the transcript , you could say , everywhere they said " Jose " that you could replace it with " speaker - seven " . But I I also wanna say that people grad b: And then it wouldn't meet match the audio anymore . professor d: And th and the other thing is if if if Liz were here , what she might say is that she wants to look if things that cut across between the audio and the dialogue , postdoc e: Well , you see ? So , it 's complicated . postdoc e: But it 's g but I think it was good to introduce the thing and we can do it next time . grad b: I didn't think when I wrote you that email I wasn't thinking it was a big can of worms , but I guess it is . postdoc e: Well it Discourse , you know Also I wanted to make the point that that discourse is gonna be more than just looking at a transcript . postdoc e: It 's gonna be looking at a t You know , and prosod prosodic stuff is involved , and that means you 're going to be listening to the audio , and then you come directly into this confronting this problem . phd a: Maybe we should just not allow anybody to do research on discourse , postdoc e: So . professor d: maybe we should only have meetings between people who don't know one another and who are also amnesiacs who don't know their own name . grad b: Did you read the paper on Eurospeech ? postdoc e: We could have little labels . I I I wanna introduce my Reservoir Dogs solution again , which is everyone has like " Mister White " , " Mister Pink " , " Mister Blue " . Did you read the paper a few years ago where they were reversing the syllables ? They were di they they had the utterances . phd a: But so , the syllables were in the same order , with respect to each other , but the acous grad b: Everything was in the same order , but they were the individual syll syllables were played backwards . phd a: What did it sound like ? grad b: People had no difficulty in interpreting it . So what we need is something that 's the reverse , that a speech recognizer works exactly the same on it but people can't understand it . professor d: What , what does the speech recognizer care ? grad b: Ah , anyway . professor d: postdoc e: Oh , do we do digits ? Or ? What do we do ? grad b:  OK , we 'll quickly do digits . like as if you were talking like , " nine eight six eight seven ? " postdoc e: Well , you know , in the in the one I transcribed , I did find a couple instances I found one instance of contrastive stress , where it was like the string had a li So it was like " nine eight two four , nine nine two four " . So they were like looking ahead , postdoc e: And phd a: huh ? postdoc e: Well , they differed .  , I 've I am sort of interested in in And sometimes , you know , I s And I I never know . phd a: Well , I was thinking that it must get kind of boring for the people who are gonna have to transcribe this postdoc e: and I phd a: They may as well throw in some interesting intonations