F: that we just happened to have a bunch all at once .
E: Well , that 's a good idea .
F: I mean , maybe F: Is that the way it 's gonna be , you think , Jane ?
A: I agree with you .
A: It 's we could do it , uh I I could I 'd be happy with either way ,
A: batch - wise A: What I was thinking A: Uh , so this one A: That was exactly right ,
A: that we had a uh , uh A: I I had wanted to get the entire set of twelve hours ready .
A: Don't have it .
A: But , uh , this was the biggest clump I could do by a time where I thought it was reasonable .
B: Mm - hmm .
A: People would be able to check it and still have it ready by then .
A: My , um I was thinking that with the NSA meetings , I 'd like there are three of them ,
A: and they 're uh , I I will have them done by Monday .
A: Uh , unfortunately the time is later
A: and I don't know how that 's gonna work out ,
A: but I thought it 'd be good to have that released as a clump , too ,
A: because then , you know , they 're they they have a it it 's in a category ,
A: it 's not quite so distracting to them , is what I was thinking ,
A: and it 's all in one chu
A: But after that , when we 're caught up a bit on this process , then , um , I could imagine sending them out periodically as they become available .
E: OK .
A: I could do it either way .
A: I mean , it 's a question of how distracting it is to the people who have to do the checking .
B: We heard anything from IBM ?
B: at all ?
C: Uh . Let 's see .
C: We C: Yeah , right .
C: So we got the transcript back from that one meeting .
C: Everything seemed fine .
C: Adam had a script that will put everything back together and there was Well , there was one small problem but it was a simple thing to fix .
C: And then , um , we , uh I sent him a pointer to three more .
C: And so he 's off and working on those .
F: Yeah . Now we haven't actually had anyone go through that meeting , to see whether the transcript is correct
F: and to see how much was missed and all that sort of stuff .
A: That 's on my list .
F: So at some point we need to do that .
C: Yeah .
A: Well , that 's on my list .
C: Yeah . It 's gonna have to go through our regular process .
F: I mean , the one thing I noticed is it did miss a lot of backchannels .
F: There are a fair number of " yeahs " and " uh - huhs " that it 's just that aren't in there .
F: So .
A: Hmm .
B: But I think Yeah . Like you said , I mean , that 's that 's gonna be our standard proc
B: that 's what the transcribers are gonna be spending most of their time doing , I would imagine ,
A: Mm - hmm .
A: Mm - hmm , mm - hmm .
B: once once we F: Yes , absolutely . Yeah .
A: One question about the backchannels .
B: It 's gonna A: Do you suppose that was because they weren't caught by the pre - segmenter ?
F: Yes , absolutely . Absolutely .
A: Oh , interesting .
A: Oh , interesting . OK .
F: Yeah . They 're they 're not in the segmented .
F: It 's not that the IBM people didn't do it .
A: OK .
A: OK .
F: Just they didn't get marked .
A: OK . So maybe when the detector for that gets better or something A: I w I A: There 's another issue which is this A: we 've been , uh , contacted by University of Washington now , of course , to , um A: We sent them the transcripts that correspond to those six meetings
A: and they 're downloading the audio files .
A: So they 'll be doing that .
A: Chuck 's Chuck 's , uh , put that in .
C: Mm - hmm . Yeah , I pointed them to the set that Andreas put , uh , on the web
C: so th if they want to compare directly with his results they can .
C: And , um , then once , uh ,
C: th we can also point them at the , um , uh , the original meetings
C: and they can grab those , too , with SCP .
E: Wait . So you put the reference files ?
C: No , no . They d they wanted the audio .
E: Or the ?
C: Jane sent them the , uh , transcripts .
E: No , I mean of the transcripts .
E: Um .
E: Well , we can talk about it off - line .
F: There 's another meeting in here , what , at four ?
C: Mm - hmm .
F: Right ?
F: Yeah , so we have to finish by three forty - five .
H: D d So , does Washi - does does UW wanna u do this wanna use this data for recognition or for something else ?
C: Uh , for recognition .
H: Oh .
E: I think they 're doing w
E: didn't they want to do language modeling on , you know , recognition - compatible transcripts
H: Oh . I see .
B: Yeah .
E: or ?
A: This is to show you , uh , some of the things that turn up during the checking procedure .
A: Um @ @ <comment> So , this is from one of the NSA meetings
A: and , uh , i if you 're familiar with the diff format , the arrow to the left is what it was ,
A: and the arrow to the right is what it was changed to .
A: So ,
A: um . And now the first one .
A: " OK . So , then we started a weekly meeting .
A: The last time , uh " And the transcriber thought " little too much "
A: But , uh ,
A: really , um , it was " we learned too much " ,
A: which makes more sense syntactically as well .
H: And these the parentheses were f from A: Then A: Oh , this that 's the convention for indicating uncertain .
F: U uncertains .
A: So the transcriber was right .
H: S
A: You know , she was uncertain about that .
H: OK .
A: So she 's right to be uncertain .
H: Oh . <comment> OK .
A: And it 's also a g a good indication of the of that .
A: The next one . This was about , uh , Claudia
A: and she 'd been really b busy with stuff , such as waivers .
A: Uh , OK .
A: Um , next one .
A: Um . This was an interesting one .
A: So the original was " So that 's not so Claudia 's not the bad master here " ,
A: and then he laughs ,
F: Web master .
A: but it really " web master " .
D: Oh . <comment> Uh - oh .
A: And then you see another type of uncertainty which is , you know , they just didn't know what to make out of that .
A: So instead of " split upon unknown " , <comment> it 's " split in principle " .
F: Yep .
D: Jane , these are from IBM ?
F: Spit upon ?
D: The top lines ?
A: No , no . These are these are our local transcriptions of the NSA meetings .
F: No , these are ours .
D: Oh .
A: The transcribers transcriber 's version ver versus the checked version .
D: Oh , I see .
A: My my checked version , after I go through it .
D: OK .
A: Um , then you get down here .
A: Um .
A: Sometimes some speakers will insert foreign language terms .
A: That 's the next example ,
A: the next one .
A: The , uh , version beyond this is A: So instead of saying " or " ,
A: especially those words , " also " and " oder " and some other ones .
A: Those sneak in .
A: Um , the next one H: Discourse markers .
F: That 's cool .
H: Discourse markers .
A: S
A: Sorry , what ?
A: Discourse markers ?
H: Discourse markers .
A: Sure . Sure , sure , sure .
H: Yeah . Yeah .
A: And it 's and it makes sense
A: cuz it 's , like , below this it 's a little subliminal there .
H: Yeah .
H: Yeah , yeah .
A: Um . OK , the next one ,
A: uh , this is a term .
A: The problem with terminology .
A: Description with th the transcriber has " X as an advance " .
A: But really it 's " QS in advance " .
A: I mean , I I 've benefited from some of these , uh , cross - group meetings .
A: OK , then you got ,
A: um , uh ,
A: instead of " from something - or - other cards " , <comment> it 's " for multicast " .
A: And instead of " ANN system related " , it 's " end system related " .
A: This was changed to an acronym initially
A: and it should shouldn't have been .
A: And then , you can see here " GPS " was misinterpreted .
A: It 's just totally understanda
A: This is this is a lot of jargon .
A: Um , and the final one ,
A: the transcriber had th " in the core network itself
A: or the exit unknown ,
A: not the internet unknown " .
A: And it it comes through as " in the core network itself of the access provider ,
A: not the internet backbone core " .
A: Now this is a lot of terminology .
H: Mmm .
A: And they 're generally extremely good ,
A: but , you know in this this area it really does pay to , um to double check
A: and I 'm hoping that when the checked versions are run through the recognizer that you 'll see s substantial improvements in performance
A: cuz the you know , there 're a lot of these in there .
H: Yeah . So how often ?
F: Yeah , but I bet I bet they 're acoustically challenging parts anyway , though .
D: Mmm .
A: No , actually no .
F: Oh , really ?
A: Huh - uh .
F: Uh , it 's F: Oh , so it 's just jargon .
A: It 's jargon . Yeah .
A: I mean this is cuz , you know you don't realize in daily life how much you have top - down influences in what you 're hearing .
H: Well , but H: But but A: And it 's jar it 's jargon coupled with a foreign accent .
H: But we don't I mean , our language model right now doesn't know about these words anyhow .
H: So ,
H: you know , un until you actually get a decent language model , @ @ <comment> Adam 's right .
B: Yeah .
F: It probably won't do any better .
H: You probably won't notice a difference .
H: But it 's I mean , it 's definitely good that these are fixed .
H: I mean , obviously .
B: Yeah .
A: Well , also from the standpoint of getting people 's approval ,
A: cuz if someone sees a page full of uh , um , barely decipherable w you know , sentences , and then is asked to approve of it or not , it 's , uh , uh F: Did I say that ?
B: Yeah .
B: Yeah . That would be a shame if people said " well , I don't approve it because the it 's not what I said " .
A: OK .
F: Well , that 's exactly why I put the extra option in ,
B: Yeah .
A: Exactly . That 's why we discussed that .
F: is that I was afraid people would say , " let 's censor that because it 's wrong " ,
B: Yeah .
F: and I don't want them to do that .
B: Yeah .
A: And then I also the final thing I have for transcription is that I made a purchase of some other headphones
H: C
A: because of the problem of low gain in the originals .
A: And and they very much appro they mu much prefer the new ones ,
A: and actually I I mean , I I think that there will be fewer things to correct because of the the choice .
A: We 'd originally chosen , uh , very expensive head headsets
F: Yeah .
F: Ugh !
A: but , um , they 're just not as good as these , um , in this with this respect to this particular task .
H: Well , return the old ones .
F: It 's probably impedance matching problems .
F: But A: I don't know exactly ,
A: but we chose them because that 's what 's been used here by prominent projects in transcription .
B: Could be .
F: Mm - hmm .
A: So it i we had every reason to think they would work .
H: So you have spare headsets ?
A: Sorry , what ?
H: You have spare headsets ?
F: They 're just earphones .
F: They 're not headsets .
F: They 're not microphones .
H: No , no . I mean , just earphones ?
E: Right .
H: Um ,
H: because I , uh , I could use one on my workstation ,
H: just to t
H: because sometimes I have to listen to audio files
H: and I don't have to b go borrow it from someone
H: and A: We have actua actually I have A: W Well , the thing is , that if we have four people come to work for a day , I was I was hanging on to the others for , eh for spares ,
H: Oh , OK .
H: Sure . No problem .
B: No , but you 'd If you Yeah , w we should get it .
A: but I can tell you what I recommend .
F: But if you need it , just get it .
H: I just F: Come on .
H: Right .
B: Yeah . If you need it .
H: Yeah .
B: Yeah .
D: Yeah , I still I still need to get a pair , too .
A: It 'd just have to be a s a separate order an added order .
B: They 're they 're they 're they 're pretty inexpensive .
E: Yeah , that E: We should order a cou uh , t two or three or four , actually .
D: I 'm using one of these .
B: Yeah .
D: Yeah .
H: I think I have a pair that I brought from home ,
E: We have H: but it 's f just for music listening
B: No . Just just just just buy them .
H: and it 's not E: Sh - Just get the model number
H: Nnn . Yeah .
E: and B: Just buy them .
E: Where do you buy these from ?
H: Yeah .
A: Cambridge SoundWorks , just down the street .
E: Like ?
E: You just b go and b
E: Oh .
A: Yeah . They always have them in stock .
B: Yeah .
H: Anyway .
E: That 'd be a good idea .
F: W uh , could you email out the brand ?
B: Yeah .
A: Oh , sure . Yeah . OK .
F: Cuz I think sounds like people are interested .
D: Yeah .
F: So .
D: Definitely .
B: Yeah .
A: It 's made a difference in in how easy .
A: Yeah .
B: I realized something I should talk about .
B: So what 's the other thing on the agenda actually ?
F: Uh , the only one was Don wanted to , uh , talk about disk space yet again .
D: Yeah .
D: u It 's short .
D: I mean , if you wanna go , we can just throw it in at the end .
B: No , no . Why don't you why don't you go ahead
B: since it 's short .
D: Um , well , uh .
F: Oh , I thought you meant the disk space .
H: The disk space was short .
F: Yeah , we know disk space is short .
H: Yeah . That 's what I thought too .
E: That 's a great ambiguity .
B: Yeah .
E: It 's one of these E: it 's it 's social
B: It 's E: and , uh , discourse level
B: I i i it i
D: Yeah .
E: and B: Yeah , it 's great .
E: Sorry .
B: Yeah ,
B: double double F: Yeah , it was really goo
E: See , if I had that little scratch - pad , I would have made an X there .
D: Thank you , thank you .
F: Uh , well , we 'll give you one then .
B: Yeah .
D: Um . So , um ,
D: without thinking about it , when I offered up my hard drive last week F: Oh , no .
E: It was while I was out of town .
D: Um , this is always a suspect phrase .
D: But , um , no . I , uh I realized that we 're going to be doing a lot of experiments , um , o for this , uh , paper we 're writing ,
D: so we 're probably gonna need a lot more D: We 're probably gonna need that disk space that we had on that eighteen gig hard drive .
D: But , um , we also have someone else coming in that 's gonna help us out with some stuff .
D: So B: We 've just ordered a hundred gigabytes .
E: I think we need , like , another eighteen gig disk to be safe .
D: OK . We just need to B: Well , we 're getting three thirty thirty - sixes .
E: So .
D: OK .
B: Right ?
B: That are going into the main f file server .
E: OK .
C: Markham 's ordering and they should be coming in soon .
D: W Well . So so B: So .
F: Soon ?
D: Yeah . I mean , I guess the thing is is , all I need is to hang it off , like , the person who 's coming in , Sonali 's , computer .
H: Oh , so so , you mean the d the internal the disks on the machines that we just got ?
D: Whew .
D: Or we can move them .
F: No .
H: Or extra disk ?
C: These are gonna go onto Abbott .
F: Ne - new disks .
B: Onto Abbott ,
D: So are we gonna move the stuff off of my hard drive onto that when those come in ?
B: the file server .
H: Oh , oh . OK .
F: On F: Yeah .
F: Once they come in . Sure .
E: Uh , i
D: OK . That 's fine .
E: Do when when is this planned for roughly ?
C: They should be I I imagine next week or something .
E: OK .
D: OK .
F: If you 're if you 're desperate , I have some space on my drive .
E: So D: I think if I 'm F: But I I vacillate between no space free and a few gig free .
E: Yeah .
D: Yeah . I think I can find something if I 'm desperate
F: So .
D: and , um , in the meantime I 'll just hold out .
F: OK .
D: That was the only thing I wanted to bring up .
C: It should be soon .
C: We we should D: OK .
B: So there 's another hundred gig .
B: So .
D: Alright . Great .
H: Mm - hmm .
B: OK .
D: That 's it .
B: It 's great to be able to do it ,
E: Good .
B: just say " oh yeah , a hundred gig ,
D: Yeah .
F: Yeah .
B: no big deal " .
F: A hundred gig here ,
F: a hundred gig there .
E: Well , each meeting is like a gig or something ,
F: It 's eventually real disk space .
B: Yeah .
E: so it 's really B: Yeah .
B: Um . Yeah . I was just going to comment that I I 'm going to , uh , be on the phone with Mari tomorrow , late afternoon .
F: Oh , yeah .
B: We 're supposed to get together and talk about , uh , where we are on things .
B: Uh , there 's this meeting coming up ,
B: uh , and there 's also an annual report . Now ,
B: I never actually B: I I was asking about this .
B: I don't really quite understand this .
B: She was re she was referring to it as B: I think this actually didn't just come from her ,
B: but this is what , uh , DARPA had asked for .
B: Um , she 's referring to it as the an annual report for the fiscal year .
B: But of course the fiscal year starts in October ,
B: so I don't quite understand w w why we do an annual report that we 're writing in July .
C: She 's either really late or really early .
F: Huh .
F: Or she 's getting a good early start .
B: Uh , I think basically it it 's none of those .
B: It 's that the meeting is in July
B: so they so DARPA just said do an annual report .
B: So .
B: So .
B: So anyway , I 'll be putting together stuff .
B: I 'll do it , uh , you know , as much as I can without bothering people ,
B: just by looking at at papers and status reports .
H: Hmm .
B: I mean , the status reports you do are very helpful .
B: Uh , so I can grab stuff there .
B: And if , uh if I have some questions I 'll F: When we remember to fill them out .
B: Yeah . If people could do it as soon as as you can , if you haven't done one si recently .
B: Uh . Uh ,
B: but , you know , I 'm I 'm sure before it 's all done , I 'll end up bugging people for for more clarification about stuff .
B: Um . But , um ,
B: I don't know ,
B: I guess I guess I know pretty much what people have been doing .
B: We have these meetings and and there 's the status reports .
B: Uh . But , um . Um .
B: Yeah . So that wasn't a long one . Just to tell you that . And if something hasn't , uh B: I 'll be talking to her late tomorrow afternoon ,
B: and if something hasn't been in a status report and you think it 's important thing to mention on this kind of thing , uh , uh , just pop me a one - liner
B: and and and I 'll I 'll have it in front of me for the phone conversation .
H: OK .
B: Uh .
B: I guess , uh , you you 're still pecking away at the demos and all that , probably .
F: Yep .
F: And Don is gonna be helping out with that .
B: Oh , that 's right .
F: So .
B: OK .
F: Did you wanna talk about that this afternoon ?
D: Um .