OK OK Yes to be working One OK crash four crashing anymore and it really bothers me I Yeah do crashing I crashed when I started crashed morning crashed Yeah morning I did not crash this morning Oh Well Really just you know how many t u u u u how many times you crash in a day Yeah Maybe yeah First time first time in the day you know maybe once done enough meetings it won't crash on you Yeah anymore No Yeah a matter of experience Yeah Yeah yeah Yeah great Yeah Uh Do we have an agenda Liz Liz do Andreas can't sh can't uh can't come So have agenda Did here and all me Cuz no one sent me anything else Did they send uh the messages to you about the meeting today have no idea but I Oh just got it a few minutes ago Oh you were in my office it arrived OK cuz I checked my mail I didn't have anything So does anyone have any a agenda items other than me I actually have one more also which is to talk about the digits Uh right so so I I was just gonna talk briefly about the NSF ITR Oh great Uh and Can then you have I mean I won't say much but uh but then uh you said wanna talk about digits I have a short thing about digits and then uh I wanna talk a little bit about naming conventions although unclear whether this is the right place to talk about it So maybe just talk about it very briefly and take the details to the people who for whom relevant Right Yeah I could always say something about transcription been but but uh well Well if we Yeah we shouldn't add things in just to add things in actually Yeah pretty busy today so if we can Yeah we a short This meeting would be fine sound like doing fine yeah That won't do So the only thing I wanna say about digits is we are pretty much done with the first test set There are probably forms here and there that are marked as having been read that weren't really read So I won't really know until I go through all the transcriber forms and extract out pieces that are in error So I wa Uh Two things The first is what should we do about digits that were misread My opinion is um we should just throw them out completely and have them read again by someone else You know the grouping is completely random so it perfectly fine to put a a group together again of errors and have them just to finish out the test set Oh By throw Um them the out other completely do is change the transcript to match what they really said So those Yeah those are the two options often things where people do false starts I know done it where I say say What a the transcribers did with that is if they did a correction and they eventually did read the right string you extract the right string about where they completely read Yeah wrong string Yeah and didn't correct And it didn't notice Ah Which happens Yeah in a few places Well So s so talking not talking about the entire page Correct I get it And so the the two options are change the transcript to match what they really said but then but then the transcript isn't the Aurora test set anymore I don't think that really matters because the conditions are so different And that would be a little easier how many are how how often does that happen Mmm five or six times Oh so not very much not much at all Seems like we should just change the transcripts Yeah OK to match Yeah five or six times out of thousands thousand Four Four Yeah Ah thousand thousand Yeah I would uh tak do the easy way Yeah OK yeah Yeah It kinda Mmm nice I mean wh who knows what studies people will be doing on on things and so I think having Yeah having it all the speakers who we had is is at least interesting So you um how many digits have been transcribed now Four thousand lines And each line Four thousand lines between one and about ten digits I didn't I didn't compute the average I think the average was around four or five So Wow couple hours of Yep of uh speech probably Yep Which is a yeah reasonable reasonable test set And Jane I do have a set of forms which I think you have copies of somewhere Yeah true Oh you do Oh OK good good Yeah I was just wond I thought I had had all of them back from you No not yet then the other thing is that uh the forms in front of us here that gonna read later were suggested by Liz because she wanted to elicit some different prosodics from digits And so nine just wanted people to take a quick look at the instructions and the way it wa worked and see if it makes sense and if anyone has any comments on it I see And the decision here uh was to continue with uh the words rather than the the numerics Uh yes although we could switch it back The problem was O and zero Although we could switch it back and tell them always to say zero or always to say O Or neither But just two thing ways that you can say it Right Oh Yeah Um um the only thought I have because if you t start talking about these you know u tr trying to get at natural groupings Right but it nothing natural about reading numbers this way I mean if you saw a telephone number you would never see it this way the problem also is she did want to stick with digits I mean speaking for her since Yeah not here But um the other problem we were thinking about is if you just put the numerals Yeah Mmm they Yeah say instead of four three Yeah Well if space though between them I mean you can With when you space them out they don't look like uh Yeah anymore Well she and I were talking about it Yeah and she felt that very very natural to do that sort of right chunking it a different problem I mean a a an interesting problem I mean done stuff with numbers before and yeah sometimes people If you say s three nine eight one sometimes people will say or three hundred three hundred Yeah one or I don't think say that but Not very but frequently no but But certainly could Yeah Uh th is probably how do So I mean But is something that Liz and I spoke about and I see since this was something that Liz asked for specifically I think Yeah need to defer to her