PhD F: The question the question then is h h how much bias do we introduce by you know , introduce by saying , you know , this was important now and , you know , maybe tha something else is important later ?
Professor D: Mm - hmm .
PhD F: I mean , does it does the bias matter ? I I don't know . I mean , uh , that 's , I guess , a question for you guys . But Postdoc H: Well , and and one thing , we we 're saying " important " and we 're saying " interesting " .
PhD F: Uh , yeah , yeah .
Postdoc H: And and those those can be two different things .
Professor A: Mm - hmm .
PhD F: Sure , sure . But I I I guess that 's the question , really , is that I mean ,
Postdoc H: Mm - hmm .
Professor D: W
PhD F: does building queries based on what 's important now introduce an irreversible bias on being able to do what Morgan wants to do later ?
Professor D: Well , irreversible .
Postdoc H: OK , good .
PhD F: That 's that 's Professor D: I I I mean , I guess what I what I I keep coming back to in my own mind is that , um , the soonest we can do it , we need to get up some kind of system
Postdoc H: Yeah .
PhD F: Right .
Professor D: so that people who 've been involved in the meeting can go back later , even if it 's a poor system in some ways , and , uh and ask the questions that they actually want to know . If you know , if uh , as soon as we can get that going at any kind of level , then I think we 'll have a much better handle on what kind of questions people want to ask than in any anything we do before that . But obviously we have to bootstrap somehow ,
Professor A: Right .
Professor D: and PhD F: Sure .
Postdoc H: Mm - hmm .
Professor A: Right .
PhD F: I agree .
Postdoc H: I will say that that I I chose " interesting " because I think it includes also " important " in some cases . But , um , I I I feel like the summary gets at a different type of information .
PhD F: I think " important " can often be uninteresting .
Professor A: Mmm .
PhD E: Mmm . And " interesting " is more interesting than " important " .
Grad G: Hmm .
Postdoc H: Well , and and also i it puts a lot of burden on the person to to evaluate . You know , I think inter " interesting " is is non - threatening in Professor A: OK - OK .
Postdoc H: Yeah .
Professor A: In the interest of , um ,
Grad G: Importance ?
Postdoc H: Yeah .
Professor A: generati {comment} generating an interesting summary , {comment} um Postdoc H: Mm - hmm . Yeah .
Professor A: No , i in the interest of generating some minutes here , uh , and also moving on to action items and other things , let me just go through the things that I wrote down as being important , um , that we at least decided on . CrossPads we were going to try , um , if Landay can get the , uh get them to to you guys , um , and see if they 're interesting . And if they are , then we 'll try to get m do it more . Um , getting electronic summary from a note - taking person if they happen to do it anyway .
Professor D: Mm - hmm .
Professor A: Um , getting just , uh , digital pictures a couple digital pictures of the the table and boards to set the context of the meeting . Uh , and then going around the room at the end to just say qu ask people to mention something interesting that they learned . So rather than say the most interesting thing , something interesting ,
Postdoc H: k
Professor A: and that way you 'll get more variety .
Postdoc H: Sure .
Professor D: Mm - hmm .
Grad G: I wouldn't even say that " that they learned " .
Postdoc H: That 's good . I like that . I like that .
Professor A: OK .
PhD E: Yeah .
Grad G: Uh , you might want to mention something that that you brought up .
Professor A: " Thing that was discussed . " And then the last thing c would be for those people who are willing to stay afterwards and give an oral summary .
Postdoc H: Mm - hmm .
Professor A: OK ? Does that pretty much cover everything we talked about ? That well , that we want to do ?
Postdoc H: Mm - hmm . A And one and one qualification on on the oral summaries . They 'd be s they 'd be separate . They wouldn't be hearing each other 's summaries .
Professor A: OK .
Grad G: Yeah , that 's like n I think that 's gonna predominantly end up being whoever takes down the equipment then .
Postdoc H: And and that would also be that the data would be included in the database .
Grad G: Yeah , that would be , let 's see , me .
Professor A: Mm - hmm .
Postdoc H: Mm - hmm .
PhD E: I mean , there is still this hope that people might actually think of real queries they really want to ask at some point .
Postdoc H: OK .
PhD E: And that if if that ever should happen , then we should try and write them down .
Postdoc H: Mm - hmm .
Professor D: Right .
Professor C: Mm - hmm .
Grad G: Give them a reward , a dollar a query ?
PhD E: Yeah , really .
Professor D: Yeah .
PhD E: If they 're real queries .
Professor A: OK . So Professor D: Well , and again , if we can figure out a way to jimmy a a a a very rough system , say in a year , then uh , so that in the second and third years we we actually have something to Postdoc H: Yeah .
Grad G: Yeah .
Professor A: Play with and generate real queries from .
Professor D: ask queries .
Professor A: Right . OK .
PhD E: Yeah .
Grad G: Yeah .
Professor A: So . Yeah .
Professor D: Uh PhD B: I think I just wanted to say one thing about queries . I mean ,  the level of the query could be , you know , very low - level or very high - level . And it gets fuzzier and fuzzier as you go up , right ?
Grad G: Well , we 're gonna PhD B: So you need to have some sort of if you start working with queries , some way of identifying what the you know , if this is something that requires a a one - word answer or it 's one place in the recording versus was there general agreement on this issue of all the people who ha
PhD E: Hmm .
PhD B: You know , you can gen you can ask queries that are meaningful for people .
Grad G: Yep .
PhD B: In fact , they 're very meaningful cuz they 're very high - level . But they won't exist anywhere in the a you know Grad G: Absolutely . So I think we 're gonna have to start with keywords
Postdoc H: Mm - hmm .
Grad G: and and if someone becomes more interested we could work our way up .
Professor D: I I 'm I I 'm not so sure I agree with that .
PhD B: It But it may well Grad G: But Professor D: Because uh , b because it depends on , uh , what our goal is .
Grad G: Really ?
Professor D: If our goal is Wizard of Oz - ish , we might want to know what is it that people would really like to know about this data .
Grad G: Oh , that 's true .
Professor D: And if it 's if if it 's something that we don't know how to do yet , th great ,
PhD E: Yeah .
Professor A: Right .
PhD E: Yeah .
Professor D: that 's , you know , research project for year four or something .
Professor A: Mm - hmm .
PhD E: Research , yeah .
Professor D: You know ?
Professor A: Mm - hmm .
Grad G: Yeah , I was thinking about Wizard of Oz , but it requires the wizard to know all about the meetings .
PhD E: We 'd have to listen to all the data .
Professor D: Um , well , not maybe not true Wizard of Oz
Grad G: So .
Professor D: because people are too
Grad G: Oh , yeah . I I understand .
Professor D: uh , aware of what 's going on .
PhD E: Well just imagine if Professor D: But but just PhD E: Get people to ask questions that they def the machine definitely can't answer at the moment ,
Professor D: Yeah . w Just " what would you like to know ? "
PhD E: but Grad G: Yep .
PhD E: Yeah .
Grad G: But that neither could anyone else , though , is what , uh , my point is .
PhD E: Yes .
Postdoc H: I I was wondering if if there might be one s more source of queries which is indicator phrases like " action item " ,
Professor A: OK .
Postdoc H: which could be obtained from the text from the transcript .
Grad G: Right . Since we have the transcript .
Postdoc H: Yeah .
Grad G: Dates maybe . I don't know . That 's something I always forget .
Postdoc H: Yeah , that 's something to be determined , something to be specified ,
PhD B: Well , probably if you have to sit there at the end of a meeting and say one thing you remember , it 's probably whatever action item was assigned to you .
Postdoc H: but text - oriented .
PhD B: I mean , in gen that 's all I remember from most meetings .
Grad G: That that 's all I wrote down .
Postdoc H: I think you 'd remember that , yeah .
PhD B: So , in general , I mean , that could be something you could say , right ? I 'm supposed to do this . It it doesn't Postdoc H: Yeah , that 's true . Well , but then you could you could prompt them to say , you know , " other than your action item " , you know , whatever .
PhD E: Well Postdoc H: But but the action item would be a way to get , uh , maybe an additional query .
PhD B: I mean , that 's realistically what people might well be remembering .
Postdoc H: So .
PhD B: So .
Professor D: Hmm .
Postdoc H: Yeah . Well , but you know , but you could get again @ @ Professor A: Well , we 're piloting . We 'll just do it and see what happens .
PhD B: Yeah . Yeah .
Professor D: Yeah .
Postdoc H: Yeah .
Professor D: I usually don't remember my action items . But  I 'd I