[speaker007:] There're some words that weren't [disfmarker]
[speaker006:] OK. We're on.
[speaker007:] See, there're some stretches that weren't even in one or the other,
[speaker002:] Right. It would have to be hand [disfmarker]
[speaker007:] so [disfmarker]
[speaker002:] Right.
[speaker008:] Yeah.
[speaker007:] What are you gonna do about those, though?
[speaker002:] It would have to be [disfmarker] Well, a h a person would [disfmarker] would check it over
[speaker001:] Hello?
[speaker007:] You're never [disfmarker]
[speaker001:] OK.
[speaker002:] and then give a final [disfmarker]
[speaker001:] Should we close the door?
[speaker006:] Oh, we'll wait for Chuck.
[speaker008:] I mean, if recognition's better on the channelized segmentations, then [disfmarker]
[speaker006:] Close the door behind him.
[speaker002:] I'm [disfmarker] Well, it's more
[speaker003:] We're [disfmarker] we're recording by the way,
[speaker002:] you didn't [disfmarker]
[speaker003:] just for [disfmarker]
[speaker002:] Oh, sorry.
[speaker003:] I mean, uh u
[speaker006:] Y you can keep talking,
[speaker003:] You can keep talking.
[speaker006:] but you should be aware.
[speaker003:] I just [disfmarker] I just [disfmarker] g guess you were gonna [disfmarker]
[speaker002:] You were saying that we were waiting for Chuck, so I just [disfmarker]
[speaker006:] Well, and then, uh [disfmarker] then Morgan said "why don't we start?"
[speaker003:] Well [disfmarker]
[speaker002:] OK.
[speaker006:] and I said "O K".
[speaker003:] So the compromise is we're [disfmarker] we're starting but we're leaving the door open.
[speaker002:] OK.
[speaker003:] So we'll have a little more background noise and [disfmarker] [vocalsound] Uh.
[speaker006:] Or we can close the door and make Chuck knock [comment] when he comes.
[speaker001:] Well, I tend to [disfmarker] th there're a couple meetings where there are a lot of preambles like this, in which case the transcription doesn't start until someone actually says "OK."
[speaker003:] Really?
[speaker001:] So, we're starting right now.
[speaker002:] Well, that's good.
[speaker003:] Yeah. Oh, yeah. The meeting's started. This is [disfmarker] this is the real thing.
[speaker001:] This is the [disfmarker]
[speaker003:] This is the real thing. Oh well, never mind, it wasn't. There goes Chuck. Just kidding, it was. OK, so.
[speaker006:] And Chuck gets stuck with the ear plug mike.
[speaker003:] OK. Last guy in [vocalsound] gets the [disfmarker]
[speaker001:] Yeah. u Didn't get the door.
[speaker003:] Oh, you just get the door now.
[speaker006:] But he didn't shut the door.
[speaker003:] Yeah.
[speaker006:] I got it since [disfmarker]
[speaker003:] Yeah. So I [disfmarker] I [disfmarker] [@ @] Adam sent around this thing about what we were going to talk about and [disfmarker] and th we had had this discussion of, uh, flipping back and forth between an emphasis on [disfmarker] [vocalsound] on the technology, particularly recognition, versus, uh, the recordings and transcriptions and so on. Um, but, um, I was asking, if we could, to [pause] uh, kind of make it just whatever is happening rather than one or the other because, uh, next weekend [disfmarker] next week I'll be at a meeting on campus
[speaker007:] Sure.
[speaker003:] and after that I'll be Europe for, [vocalsound] uh, several meetings' worth. Uh, you folks'll be gone for a couple of the meetings' worth in [disfmarker] in Europe also,
[speaker007:] Mm hmm.
[speaker002:] I overlap exactly with the times you're gone.
[speaker003:] right? Really?
[speaker002:] I mean [disfmarker]
[speaker003:] OK. Yeah.
[speaker002:] Yeah.
[speaker003:] So. So, uh, you didn't [disfmarker] you didn't get an agenda, I guess. We've got the usual [disfmarker]
[speaker006:] Well, because no one [disfmarker] no one ever rep responded [pause] with any items.
[speaker003:] Yeah.
[speaker006:] So I have [pause] a couple of minor ones. Uh, our [pause] normal transcription status, just so that we can make some [disfmarker] some plans. So wha what's up with IBM, Chuck? Do you know?
[speaker009:] Um, I think Brian is on vacation now but, uh, before he left we gave him, uh, another set of meetings to give to the transcribers. And [disfmarker]
[speaker008:] How many?
[speaker009:] Uh, what is it?
[speaker006:] Is [disfmarker] is yours working there, Chuck?
[speaker009:] Four?
[speaker004:] Four.
[speaker008:] Oh.
[speaker009:] Four.
[speaker006:] Can you [disfmarker]? You're b you're B?
[speaker009:] Test. What am I?
[speaker001:] Is it turned on?
[speaker006:] There's no on.
[speaker009:] Test.
[speaker001:] OK.
[speaker009:] Yeah.
[speaker006:] Oh. It's just [disfmarker]
[speaker001:] Channel B.
[speaker006:] I'll [disfmarker] Let me raise the gain on that a little bit
[speaker009:] OK.
[speaker001:] Channel B.
[speaker006:] since it's so far from your mouth. Sorry.
[speaker003:] OK. [vocalsound] So we sent them [disfmarker]
[speaker009:] So we gave them four meetings before he left and, um, that's it. So, um, I don't think we'll hear from him before he gets back.
[speaker006:] OK.
[speaker003:] And the
[speaker001:] Do they know about your pie chart?
[speaker009:] I don't know.
[speaker001:] OK.
[speaker009:] I don't know.
[speaker003:] What pie chart?
[speaker006:] Pie? Oh.
[speaker001:] He has a nice pie chart on the, uh, s the current status page,
[speaker002:] Pie.
[speaker001:] which shows the amount of transc amount of data that had been transcribed
[speaker007:] Mm hmm.
[speaker001:] and the amount [disfmarker] out of the entire [disfmarker] and [vocalsound] at this point it's not quite half. Wouldn't [disfmarker] Is that what you'd say, with the pie chart?
[speaker009:] Yeah.
[speaker001:] And then of that, there's, uh, a little sliver [disfmarker] I could try and draw it but it's probably better to describe.
[speaker003:] Half the data that's been recorded has been transcribed?
[speaker001:] So [disfmarker] [vocalsound] Roughly. Almost. Not quite.
[speaker003:] Wow! That's getting pretty good.
[speaker001:] And I haven't actually caught up with, uh [disfmarker] since I got back so recently from my vacation. Um, I know that the transcribers finished, um, uh, several meetings while I was gone.
[speaker009:] Oh.
[speaker001:] And I haven't told you cuz I haven't [disfmarker] I haven't figured out which ones they are y are yet.
[speaker009:] Right.
[speaker001:] But when that happens, then that pie will get even closer to the midline.
[speaker003:] Mm hmm.
[speaker009:] Mm hmm.
[speaker001:] It's not quite [disfmarker] [vocalsound] not quite fifty percent but [pause] really getting close. I think it will be.
[speaker006:] OK. So also, um [disfmarker]
[speaker007:] You mean, pi will be close to one half?
[speaker001:] Well, [vocalsound] not mathematically.
[speaker007:] That's new.
[speaker006:] Now, that's a strange [disfmarker]
[speaker003:] Well, if we can have three point one four times as much tr transcribed as we recorded, we really would be doing well.
[speaker001:] n
[speaker006:] Yep.
[speaker007:] Right.
[speaker001:] But it's a nice [disfmarker] it's [disfmarker] I recommend his [disfmarker] his [disfmarker] his graphic,
[speaker006:] Um. So [disfmarker]
[speaker007:] You know, this [disfmarker] this raises some [disfmarker]
[speaker001:] cuz it's [disfmarker] it's a really nice graphic.
[speaker007:] Mm hmm.
[speaker006:] How much [disfmarker]
[speaker007:] How do you transcribe that?
[speaker006:] How much do we need transcribed before it's worth doing some trainings?
[speaker007:] Oh. B uh [disfmarker]
[speaker002:] Mmm.
[speaker006:] I mean, it seems like probably we have enough now.
[speaker007:] We can [disfmarker]
[speaker006:] Right? Because, like [disfmarker] like Macrophone wasn't that much data.
[speaker002:] You mean [disfmarker]
[speaker006:] Right? And it helped.
[speaker007:] Well, we already use it for digit training.
[speaker002:] But [disfmarker] but that was read speech.
[speaker006:] You only used that for digits?
[speaker007:] I mean [disfmarker]
[speaker006:] Right.
[speaker007:] Well, we did do some training on digits [disfmarker]
[speaker006:] That's right.
[speaker007:] uh, rather adaptation on digits [disfmarker] digits. I mean, supervised adaptation.
[speaker006:] Mm hmm.
[speaker007:] So. Yeah. I mean, uh [disfmarker]
[speaker002:] Maybe like twenty hours. We could try, but [disfmarker] Maybe not counting the non native speech, cuz if [disfmarker] That [disfmarker] that just doesn't translate very well.
[speaker007:] Well, I would [disfmarker] I would love to do some, um [disfmarker] you know, with adaptation you can use fairly small amount of data to improve your performance.
[speaker006:] Right.
[speaker007:] Um, and n you know, it's just basically, uh [disfmarker] uh You know, I [disfmarker] I don't have to time to [disfmarker] to do too much these days except what I'm already doing. So [disfmarker]
[speaker006:] Mm hmm.
[speaker007:] um, but if there's some [disfmarker] someone has some free time, I'm [disfmarker] I'll be happy to show them how it works and [pause] you can play with it.
[speaker006:] Cool. Um.
[speaker003:] Uh, I thought you [disfmarker] you were already using adaptation w on the test set.
[speaker007:] No, supervised adaptation.
[speaker006:] Supervised.
[speaker007:] So, we're doing s unsupervised speaker adaptation.
[speaker003:] I see.
[speaker007:] But [vocalsound] you could [pause] build a test set which you sort of take your models and ada do supervised adaptation.
[speaker003:] Oh, OK. Got it.
[speaker007:] And then you start with the speaker adaptation from sort of channel adapted
[speaker003:] Right. Right.
[speaker007:] or room adapted or whatever.
[speaker003:] Yeah, yeah. Yeah, whatever this is.
[speaker006:] H how would you imagine doing a test set on this corpus? A test set, training set division? I mean, it it's really weird. Right? Because it's [disfmarker] it would be hard to get speaker disjoint sets.
[speaker007:] Right.
[speaker006:] Do y do we just give up on that?
[speaker002:] Right. And actually the [disfmarker] I was thinking about this the original application doesn't really appl I mean, if you're using this over and over again, you're gonna be testing on the same [disfmarker] the same speakers.
[speaker006:] Well, but then you have the supervised versus unsupervised question.
[speaker002:] I just mean that it's not a terrible thing to assume that you don't [disfmarker] that you don't have disjoint sets,
[speaker006:] Right.
[speaker003:] Mm hmm.
[speaker006:] So.
[speaker002:] for this particular kind of [pause] application. I mean [disfmarker]
[speaker006:] Yeah.
[speaker003:] Right. [vocalsound] Yeah. I mean, you could have some parts of it that are disjoint and some that aren't,
[speaker007:] It's [disfmarker] it's sort of like in, um, Broadcast News
[speaker003:] and see what the difference is, you know, on the others.
[speaker002:] Yeah.
[speaker003:] Yeah.
[speaker007:] because you have those people who re occur over and over.
[speaker003:] Yeah.
[speaker007:] I mean, the anchor speakers tend typically.
[speaker006:] Right.
[speaker007:] So, um [disfmarker] m m m m Yeah. As long as you're aware that you're doing that, that's [disfmarker] I don't see that as a problem.
[speaker003:] You can separate it out and see how [disfmarker] if they're [disfmarker]
[speaker006:] And then s s similarly with subject matter.
[speaker003:] Yeah.
[speaker006:] That, you know, if you're training your language model on this meeting only and testing on this meeting only, you're gonna do a lot better than if you start crossing them.
[speaker007:] Mm hmm.
[speaker002:] Somewhat. Although what's interesting is that the majority of the words in the language model are actually [disfmarker]
[speaker003:] Mm hmm.
[speaker006:] Are the same.
[speaker002:] Yeah. They're actually these, like, function words
[speaker006:] Sure.
[speaker002:] and "Yeah!" and s stuff like that.
[speaker003:] Mm hmm. Mm hmm.
[speaker002:] And there there's a lot of speaker dependence there. Even the transcribers will say they know who the speaker is after a while just from their backchannels
[speaker003:] Yeah.
[speaker006:] Just from word choice?
[speaker002:] and [disfmarker] Right. So y So, I don't think you're talking the way you write, in [disfmarker] in other words.
[speaker006:] Most certainly. So it's just, uh, if we're gonna do that we should [pause] give some thought to how we wanna divide it up.
[speaker003:] Yeah. Yeah, so, you know, maybe someone else would do [pause] a lot of the work where probably [pause] your advice
[speaker006:] Yeah. And similarly with digits. We now have a lot of digits
[speaker007:] Yeah.
[speaker003:] would be helpful.
[speaker006:] but most of them aren't transcribed. So if we wanted to do a forced alignment on them, we could start collecting ourselves up a fairly large digit corpus.
[speaker003:] Yeah. Well, we'd [disfmarker]
[speaker006:] And so, same issue. You know we just need to get someone who's interested in that to start looking at it.
[speaker003:] We want that for sure. Yeah.
[speaker006:] So who's working on digits currently?
[speaker003:] Uh, Dave Gelbart.
[speaker006:] OK, maybe I'll talk to him and see if he's interested.
[speaker003:] Not [pause] right away.
[speaker006:] Yeah, certainly.
[speaker003:] He's got prelims
[speaker006:] He wants to pass the prelims.
[speaker003:] and [disfmarker] Yeah. Um, [vocalsound] one thing, uh, uh, just a e uh, uh, an announcement of sorts is that, um, [vocalsound] Chuck is gonna be going to a meeting at NIST, in, uh, about a month and a half, I guess. They're still working out the date. cuz they want to gather together sort of one person from each site who is involved in the meeting stuff since they're going to be doing [vocalsound] a bunch of meeting recordings there.
[speaker006:] Mm hmm.
[speaker003:] And so, uh.
[speaker006:] Is, uh [disfmarker]? Are the CMU folks gonna be there?
[speaker003:] Somebody [disfmarker] you know, it's like one person [disfmarker] at the moment it's one person from each site. So there'll be somebody from the CMU, and somebody from here, and somebody from, [vocalsound] uh, a [disfmarker] a number of places. Probably somebody from UW. Um. So. Yeah, it's possible they'll open it up to more people. But [disfmarker] but I think, you know, the main thing is just to, uh [disfmarker] uh [disfmarker] uh [disfmarker] uh, it's not a [disfmarker] it's not a conference. It's not a workshop, really.
[speaker006:] Right.
[speaker003:] It's just connecting with them. So. Um. So, then if they start a bunch of recordings then ultimately they'll [disfmarker] they'll have training sets and test sets, and [disfmarker] [vocalsound] and all that [disfmarker] all that stuff, and [disfmarker] But.
[speaker007:] But it would be interesting to hear what they intend to do about the speaker overlap, for instance.
[speaker006:] Right.
[speaker003:] Yeah.
[speaker002:] What's the plan if [disfmarker] were we still going to be like a [pause] center for transcribing data? What happens if th they don't deliver things until [pause] next year or something when we [pause] have less [pause] resources
[speaker003:] I
[speaker002:] or [disfmarker]?
[speaker003:] Well, again the hope is [vocalsound] that, uh [disfmarker] I mean, it's [disfmarker] it's looking [disfmarker] I mean, I have to ask these folks but, uh, my impression is that the, um, IBM path is looking, you know, more promising.
[speaker006:] Yep. It [disfmarker] it [disfmarker] pretty good. Yeah.
[speaker003:] And if that's the case and if it turns out that, uh, it's really a relatively small amount of time for our transcribers to process things before and after, if they really have taken out enough of the [disfmarker] of the, uh, uh, work that [disfmarker] that it's f feasible, then maybe we can do it with a smaller staff next year.
[speaker002:] Mm hmm.
[speaker003:] I mean, [vocalsound] next [disfmarker] next year, uh, in which he's [disfmarker] you're referring to is, uh, next year we [disfmarker] we don't have a whole lot of guaranteed funding for this [disfmarker] [vocalsound] this work. Um, other funding may come. You know that's [disfmarker] But [disfmarker] but if we wanna just count on, uh, [vocalsound] uh, what we know about, it's [disfmarker] it's more modest than this year. Uh, it's still [disfmarker] there'll still be money, but it's just more modest. So [disfmarker] um, so I would see us as probably not doing more recordings at least for [disfmarker] for [disfmarker] for meetings or [disfmarker] or digits or anything. But, uh, if [disfmarker] if we feel that we need to, probably still doing some recordings for SmartKom or something.
[speaker004:] Yeah.
[speaker003:] Um, but otherwise just, you know, stop that and just [pause] take whatever comes from the other places, which, uh, I guess we have an u unknown rate. If it [disfmarker] if it starts being [disfmarker] if they're generating this huge amount and we can't handle it then, you know, we'll tell them. But. Uh, although it would have been nice if that [disfmarker] their stuff had come earlier, it it's in some ways a good thing, because we've been [vocalsound] ironing out this [pause] path. So.
[speaker006:] Um. Well, I got a email from one of the UW guys. They want to record the meetings at higher, uh, sampling rate than sixteen [pause] kilohertz. Uh, I didn't ask why. But it seems to me [pause] that really doesn't matter. If they have the disk space to do it, it seems that that [pause] is not a big deal. I was just wondering if anyone had [pause] an opinion about mismatched [pause] rates.
[speaker003:] Well, it's just if that they're sending it to us, then we have to have the disk space to do it too.
[speaker001:] Can't we downsample and, uh, transcribe on that basis?
[speaker003:] That would be the hope. Yeah.
[speaker006:] Yep.
[speaker003:] d Are they [pause] doing some nice integer multiple or [disfmarker]?
[speaker006:] Excuse me?
[speaker003:] Are they doing some nice integer multiple of th of sixteen?
[speaker006:] No.
[speaker002:] Are they [disfmarker] they're doing, like, twenty two
[speaker006:] No. No, no, it was like forty something.
[speaker002:] or s? Could [disfmarker] Forty eight? Forty [disfmarker] forty four?
[speaker006:] Forty four,
[speaker008:] F
[speaker006:] forty two.
[speaker008:] So, CD.
[speaker002:] Yeah. CD ROM.
[speaker004:] CD.
[speaker006:] Yeah.
[speaker002:] Yeah.
[speaker003:] Oh, forty four point one.
[speaker004:] Yeah.
[speaker002:] Forty four.
[speaker008:] Forty four one.
[speaker004:] Yeah.
[speaker002:] S
[speaker003:] Yeah.
[speaker006:] Something like that.
[speaker003:] Oh, so that's [disfmarker] Well, you know, we record here at for at forty eight or something
[speaker006:] And then we downsample. Yep.
[speaker003:] and then we downsample.
[speaker008:] But forty eight's a nice multiple of [pause] eight.
[speaker002:] But [disfmarker] but it [disfmarker] but forty four and sixteen are not easy?
[speaker003:] Yeah. Well you can do it.
[speaker008:] You can do it, I think.
[speaker002:] Yeah?
[speaker003:] Oh, absolutely you can do it.
[speaker002:] It's not lossy?
[speaker003:] Yeah. You can do [disfmarker] you can go from anything to anything else.
[speaker008:] You c y
[speaker003:] But [disfmarker] but it's [disfmarker] it's just [disfmarker] it's [disfmarker] it's just a little more complicated.
[speaker006:] You get aliasing.
[speaker002:] As long as you're [disfmarker] Yeah. As long as you're not doing the processing on the [pause] downsampled [disfmarker]
[speaker008:] There's probably some [disfmarker]
[speaker002:] I mean [disfmarker] Just for transcribing it, you mean?
[speaker003:] It's just like [disfmarker] Yeah. So [disfmarker] u u u Yeah. I mean, it's just slightly more complicated, but it's [disfmarker] but i you can [disfmarker] you can go from any frequency to anyth any other frequency. So it's [disfmarker]
[speaker006:] Well, the [disfmarker] the only thought was if we're gonna do a combined corpus, does it really matter if some's sampled at one rate and some's sampled at the other? My feeling is no, it doesn't. Your audio, u these days audio tools tend to take care of all of that. But I just wanted to double check with other people before I told them "yeah, no problem".
[speaker001:] Also seems like the corpus could all be standardized on s on this [disfmarker] the, uh [disfmarker]
[speaker006:] That's what I was saying.
[speaker009:] Why are [disfmarker] why are they asking us?
[speaker006:] So [disfmarker] so [disfmarker]
[speaker001:] Yeah.
[speaker006:] I don't know. Why are they asking us? Because, you know, we're sort of doing the corpus, so they want to be as similar as possible.
[speaker003:] A and, so I gue
[speaker006:] So. But I think the answer is, if [disfmarker] if we tell him "no, that's not alright", what he'll probably say is "well, we're gonna do it anyway".
[speaker007:] It could be interesting.
[speaker009:] Well that's [disfmarker] that's why I'm asking.
[speaker006:] But, uh,
[speaker007:] Well, it will be interesting to find out why they are choosing a higher sampling [disfmarker]
[speaker008:] Yeah.
[speaker006:] Uh. Yep.
[speaker008:] It's kind of a s
[speaker003:] Well, I would suspect it's because it's what the hardware does.
[speaker002:] For [disfmarker]
[speaker006:] Oh, and they just don't want to downsample?
[speaker002:] Yeah.
[speaker003:] Yeah.
[speaker008:] Well, someone's gonna have to downsample.
[speaker007:] But then they're just [disfmarker] they're just [disfmarker] there's just deferring the problem to later
[speaker008:] Yeah.
[speaker007:] and they might save themselves a lot of disk space problems by doing it right away.
[speaker002:] They're taking up more disk space.
[speaker008:] Yeah. It [disfmarker]
[speaker004:] Yeah.
[speaker003:] I [disfmarker] I [vocalsound] I think it's the sort of thing that's deserving of discussion with them.
[speaker006:] OK.
[speaker003:] I d I don't think it's like, i uh, they'll ask us, we'll give a simple answer and come back. It needs some back and forth
[speaker007:] I mean that's wha
[speaker003:] because it's [disfmarker] [vocalsound] it it's a little gnarly to have parts of the database with different things.
[speaker007:] That's like three times [disfmarker] three times as much disk space.
[speaker002:] Yeah.
[speaker008:] Yeah. It's [pause] four or five times.
[speaker003:] And it's,
[speaker004:] Yeah.
[speaker008:] Depends what you save.
[speaker003:] um, i You know, part of the arguments for the higher sampling rate is that maybe there's something, you know, say, in six to ten kilohertz that [vocalsound] you might use for [disfmarker] for some purposes somewhere. If people are doing a wide range of things, doing location, uh, you know, doing a bunch of things, maybe, you know, why [disfmarker] why throw it away if you don't need to? Um, on the other hand, um, I mean, it's [@ @] [disfmarker] [vocalsound] sixty kilohertz is plenty.
[speaker006:] Yep. That's wh that's what I thought.
[speaker008:] Yeah.
[speaker003:] So [disfmarker] [vocalsound] so [disfmarker] So, uh, I th I [disfmarker] I think it's [disfmarker] it's, uh [disfmarker] And they are gonna be using up a lot of disk, both for th them and for us when we're pr processing their stuff,
[speaker006:] Mm hmm.
[speaker007:] We should warn them that these disk space issues [pause] are gonna creep up on them very fast.
[speaker003:] uh, if they
[speaker006:] Yep. Yep.
[speaker002:] They'll have to start kicking people out of the meetings,
[speaker003:] Well, i w wa if [disfmarker] if they're going at forty four, they won't even creep.
[speaker006:] Yeah, but [disfmarker]
[speaker002:] like [disfmarker]
[speaker008:] Yeah.
[speaker004:] Yeah.
[speaker002:] As long as they have only, like, three people per meeting.
[speaker003:] They'll just pounce.
[speaker009:] How many channels?
[speaker002:] I mean, they can just limit the number of people.
[speaker006:] Um, I don't remember what their hardware set up was but it was smaller than ours.
[speaker003:] Well, that might help a bit.
[speaker006:] Yeah.
[speaker003:] Yeah, actually I think at NIST they were ta there were [disfmarker] there was some discussion of fairly high sampling rates too,
[speaker006:] Well, with NIST I think
[speaker003:] so.
[speaker006:] they're [disfmarker] they're in a different situation cuz they're doing video. And so compared to the video, the audio is just noise in terms of disk space, literally.
[speaker003:] I don't think that's true.
[speaker006:] Really?
[speaker003:] They're recording fifty channels of mikes.
[speaker006:] They're not recording all fifty of the [pause] array. They're [disfmarker] they're cooking it down,
[speaker003:] Yeah, they are.
[speaker002:] Yeah. They were g they said they were gonna record [@ @] [disfmarker]
[speaker006:] aren't they?
[speaker003:] They're recording all of them.
[speaker002:] I don't know if there were fifty, but there were definitely above, like, twenty.
[speaker006:] Whew.
[speaker003:] Yeah.
[speaker006:] That's funny. I thought that they were cooking down that data [pause] in some way before they were storing it.
[speaker002:] It was [disfmarker] it was high.
[speaker003:] I don't believe so. No. I don't think so. No. So I think they [disfmarker] they have actually a very large audio data rate. I think it is comparable to a video data rate.
[speaker008:] OK.
[speaker003:] So.
[speaker009:] How in the world are they gonna ever distribute this?
[speaker006:] Yeah, distributing [disfmarker] They're not going to.
[speaker003:] Uh.
[speaker009:] You're gonna have to just get [disfmarker]
[speaker003:] Interesting question.
[speaker009:] Because our [disfmarker]
[speaker006:] You'll have to just work on little subsets of it. There's just no way [pause] you could get it all.
[speaker009:] We're [disfmarker] we're estimating that ours [disfmarker] if we collect say a hundred meetings and each meeting is just the audio, compressed audio's half a gig, so there's fifty gigs just for our corpus.
[speaker006:] Yep.
[speaker009:] For a hundred meetings. And, uh, you know [disfmarker]
[speaker008:] That's eight kilohertz?
[speaker003:] And that's [disfmarker] and that's [disfmarker] and that's no video.
[speaker006:] Sixteen.
[speaker004:] Sixteen.
[speaker009:] That's sixteen.
[speaker002:] Sixteen.
[speaker008:] Sixteen.
[speaker009:] And so,
[speaker003:] Sample rate,
[speaker002:] You just get, like, one backchannel at a time or something.
[speaker003:] yeah.
[speaker008:] Oh, it's shortened.
[speaker009:] even [disfmarker] even a distribution of fifty gigs,
[speaker008:] Oh, OK.
[speaker004:] Yeah. It's shortened.
[speaker008:] And then shortened.
[speaker009:] you know, it's [disfmarker] if you use D V Ds or something, that's [disfmarker]
[speaker004:] Yeah.
[speaker006:] A lot.
[speaker009:] It's still, yeah, two or three D V but [disfmarker]
[speaker003:] Yeah, not if you have to distribute the video also.
[speaker006:] Two or three?
[speaker009:] If you use both sides and the two layer and all that.
[speaker006:] It's a lot more than that. Right? DVD is [pause] eight gig?
[speaker003:] Well, I think you'll have some interesting discussions next month when you go out there.
[speaker009:] S seventeen. Yeah. Yeah.
[speaker003:] I mean, how are they gonna [disfmarker] you know, what's [disfmarker] what's the distribution plan?
[speaker009:] Mm hmm.
[speaker003:] If they have something really smart in mind, you know, maybe we can use it. I mean [disfmarker] I mean, [vocalsound] w we talked about sending around a disk or a computer.
[speaker006:] I think that's definitely the right way to do it. Someone sends us disk. We [disfmarker] we load it with data and send it back. It's gonna be easier than any other method.
[speaker003:] Maybe a compu maybe [disfmarker]
[speaker006:] Well, if not [disfmarker] if you want to burn the C Ds, you're welcome to it.
[speaker009:] I say we give it to LDC and let them do it.
[speaker006:] Well, yeah. Yeah, absolutely. If they have a way of doing it.
[speaker002:] And there's never any talk [disfmarker]?
[speaker006:] I'm thinking prior to that.
[speaker008:] What's LDC?
[speaker002:] Was there ever any talk of taking the, um, close talking mikes when people aren't talking and deleting those portions?
[speaker007:] Linguistic Data Consortium.
[speaker008:] Mmm.
[speaker002:] Or is the breathing and things [disfmarker]?
[speaker006:] We already do that. Shorten does that automatically.
[speaker002:] Yeah? OK.
[speaker006:] That's why you [disfmarker] why [disfmarker] that's why Shorten [disfmarker] that's why Shorten reduces the size so much.
[speaker002:] And if they're still that big [disfmarker] I see. Yeah, that's true.
[speaker003:] That's why it's only fifty gigs.
[speaker006:] Right.
[speaker002:] OK. So it's still really big even if you're [disfmarker] only one person or two people at most are actually talking all the time.
[speaker006:] Yep.
[speaker002:] Wow.
[speaker007:] We should just talk less.
[speaker002:] Have shorter meetings!
[speaker006:] Well, if you talk less it does in fact use less me d m data.
[speaker004:] Yeah.
[speaker006:] So, the channels [disfmarker]
[speaker004:] Yeah.
[speaker003:] Hey, it's [disfmarker] it's the first time I've ever heard you ask for less data.
[speaker006:] Hmm. It's actually one way to tell if a microphone is dead in a meeting is if the shortened file is too short.
[speaker002:] Sorry. [vocalsound] [nonvocalsound] Thanks, Morgan.
[speaker004:] It's really short, yeah. Yeah.
[speaker006:] Then you can be pretty sure that the mike was off.
[speaker001:] Oh.
[speaker004:] Yeah.
[speaker007:] Uh, OK.
[speaker006:] And, the t unfortunately the tabletop ones [disfmarker] the six tabletop which we record all the time no matter how many people are there, uh, don't compress nearly as well because they're almost always have signal on them.
[speaker003:] Yeah, that's probably a lot of it.
[speaker004:] Yeah. Yeah.
[speaker003:] And they're gonna have mikes like that too.
[speaker008:] Yeah.
[speaker006:] Yep.
[speaker003:] In fact, their array [disfmarker] their array will be [disfmarker]
[speaker006:] Most of them.
[speaker008:] All of them are like that.
[speaker006:] Yep. So they won't shorten nearly as well.
[speaker003:] Yeah.
[speaker002:] Wow.
[speaker006:] And I assume they're gonna do it lossless.
[speaker002:] Yeah. So [disfmarker] so they're really going to have a huge [disfmarker]
[speaker007:] So f so for dis for distribution purposes it might make sense to split it by channel, uh, rather than by meetings.
[speaker006:] Yeah.
[speaker007:] So, you could distribute, like, only the near field signals, uh, uh, uh, together for a bunch of meetings
[speaker006:] Yep. Absolutely.
[speaker007:] and then have a second row.
[speaker006:] And then maybe one far field. You know? It's things [disfmarker] or the mixed channel.
[speaker007:] Yeah.
[speaker006:] Yeah, I think there are a lot of ways to do it, but [disfmarker] Let's not worry about that now.
[speaker003:] Yeah.
[speaker007:] Right.
[speaker003:] Yeah.
[speaker006:] How are we on disk space, Chuck?
[speaker009:] Um, we're OK. We've got [disfmarker] for the, uh, compressed meetings we've still got about, I think it was four gigs, uh, on the one disk that we're using.
[speaker006:] Mm hmm.
[speaker009:] And we've got several [disfmarker] we' we've still got, uh, quite a bit of space on the, uh, un backed up. So.
[speaker006:] Good.
[speaker009:] But I [disfmarker] I think it's probably [disfmarker] we should start thinking about where to go next, especially on the backed up disk space.
[speaker003:] Now we bought [disfmarker] a little [disfmarker] not all that long ago we brought three [pause] uh, thirty six gigabyte disks.
[speaker009:] That's the un backed up. Yeah. Those are the u
[speaker006:] Yeah, we're using those for the [disfmarker] for the expanded.
[speaker009:] So, for example, the, uh [disfmarker] Guenter's Wall Street Journal data went onto one of those,
[speaker003:] Uh huh.
[speaker009:] uh, some other experiment things that people are doing are on there, and [disfmarker] So. [vocalsound] If you put it there people will use it. Yeah. So.
[speaker003:] So I think after that we need another, uh, rack or something.
[speaker009:] Have to change servers, actually.
[speaker003:] Right? Change servers?
[speaker009:] Well, we could [disfmarker] we could [disfmarker] There are a bunch of disks that we have, uh, that are s s smaller. And they're, like, seventeen. We could go to thirty five. So we could [vocalsound] get some extra space out of that. But the s right now the server's full. We couldn't add any more disks. We could [pause] change a smaller disk for a larger one.
[speaker003:] We should probably do that while [pause] we have the space left on the [disfmarker] on the th the existing thirty sixes,
[speaker009:] Yeah.
[speaker004:] Yeah.
[speaker003:] so that we can
[speaker009:] Yeah.
[speaker006:] Yeah. The problem with that for backed up media is, uh, the sysadmins wanna keep them at eighteen meg [disfmarker] eighteen gig partitions
[speaker003:] shuffle it around.
[speaker001:] Mm hmm.
[speaker006:] because that takes about a day to get off back up tape.
[speaker003:] Oh.
[speaker009:] Well, then there's the other issue is that to g to g add more disk now, um, David says we really need to go to new servers.
[speaker006:] So.
[speaker009:] But he wants to go to new servers not just for us but for other groups too.
[speaker006:] For u the whole institute. Yeah.
[speaker009:] So there's this sort of coordination issue, and I guess I need to talk to him more about [disfmarker]
[speaker006:] Actually, going to bigger disks we can do even, and just maintain the eighteen gig partitions. You just partition them into multiple.
[speaker004:] Yeah.
[speaker009:] Yeah.
[speaker006:] So that's probably the next step,
[speaker003:] That's right.
[speaker006:] is to get the eighty or ninety gig drives to replace the thirty gig or an eighteen gig that we have now.
[speaker003:] There are eighty gig drives now that you can get for that?
[speaker006:] Yeah. Yeah.
[speaker003:] See, and that's probably what we should send around for these [disfmarker] [vocalsound] to d for distribution [vocalsound] of this corpus. This s s isn't any [disfmarker]
[speaker006:] A whole handful of microdrives.
[speaker003:] Yeah.
[speaker009:] Well, when they come out with an
[speaker006:] Is [disfmarker] is the areal density of the microdrive higher [pause] than of a w normal drive? It must be.
[speaker009:] When they come out with the eighty gig microdrive then we'll just send one of those little things around with all the meeting data.
[speaker006:] Yep.
[speaker004:] Yeah.
[speaker003:] Yeah. That's what I meant,
[speaker006:] Well, they have the two gig already.
[speaker003:] yeah.
[speaker006:] And I'm [disfmarker] I'm just thinking forty of them is probably still smaller [pause] in area than, uh, one normal sized drive.
[speaker003:] Actually, what [disfmarker] I think what [disfmarker] what, uh [disfmarker] was it [disfmarker] was it Dave who was suggesting [comment] that, uh, you just get, uh, uh, a [disfmarker] a computer
[speaker006:] Yep.
[speaker003:] that has one of these drives in it and just send the computer around to the different sites.
[speaker008:] Oh, God. Y
[speaker003:] And you can just [vocalsound] get it off the computer
[speaker008:] Put the computer on tour?
[speaker003:] and press the [disfmarker]
[speaker006:] Yeah. [comment] A laptop.
[speaker003:] Yeah. Laptop? Yeah,
[speaker004:] Yeah.
[speaker003:] send the laptop.
[speaker006:] Eighty gig laptop.
[speaker003:] And, of course you don't want [disfmarker] y we don't want to trust the shippers necessarily, so you send a person too. And they just kind of go from site to site,
[speaker006:] I'll [disfmarker] I'll do that.
[speaker003:] and download their data kind of [disfmarker] Johnny Appleseed.
[speaker006:] It [disfmarker] uh, uh, unfortunately it takes me a week at each site.
[speaker003:] Yeah. What?
[speaker006:] It does take a week at each site. So.
[speaker003:] Does it?
[speaker006:] Yeah, a absolutely. [vocalsound] If it's a nice site.
[speaker002:] Especially Hawaii.
[speaker003:] Yeah. There's a [disfmarker] there's a [disfmarker] they really need it in Novosibirsk.
[speaker006:] Yeah, right. Th that only takes a day or so. Anyway.
[speaker003:] R r I'm probably pr mispronouncing it. Well.
[speaker007:] But the University of Hawaii has issued a request.
[speaker006:] Yep.
[speaker003:] Yeah. Mm hmm. That [disfmarker] that needs a month, yeah,
[speaker007:] Yeah.
[speaker003:] to download. Things are slower there.
[speaker006:] Definitely true.
[speaker003:] Yeah. OK.
[speaker006:] Any other items?
[speaker003:] So. OK, so that's the meeting stuff. Uh, transcrip So you're [disfmarker] we're [disfmarker] you said it was almost half, so that means that we have, like, eighty or so hours and out of that maybe thirty five or something are [pause] transcribed?
[speaker009:] Yeah. The [disfmarker] the pie chart shows actually [pause] m meetings that are, uh [disfmarker] it combines the categories of, you know, "currently in [disfmarker]" Oh! Well, I've got it right there, I think.
[speaker006:] I [disfmarker] I saw the pie chart sticking out,
[speaker009:] Yeah. There's [disfmarker] there's just a few, uh,
[speaker006:] so.
[speaker001:] Do you want to write on the l on the board?
[speaker009:] Um. Yeah, except I [disfmarker] I'm tethered.
[speaker006:] D d do we care?
[speaker003:] He's tethered, yeah.
[speaker009:] Uh,
[speaker001:] I could write on the board.
[speaker009:] OK. It combines categories. So when we say "transcribed", we mean either in the process of being transcribed, either here or at IBM,
[speaker003:] Oh. Yeah.
[speaker009:] or completed transcription, and it also includes, uh, checked. So it includes a lot of categories together.
[speaker003:] I see.
[speaker009:] So.
[speaker006:] We need different color pens, definitely.
[speaker009:] And that [disfmarker] I think that that status thing is kinda old actually right now.
[speaker003:] Oh, that's [disfmarker] Yeah, that's not half. Yeah.
[speaker001:] Last updated in July.
[speaker009:] That one that you have?
[speaker001:] Oh, I'm not sure. The one that I saw on the web when I came back. OK.
[speaker009:] Yeah. The [disfmarker]
[speaker006:] Rustle, rustle.
[speaker009:] the date on this one is July twenty sixth, so, uh, I have to update it.
[speaker003:] A couple weeks ago. Yeah.
[speaker009:] Yeah.
[speaker001:] OK.
[speaker003:] But about how much do we have that's sort of, uh [disfmarker]?
[speaker009:] So we have total number of meetings is seventy eight [pause] meetings and, uh, uh, the total meeting time is seventy five hours.
[speaker003:] Mm hmm.
[speaker009:] And, um [disfmarker] [vocalsound] So,
[speaker008:] Oh.
[speaker009:] the ones that are finished being transcribed, as opposed to in the process of being transcribed [disfmarker] we've got twenty six hours that are finished being transcribed.
[speaker006:] Oh! Great.
[speaker008:] What does that mean, "finished being transcribed"?
[speaker009:] Um. So there's, uh, several processes to the transcription. There's, uh [disfmarker] I it ranges from being assigned to a transcriber, to [pause] them finishing transcription, to then being checked, you know, with a double check.
[speaker008:] Mm hmm.
[speaker009:] And so, when we say the total transcribed, that's the one that's gone through being checked, I believe. I think that's what the [disfmarker] I have here.
[speaker008:] OK.
[speaker004:] Just not yet approved for [disfmarker]
[speaker009:] But not yet approved.
[speaker004:] Yeah? OK.
[speaker009:] And then there's, uh [disfmarker] the final one is approved for release.
[speaker006:] Oh.
[speaker009:] That's after the meeting participants have [pause] gone through it.
[speaker006:] So I should probably send those to you, shouldn't I?
[speaker008:] Oh.
[speaker001:] Yes. At present there's [disfmarker] n none of those are on the pie chart.
[speaker009:] Yeah, if you know. Yeah, currently that's zero, released [disfmarker] uh, approve
[speaker006:] There are five.
[speaker009:] Huh?
[speaker006:] There are five.
[speaker001:] There're five? Good.
[speaker006:] We have five where, uh, everyone has replied.
[speaker009:] OK. OK. So we have five that are potentially releasable then.
[speaker001:] So the c the cross hatching there is, um [disfmarker] is it's been through the double check. Right? I mean, it's [disfmarker] this is the [disfmarker] it's it's been tran
[speaker009:] Yeah. That's approval in progress.
[speaker003:] Mm hmm.
[speaker001:] Everything on the [disfmarker]
[speaker009:] Yeah.
[speaker001:] So, I mean, it's [disfmarker] When I add a couple more from [disfmarker] that, uh [disfmarker] that were done in my absence, I think that th we'll be down to about there. So it's not quite as close to half as I'd thought, but it's, you know [disfmarker] it's more than a [disfmarker] And so these right here have been through the double check. These haven't.
[speaker003:] Mm hmm.
[speaker001:] Oh, how nice of you, holding [disfmarker] holding the thing so I'm not [disfmarker]
[speaker006:] It was falling off, uh.
[speaker001:] Yeah, thank you.
[speaker003:] Yeah. OK. Uh. Alright. So we still have a long [comment] ways to go but maybe the, uh [disfmarker] the IBM thing will [disfmarker] will help push through the [disfmarker] the rest of it somewhat quicker. OK.
[speaker006:] And there's still, uh, two people for whom I have not been able to get in touch [disfmarker] have never gotten a response from [disfmarker] from any of the emails about, uh [pause] permission forms. So.
[speaker001:] Are they from one of the foreign language ones?
[speaker006:] Yep.
[speaker001:] I mean [disfmarker] OK, good.
[speaker006:] That's so [disfmarker] that's why the NSA ones have still not been approved. Though.
[speaker001:] Those will figure less prominently in things anyway.
[speaker006:] Yep.
[speaker003:] Yeah. It might [disfmarker] it might partly just be [pause] European summer vacation issues.
[speaker006:] Possibly. It's been, like, four months, so.
[speaker003:] Oh.
[speaker008:] Wow.
[speaker007:] Uh, you know those Europeans. They got a lot of vaca
[speaker001:] Long vacations.
[speaker003:] Right. Hmm. OK. Uh, [comment] www. [comment] What else is going on?
[speaker004:] You [disfmarker]
[speaker003:] Why don't we just go around, cuz we only have a few minutes.
[speaker004:] Didn't you wanna say something about the hardware [pause] set up?
[speaker006:] Oh, that's right. Uh. Yeah, we have new hardware. So, I want to set it up at some point, so I just wanted to know what meeting schedules were.
[speaker003:] What new hardware?
[speaker006:] Uh, we have several more wireless channels so that we can set up and get rid of these, uh [disfmarker] the wired stuff completely.
[speaker003:] Oh.
[speaker006:] And then also we got replacements for these mikes.
[speaker002:] Oh. Really?
[speaker007:] Mm hmm.
[speaker003:] So, wha what's your question?
[speaker006:] Yeah.
[speaker008:] Oh.
[speaker002:] Are they like these,
[speaker006:] Yeah, they're like those.
[speaker002:] right?
[speaker006:] Those are the only two choices right now, unfortunately.
[speaker002:] OK.
[speaker003:] So what's your question?
[speaker006:] Question is, when are we not recording any meetings for a couple days so that I can do it and if it doesn't work, we won't impact people.
[speaker003:] Well, there's a point when a bunch of us are off at Eurospeech.
[speaker006:] So.
[speaker003:] Um.
[speaker006:] So, what's SmartKom?
[speaker004:] Nothing this week. Maybe n end of next week.
[speaker006:] End of next week. And is EDU still recording?
[speaker002:] They usually do Thursdays. I don't get a lot of advance notice, but it's al always been either Mondays or Thursdays. So.
[speaker009:] Thursdays?
[speaker002:] Yeah. They [disfmarker] they often do it after [disfmarker]
[speaker006:] So if I did it, like, tomorrow that would be alright [pause] it sounds like?
[speaker002:] for a while they were doing it after this meeting.
[speaker009:] Oh!
[speaker002:] Yeah. Wednesdays, Fridays [disfmarker]
[speaker006:] OK. So it sounds like no one n
[speaker002:] Definitely Wed Definitely Wednesday I'm not here, so I don't record anything.
[speaker006:] No one early next week.
[speaker004:] Yeah. Let me check with [pause] Robert again, but I [disfmarker] I'm [pause] pretty sure that there's nothing this week.
[speaker006:] OK.
[speaker003:] OK.
[speaker006:] And then I'll also re number so that, uh, the mikes are in order.
[speaker001:] Oh, thank you. Thank you.
[speaker003:] OK.
[speaker006:] Should help with the transcripts.
[speaker003:] Right.
[speaker006:] They wer so right now the channel numbers are discontiguous. Right.
[speaker001:] Yeah. I mean, you know, it's an extra step.
[speaker004:] Yeah.
[speaker003:] OK. So, I was just thinking maybe just go around and just brief briefly look what's other things that are going on, maybe, since we don't [disfmarker] don't have much of a set a set agenda and we don't have much time. Uh.
[speaker002:] But feel free to overlap.
[speaker006:] OK, we'll all say what we're doing at the same time.
[speaker002:] No, I mean [disfmarker] [vocalsound] I always get scared when you do these portions where you're not gonna overlap because [vocalsound] there's less data points.
[speaker003:] Well, why don't we d we [disfmarker] we deliberately pick two people to [disfmarker]
[speaker002:] I mean, people could, like, backchannel and ask questions and stuff.
[speaker003:] Yeah. I'll [disfmarker] I'll [disfmarker] I'll keep saying "uh huh". Yeah.
[speaker002:] OK.
[speaker007:] Mm hmm.
[speaker003:] This is absolutely natural meetings. We have [vocalsound] absolutely no effect from our preconceptions.
[speaker007:] So, we had [disfmarker]
[speaker002:] Right.
[speaker007:] the [disfmarker] the transcribers [comment] have trouble with your backchannel, because [disfmarker]
[speaker003:] With my backchannel?
[speaker007:] Yeah, with your backchannels.
[speaker003:] Uh huh.
[speaker007:] Because sometimes you have this sort of [disfmarker] this [disfmarker] this "uh huh" that you don't n So there's "uh huh" and then there's "aha!".
[speaker002:] Uh huh.
[speaker007:] And it's not quite clear always what [disfmarker] what it is you mean.
[speaker006:] Which "uh huh"?
[speaker003:] Which one it is?
[speaker007:] Yeah.
[speaker002:] But I don't think it's "aha!".
[speaker004:] Yeah.
[speaker002:] It's more like "uh huh!" rather than "uh huh".
[speaker004:] I'm [disfmarker] Yeah.
[speaker007:] Yeah.
[speaker008:] Yeah.
[speaker004:] I don't like the backchannels at all, as that's [pause] really a problem with the speech nonspeech detection.
[speaker008:] Yeah. Let's get rid of them.
[speaker004:] So [disfmarker]
[speaker006:] That's a [disfmarker]
[speaker003:] Well, has anybody done anything? Come on. What are we doing?
[speaker006:] I mean, I'll start if you want. I've been, uh, most recently rewriting Transcriber in Java for no particular reason.
[speaker003:] Yeah. Uh huh.
[speaker001:] Well, for speed.
[speaker006:] Uh. Well, I mean, Trans What happened was that Transcriber's very slow to load. So when you have a big meeting it c uh, especially on a slower machine, it can take five minutes before you can start doing anything.
[speaker007:] Mm hmm.
[speaker006:] And so I was thinking about why that was and the data structures I would use, and I found myself unable not to sit down and code it.
[speaker007:] Mm hmm.
[speaker006:] So I did. And so I have a big chunk of Transcriber now written in Java and it comes up, you know, in a couple of seconds. Um.
[speaker007:] u Do you take [disfmarker] do you take feature requests?
[speaker008:] Cool.
[speaker002:] Great. Great. Y y yeah. W we should talk to you off line about something.
[speaker003:] Well, wait a minute,
[speaker006:] I [disfmarker] It's not really [disfmarker] probably not worth doing.
[speaker003:] what [disfmarker]?
[speaker007:] That would [disfmarker] th w s Well, actually, I think it is worth doing
[speaker006:] But we can talk about it.
[speaker002:] Yeah.
[speaker007:] because here's the thing. We're sort of [disfmarker] we're starting to move from transcription to annotation.
[speaker006:] Mm hmm.
[speaker007:] And [pause] the Transcriber interface is fine [pause] if essentially what you're doing is stringing words together to p to make transcripts.
[speaker006:] Annotating. Yep.
[speaker007:] But, um, in [disfmarker] for instance, what we're doing now w with, uh, Communicator data, but which we would like to do with Meeting data, is to actually label utterances, or words, or whatever units you want [vocalsound] with, uh, you know, basically doing a multiple choice type of labelling.
[speaker006:] Mm hmm.
[speaker007:] And for those type of tasks, it wou it's much more efficient to present, [vocalsound] uh, the [disfmarker] th p present a bunch of, uh, clickable buttons or whatever
[speaker006:] Dialogue. [comment] Yeah. Buttons.
[speaker002:] Mm hmm.
[speaker007:] and, um [disfmarker]
[speaker002:] But it has to be multi stream. Th they [disfmarker] In other words, the beginning of something could be one [pause] speaker and the end of that unit, like question answer pair, could be a different speaker. That's why we can't [pause] just annotate the transcripts, uh, one [disfmarker] listening to one at a time.
[speaker006:] Mm hmm.
[speaker002:] So [disfmarker] so that's why the Transcriber's nice for sort of listening to it, but you can't actually encode, um [disfmarker] encode someth
[speaker006:] Yeah. I un I understand the problem.
[speaker002:] Yeah, exactly.
[speaker006:] So.
[speaker002:] So.
[speaker007:] And [disfmarker] and th that's actually a good model, which is what this current tool that we're using has, is to atta to associate these [vocalsound] labels with, um, attributes of SGML tags.
[speaker006:] Mm hmm.
[speaker007:] So, you know, you have, say, a tag for [disfmarker] I don't know [disfmarker] what type of utterance, whether it's a question or a statement or whatever. And then [vocalsound] you have an, uh [disfmarker] you know, an [disfmarker] a tag attribute and the value of that encodes the choice.
[speaker006:] Right. Right. So what I don't have with it so far is it doesn't play wavefiles and it display wavefiles. I just haven't done that since that [disfmarker] that part wasn't [disfmarker]
[speaker007:] Oh, you mean display as in showing the waveform?
[speaker006:] Yep.
[speaker007:] OK.
[speaker006:] Yep. And, uh [disfmarker] and then also a lot of the fancy user interface stuff that's in Transcriber I haven't done.
[speaker007:] Mm hmm.
[speaker006:] But it works.
[speaker003:] What's, uh, the original Transcriber written in?
[speaker006:] Tcl TK.
[speaker003:] I see.
[speaker006:] So.
[speaker003:] So.
[speaker009:] Are you using [disfmarker]?
[speaker006:] Which is nice and flexible but very, very slow in comparison.
[speaker003:] Yeah, yeah. Right.
[speaker009:] Are you using the [disfmarker]? Oh, you [disfmarker] oh, you are. We already talked about that. The XML [disfmarker] [vocalsound] Reading
[speaker006:] Yep, SAX.
[speaker009:] SAX. Yeah.
[speaker006:] Cuz it's much faster than DOM and uses less memory.
[speaker009:] Right. Right.
[speaker006:] So. And then, uh,
[speaker007:] Mm hmm.
[speaker006:] preparing for quals. Uh, hopefully second week of September if I can ever get Warren Sack to [pause] answer my emails. I probably shouldn't say that on the tape.
[speaker003:] Beep.
[speaker006:] Yeah. Oh, well. I gotta remember to beep that out.
[speaker009:] Who was that?
[speaker006:] No So anyway. So I've been preparing for that.
[speaker003:] Not answering your calls, huh?
[speaker006:] And, uh, actually, I wanted to say off line with you about any literature [pause] reviews I should do beforehand.
[speaker003:] "War and Peace."
[speaker006:] "War and Peace." That's a good choice.
[speaker003:] Yeah.
[speaker006:] Keep me busy.
[speaker003:] Yeah.
[speaker002:] It's actually not a bad idea to say "beep" as a word because you can search the transcripts, y you know, for [disfmarker] for that, to find these places.
[speaker006:] For "beep". That's a good idea.
[speaker002:] No, I'm s I'm totally serious. To have one word, like "beep",
[speaker006:] No, absolutely. I agree.
[speaker002:] especially with a really long "eee" [comment] like that.
[speaker003:] Yeah.
[speaker002:] Works great.
[speaker003:] I'll [disfmarker] I'll take that role anytime you want. I like saying it. So. OK.
[speaker004:] Yeah. I've been doing a bunch of recognition experiments on [pause] meeting data with different, uh, segmentations [disfmarker] with different [disfmarker] different automatic segmentations, but [pause] it's not yet finished. It's [pause] work in progress.
[speaker003:] OK. Any sense about how [disfmarker] how it does on [disfmarker]?
[speaker004:] Yeah. For, uh [disfmarker] for [disfmarker] for the paper I w I want to submit to ASRU to [disfmarker] [vocalsound] to, uh, evaluate the quality of the speech nonspeech detection by [pause] using it for speech recognition.
[speaker003:] Right, but I was just asking if you had a sense yet of [disfmarker] of, uh, whether [disfmarker] maybe you already did this experiment, where there's this question of [disfmarker] of how much it hurt you or helped you to use segmented versus [disfmarker]
[speaker007:] Yeah, but we didn't have the exact comparison.
[speaker004:] It [disfmarker]
[speaker007:] But [disfmarker] you know, there were [disfmarker] i i the experiments were based on different segmentations and different transcripts.
[speaker004:] Yeah.
[speaker007:] So we weren't quite sure which [disfmarker] whether the difference came from different [pause] transcripts, for instance. And so [vocalsound] Thilo's [disfmarker]
[speaker004:] So, it hurts compared to the ideal segmentation, when you have the [disfmarker] the manual segmentations, where you have exact boundaries for each s utterances. Sometimes there are some [disfmarker] some words are cut off or [pause] there's some segments i are s uh, assigned to s to speech which there is nothing in. And so there are more insertions but [vocalsound] most of the time there are more [disfmarker] the [disfmarker] the number of deletions is higher when [disfmarker] when you use the automatic segmentation compared to the ideal one. And so I'm just in [disfmarker] in progress of, yeah, trying to feed the recognizer with un segmented data and to see how much worse that is. So that [disfmarker] that I have three things. Un yeah [disfmarker] un segmented, the automatic, and the [disfmarker] the ideal one.
[speaker003:] Yeah.
[speaker007:] But the recognizer's putting up some resistance because it doesn't like the un segmented data.
[speaker004:] Yeah.
[speaker003:] Uh huh.
[speaker008:] Um. Yeah, I just got back [pause] from Chicago. So. Um, fishing went pretty well.
[speaker006:] Oh, yeah. All of us are banging.
[speaker003:] Good. Good.
[speaker008:] And, um, I was gonna post some results, you know, with, uh,
[speaker002:] Wisconsin fishing.
[speaker006:] With fishing. B
[speaker008:] Wisconsin fishing. Yeah.
[speaker003:] Yeah.
[speaker008:] Uh.
[speaker003:] So your [disfmarker] so your results are about the same as Bush's,
[speaker006:] You should have seen the one that got away.
[speaker003:] basically. His [disfmarker]
[speaker008:] Y who [disfmarker] Yeah, right. Whose result?
[speaker003:] Bush's. Yeah, you're both, you know, sort of [disfmarker] He's [disfmarker] he's coming back to the heartland and [disfmarker]
[speaker008:] Yeah, right, exactly. I did my tour of the heartland.
[speaker003:] Right. [vocalsound] Yeah.
[speaker009:] Did you build any houses?
[speaker008:] Yeah. Yeah. I built a few [disfmarker] built a few houses. Um, but right now I guess, uh, I'm working on [vocalsound] this paper [disfmarker] this ISCA paper for this workshop that Liz and Andreas and I are [pause] putting together. So we're just getting, uh, different results for [disfmarker] Um, we fixed up [pause] our different, uh, transcripts with different types of, uh, annotations and we re re ran ali re ran alignments. And we're gonna develop a new feature database based on those alignments and do some trees and analysis. So I'm kind of in the middle of that. And hopefully by the twentieth, the twenty third.
[speaker002:] Twentieth.
[speaker008:] The twentieth! Yeah. We'll have it all straightened out.
[speaker007:] Yeah.
[speaker008:] So. It's gonna be a busy week.
[speaker007:] Yeah. You know, I'll bet [disfmarker] You know, Bush went on this European trip recently and [vocalsound] they told him there that they get more vacations.
[speaker003:] Yeah.
[speaker007:] So he came back here and thought "oh, I [disfmarker] I can afford some more vacation too".
[speaker002:] Beep.
[speaker003:] Yeah. I [disfmarker] I think he's b he's been [disfmarker] he will have been off, like, two months out of his first seven [pause] in office.
[speaker008:] Yeah. It's amazing.
[speaker007:] Yeah. It's hard to keep concentration, you know,
[speaker003:] That's a pretty good deal.
[speaker007:] and the focus on the [disfmarker]
[speaker009:] Don't even really notice, do you?
[speaker003:] Anyway.
[speaker007:] Um. So while he's vacationing, um, we've been, uh [disfmarker] Well basically this is like a joint effort. Uh, d we were just [disfmarker]
[speaker003:] Who are you talking about, Bush or Don? Yeah.
[speaker007:] Um, you know, f apart from getting [disfmarker] preparing the [disfmarker] the da the data for the, um [disfmarker] [vocalsound] for these experiments for the, um, [vocalsound] uh [disfmarker] for this prosody workshop, um, we just, um [disfmarker] we just had a phone call with Mari and her students, in fact, and they want to, um, e m They're bringing up their own meeting recognizer, which is based on Bill Byrne's, uh, recognizer from Johns Hopkins.
[speaker003:] Mm hmm. Based on Hub five, or like [disfmarker] like your [disfmarker]?
[speaker007:] u [comment] Based on their Hub five recognizer.
[speaker002:] Mm hmm.
[speaker007:] And, uh,
[speaker003:] Yeah.
[speaker007:] so they've been getting from us the, um [disfmarker] [vocalsound] you know, some support in terms of getting the latest transcripts and the [disfmarker] also the [disfmarker] actually the, [vocalsound] uh, transcripts annotated with events,
[speaker003:] Mm hmm.
[speaker007:] uh, like sentence boundaries and stuff like that.
[speaker003:] Mm hmm. Yeah.
[speaker007:] Um, because one of Mari's students was to [disfmarker] wants to do some language modeling for, uh, predicting overlaps and, uh, stuff like that.
[speaker003:] Yeah.
[speaker007:] Um.
[speaker002:] Yeah. Actually we had this ide from the last time that they were here, that it'd be nice to have UW do some work on [pause] language modeling that would be trying to get at the same [pause] detection as what we do acoustically
[speaker006:] Can I borrow a piece of paper?
[speaker002:] since they can ramp up much ques quicker in the language modeling
[speaker006:] Thank you.
[speaker002:] and we don [vocalsound] you know, we'll do the, uh, prosodic side. And so this is supposed to be a project that we could actually [pause] integrate the posteriors that they get from their language model for every word boundary or every frame boundary, and then train up the classifiers.
[speaker003:] Yeah.
[speaker007:] Mm hmm.
[speaker002:] And it's [disfmarker] I guess it's an undergrad, too, that [disfmarker] that's going to be doing this work.
[speaker008:] Cool.
[speaker007:] Yeah.
[speaker002:] So.
[speaker007:] Um, on the recognition side, actually, um, I think the main person doing that is, uh, Harriet from [disfmarker] Harriet Nock from, uh [disfmarker] formerly of Cambridge.
[speaker003:] Yeah.
[speaker007:] Um, [vocalsound] and apparently they get reasonable results except in some portions they get very high insertion rates [disfmarker] even higher than we get with [disfmarker] with the, um [disfmarker] [vocalsound] like even, you know, on lapel mikes with, uh, [vocalsound] background speech. And so they were trying to track that down, and [disfmarker] It could be that our recognizer's actually doing relatively well because it has a reject model for, you know, mismatched speech, essentially, or for unspecified speech. And, um, so [disfmarker]
[speaker003:] Oh!
[speaker007:] so, uh, they'll [disfmarker] I sent them our recognition output so they can sort of do a [pause] line by line comparison and see if [disfmarker] if they, um [disfmarker] [vocalsound] you know, their insertions correspond to our rejects and stuff like that. So, um, we'll see what that, uh, leads to. Um. Yeah. Other than that, uh, we're [disfmarker] Well, that's pretty m pretty much it as far as meetings are concerned.
[speaker003:] Yeah, I mean we're doing, uh [disfmarker] So I should mention, Dave and I have sort of been [pause] pushing through [disfmarker] thinking in terms of an ASRU paper. But I'm still [disfmarker]
[speaker007:] Mm hmm.
[speaker003:] I think early next week we'll decide whether we'll [disfmarker] [vocalsound] we'll do one or not. Um. But [disfmarker] because, you know, the results are [disfmarker] are still confusing enough that [disfmarker] [vocalsound] that, um, we we gotta be convinced we understand what's going on. But it's starting to look like it [disfmarker] it's almost the opposite of the usual th situation [vocalsound] where, um, [vocalsound] you get some really nice result with, uh [disfmarker] [vocalsound] with digits, say, and then you go to a large corpus and the result goes away. Um, we had what looked like a good result in digits but th but then when we went to more training data that kind of went away.
[speaker007:] Mm hmm.
[speaker003:] So, uh, the digits result right now is kind of equivocal.
[speaker007:] Mm hmm.
[speaker003:] Um, but the conversational speech one, while not huge, is in sort of Hub five or Meeting kind of terms, actually it's [disfmarker] it's [disfmarker] it's not bad. You know? So [disfmarker] [vocalsound] So it's [disfmarker] it's [disfmarker] you know, it's like, i i w
[speaker007:] Right.
[speaker003:] after he did some adjustments, more like a percent or so that [disfmarker] that i th absolute, that it goes [disfmarker] [vocalsound] goes down
[speaker006:] Yeah. It's a P H
[speaker003:] and [disfmarker]
[speaker007:] But is it still true that basically the s speaker adaptation, um, sort of negates much of the advantage?
[speaker003:] Sometimes. Yeah. No, I'm talking about with the adaptation.
[speaker007:] With it.
[speaker003:] Without the adapt without the adaptation is a much bigger effect.
[speaker007:] OK.
[speaker003:] So it so it's [disfmarker] it's very reasonable to think of as an alternative way [pause] of getting this kind o kind of improvement.
[speaker007:] Mm hmm.
[speaker003:] But I think what w ultimately what we have to face with it is that, um [disfmarker] I mean, he gets incredibly good results [vocalsound] if you artificially reverberate clean [disfmarker] you know, close [disfmarker] close miked data.
[speaker006:] Right.
[speaker003:] So I think the thing we really have to face is that our model [vocalsound] for what's going on is [disfmarker] is wrong
[speaker006:] Is it wrong?
[speaker007:] Right.
[speaker003:] or incomplete, and that in this situation in particular there's a lot of noise.
[speaker007:] Right.
[speaker003:] And noise plus reverberation is not at all the same as just reverberation. So, um, uh, there's that one thing that [pause] [@ @] [comment] been thinking of doing, is there's a whole lot of work that's been going on in noise suppression in the [disfmarker] in the Aurora, uh, team. And so, uh, they've got some software and I'm think of [disfmarker] of just having us integrate that in, uh, cuz it [disfmarker]
[speaker006:] Just combine it see.
[speaker003:] Yeah. Cuz it just [disfmarker] I mean, it just subtracts it out. In fact [disfmarker] in fact you can run it in sort of enhancement mode where you get speech out and [disfmarker] and [disfmarker] and, uh, then just run it through the rest of your recognizer.
[speaker007:] Mm hmm.
[speaker003:] So [disfmarker] So, uh [pause] um.
[speaker007:] Yeah.
[speaker006:] Neat.
[speaker003:] So we're working on that.
[speaker007:] OK. There's some work, um, [vocalsound] that [disfmarker] Do you remember this [pause] paper or poster [comment] by, um, some CMU folks at, uh, HLT? They were talking about [disfmarker] and [disfmarker] and they s they referred to an upcoming ICASSP paper, I think, at the time. Some someone in Karlsruhe, I think, um, worked on, [vocalsound] uh, es you know, estimating noise from the silent regions and then, [vocalsound] uh, doing some explicit [disfmarker] I don't know if it's something akin to parallel model combination or something like that to [disfmarker] to, uh,
[speaker003:] I mean, people have done that for a long time. Right?
[speaker007:] Right. Anyway, uh, so I [disfmarker] I [disfmarker] I couldn't judge whether this was original or not, but [disfmarker] but it seemed like they got pretty good results on their meeting data. So we might want to look into that.
[speaker003:] Yeah, I don I don't remember the paper.
[speaker007:] Right.
[speaker003:] But I mean, that [disfmarker] th that's certainly one of the common techniques is to do that.
[speaker007:] Right.
[speaker003:] Uh, and in all th the stuff that our team is doing they certainly look at [vocalsound] regions that you think are [vocalsound] nonspeech in order to get noise statistics.
[speaker007:] Mm hmm.
[speaker003:] But, [vocalsound] uh,
[speaker007:] Right.
[speaker003:] I mean, there's a host of thing different things you could do. In the Aurora thing, we have [disfmarker] we have a little bit of a handicap in that they [disfmarker] they don't let you, [vocalsound] uh, adjust the tis [comment] the statistical models. So y you have to [disfmarker] you have to do everything at the feature level.
[speaker007:] Mm hmm.
[speaker003:] Um. But, um, um [disfmarker] but there's, uh, you know, Wiener filtering and spectral subtraction which are, uh, sort of [disfmarker] i can be looked at as m minor modifications of one another. Um. And they they've now built up a nice piece of software that does [disfmarker] u um [disfmarker] has this sort of general framework for a [disfmarker] for it so that you can adjust it to sort of an any [disfmarker] any [disfmarker] any one of a dozen ways that people have done this kind of thing and
[speaker007:] Mm hmm.
[speaker003:] they found a particular set of parameters they liked [pause] this week. And [pause] we're running with that for a while. But.
[speaker007:] OK.
[speaker003:] Anything else?
[speaker002:] So. Well, I'll just really briefly, um [disfmarker] So, I've been working with Don and also [disfmarker] [vocalsound] and [disfmarker] and Andreas on the [disfmarker] this paper on prosody, and what we're trying to do is predict where people [disfmarker] at [disfmarker] given all information up to whatever point in time you're considering, try to predict if that's a good location for someone else to jump in. So, that's the idea of that paper. And that's [pause] the same task that Mari, a um, [vocalsound] a student named Dustin, and also Sarah who was at this last meeting [vocalsound] will be looking into doing from the language modeling side. Maybe some kind of clu you know, clustered class N gram or something.
[speaker003:] Uh huh.
[speaker002:] Um. And also we're [disfmarker] we're using a couple of the labellers who are doing emotion to help us, um, finalize some transcripts for this. So these undergra undergrad students are really helping us out a lot,
[speaker008:] Yeah.
[speaker002:] under Don's supervision, actually. So that's good.
[speaker008:] Right.
[speaker002:] So these offices are being, uh, very busy [disfmarker] Don's and the one across from him. And then also, um, working with Jeremy on Communicator emotion labelling. And [vocalsound] most of that up to a few weeks ago was just getting the [pause] people labelling these utterances to a computer for emotion and that's going pretty well now.
[speaker003:] What kind of emotions do you label?
[speaker002:] Um. Well, we're mostly looking for places where the person's frustrated with the system.
[speaker003:] So, there's just two categories, frustrated and not, or [disfmarker]? No.
[speaker002:] There [disfmarker] there are actually [disfmarker] that's how we started it.
[speaker003:] Yeah.
[speaker002:] And we had different levels. Now we have things like "amuse". Like, "oh, you finally got it". And [disfmarker] [vocalsound] um, and "disappointed tired". Like, "yeah, no, that's wrong again". Which isn't really mad, but, you know.
[speaker003:] Yeah.
[speaker002:] So th they gave me a lot of feedback. The labellers, after doing this,
[speaker003:] Uh huh.
[speaker002:] told me what they wanted as categories. So. [comment] And then there's jokes. And [disfmarker]
[speaker003:] Yeah.
[speaker002:] Yeah, right. Um. There's not a lot of [disfmarker] enough frustration for us to really go through quickly, cuz we have to label every meeting and also things like repeats for the same information, and so forth. And I've been coordinating a little bit with [vocalsound] Katrin at, uh, UW who was doing [pause] user correction work that she presented at the [disfmarker] at the meeting. So there's some overlap there in what you m there's a correlation between corrections and annoyance or frustration.
[speaker003:] Yeah.
[speaker002:] Um, but Jeremy's been starting to really work on that project now from the acoustic side. So we have all these waveforms, and he's been [vocalsound] with Morgan's help and, uh, Dan Ellis's, I think, looking into spectral tilt a bit, so he can talk about that. It's a feature we haven't used before. Um, and starting to, uh, r r take information from alignments and create a database that we can use sort of as a [disfmarker] [vocalsound] a large feature vector or table to feed to our decision trees, which will try to give us back an answer from the speech only as [pause] to whether the person's frustrated or not.
[speaker003:] That reminds me of something.
[speaker002:] So.
[speaker003:] We [disfmarker] we talked about something a ways back and I sort of lost track of it, about having a synthesizer driven with [disfmarker]
[speaker004:] Yeah. I haven't really [pause] had time to do that.
[speaker002:] Yeah. [vocalsound] Actually, I wanted [pause] to talk with you about that
[speaker004:] Yeah.
[speaker002:] cuz there's a similar project at SRI where we're using [disfmarker] we want to do something like that to look at whether or not some of the p stylized pitch stuff [vocalsound] is, um, sort of perceptually similar to the kinds of things that people would mark.
[speaker004:] Yeah.
[speaker002:] So, I [disfmarker] I actually wanted to talk to you about that.
[speaker004:] Yeah. Maybe after Wednesday?
[speaker002:] So. OK. Yeah. Cuz this will be, like, after [disfmarker]
[speaker003:] Yeah, cuz you have this AS ASRU deadline.
[speaker004:] Yeah. Yeah.
[speaker002:] OK. Yeah. This will be after September anyway,
[speaker007:] Right.
[speaker003:] But that seemed like it would be fairly straight forward, that if you take the [disfmarker] take the pitch from the real data, feed it into the synthesizer, and then process the output with a gain box that you also had energy from the [disfmarker] from the real data.
[speaker004:] Yeah.
[speaker002:] so I [disfmarker]
[speaker004:] Yeah.
[speaker002:] Right.
[speaker004:] Yeah.
[speaker002:] Yeah. There was just no [pause] way to use the energy in Festival, that was [disfmarker]
[speaker007:] Hey! We could use that in the English [disfmarker] We have to do the English synthesis for What if we make the system really [pause] annoyed?
[speaker002:] OK Anyway. [vocalsound] I [disfmarker] I should move on cuz we're running late,
[speaker003:] Yeah.
[speaker002:] but I wanted to say there's one question in my mind, which maybe Morgan can talk to Jeremy about, is how to sort of normalize spectral tilt. It's just [disfmarker] I'm sort of in this, uh, area I don't know much about and so we should talk off line.
[speaker003:] OK.
[speaker002:] But if you have a certain speaker [vocalsound] and you wanna sort of get a bunch of data from that speaker but compare it, you know, directly on a feature to [disfmarker] to like a decision tree that won't normalize anything for you once you feed it the features, how do you sort of normalize over a particular speaker?
[speaker003:] Mm hmm.
[speaker002:] What kinds of [disfmarker] what [disfmarker] what makes sense to do with that feature?
[speaker003:] Well, I'll have to hear what he's using, f given different suggestions he's gotten.
[speaker002:] So. i Yeah. But that's something we [pause] would [pause] be [pause] glad to [pause] have help on.
[speaker003:] But [disfmarker] OK.
[speaker002:] So. Go ahead, Jeremy.
[speaker005:] Right. So I've been looking at spectral tilt and [pause] different ways of [pause] perhaps generating it. And, um, I basically have three ways right now that we're looking at for, uh [disfmarker] we're gonna look at for features. Uh, one is just looking at, um, the first cepstral coefficient and, uh, using that. Um, another is looking at the log ener the difference of log energies between, um, the high [disfmarker] like a high frequency band and a low frequency band. And the third is just, um, taking a slope, um, of the linear fit of the spectrum [pause] and using that. So, those are the three [disfmarker] three ways I have right now for generating these spectral tilt numbers. And, [vocalsound] um, hopefully soon we can look at some of the labelled stuff and look at, uh, these numbers and see [disfmarker] see which ones w seem to be working well. And things like that. Um, I also recently wrote a script, um, [vocalsound] that, uh, generates the kappa statistic, um, which is a [disfmarker] for labeller agreement. Um, so, [vocalsound] [nonvocalsound] been looking at that as well.
[speaker004:] Yeah.
[speaker003:] I mean, wh what [disfmarker] [vocalsound] specifically, what you wanna do is remove the [disfmarker] the [disfmarker] the [disfmarker] the average, uh, speaker [pause] tilt in some sense?
[speaker002:] The thing i Yeah. We [disfmarker] we [disfmarker] you wanna use spectral tilt to try to get at the s n the voice quality of these utterances. So you could have something like "no" versus "no!" and these might differ in that way. But the problem is we don't know [disfmarker] [vocalsound] th we don't [disfmarker] we don't know whether the "no" is frustrated or not.
[speaker003:] You don't know it. Yeah. Yeah.
[speaker002:] So [disfmarker] Right. [vocalsound] Exactly. And then you also have the different speakers. And so, the sort of question is, [vocalsound] do you wanna average all the data together or do you [disfmarker] do you [disfmarker]?
[speaker003:] Yeah.
[speaker002:] You wanna capture the change in voice quality within a speaker, without having to know ahead of time w which is which, cuz that would be circular.
[speaker003:] I mean,
[speaker002:] So,
[speaker003:] m maybe [disfmarker] maybe this is too obvious to be right,
[speaker002:] u this is [disfmarker]
[speaker003:] but I mean, the [disfmarker] the [disfmarker] the [disfmarker] the normal thing for C one would be to [disfmarker] to, uh, get rid of the mean and th and the variance. Right?
[speaker001:] To get rid of what?
[speaker003:] Does that [disfmarker]? [vocalsound] The mean and variance. Have it be zero mean and unity variance.
[speaker006:] Mean and variance.
[speaker001:] OK.
[speaker002:] But do you do this, say, just in the vowel regions,
[speaker003:] And then [disfmarker]
[speaker002:] and do you [disfmarker]? a There's [disfmarker] there's a whole bunch of, um, sort of unknowns.
[speaker003:] Right.
[speaker002:] And we can try all of them and just put them into the tree as features,
[speaker003:] Well, the answer's yeah. I mean, you want [disfmarker] you want it for every place that's voiced.
[speaker002:] and [disfmarker]
[speaker007:] But [disfmarker] but you can't do it [disfmarker] I mean you can't just normalize it based on the utterance because then you're gonna have zero everywhere. Right? So you'd have to normalize it based on [pause] the [disfmarker]
[speaker003:] No, ev everything for that speaker.
[speaker002:] Yeah.
[speaker007:] Yeah, OK. But that's not really feasible
[speaker002:] Everything up to that point.
[speaker007:] because you're having a sys you have a system, a dialogue system, where you only have access to the [disfmarker] what the speaker said before.
[speaker003:] Yeah?
[speaker007:] So it'd have to be sort of a causal, uh, version of [@ @].
[speaker002:] Oh, yeah. That's OK. That [disfmarker] that's the sort of [disfmarker] w we keep [disfmarker] you keep, uh, iterat you keep updating those numbers for future utterances.
[speaker006:] Yeah.
[speaker002:] Th That [disfmarker] that would work.
[speaker003:] Yeah. I mean, but [disfmarker] but the main [disfmarker] I think the main thing is that [disfmarker]
[speaker007:] Or you c u
[speaker003:] the [disfmarker] You're right. I mean, the main distinction is whether it's voiced or [disfmarker] or [disfmarker] voiced or not. If it's [disfmarker] if it's [disfmarker] if it's silence or [disfmarker] or unvoiced regions, then you [disfmarker] you [disfmarker] you don't really want that in there, uh, if you can help it.
[speaker002:] Yeah.
[speaker003:] But actually, I mean, just to first order, [comment] suppose you just didn't do anything smart at all and just did [disfmarker] you know, did that, it wouldn't be that bad. Because you'd get some number that would be skewed by [disfmarker] be skewed by that [disfmarker]
[speaker002:] So you mean, you're just [pause] using a mean and the varian and a variance?
[speaker003:] You know, uh, uh, X X [disfmarker] X [disfmarker] X X [disfmarker] X minus mu over sigma. Yeah.
[speaker002:] You mean just a [disfmarker] a Z square, like? Right, right. Right. OK. So it is distributed [pause] in a way that you can do this. Yeah. OK.
[speaker007:] Mmm.
[speaker003:] It [disfmarker] it [disfmarker] it's [disfmarker] it's sort of the first order thing to do. There's, uh, you know, uh, obviously much [disfmarker] much more arcane things to do and complicated things to do.
[speaker002:] OK. So, that's [disfmarker] so [disfmarker] that was our sort of [disfmarker]
[speaker003:] But that's [disfmarker] th that's the first thing to do.
[speaker002:] maybe this will work, I don't know.
[speaker003:] And then [disfmarker] you know, then [vocalsound] the next thing is, "well, let's just look at the voiced regions",
[speaker002:] OK.
[speaker003:] you know, and that would be a reasonable thing to do. And then if it's really [disfmarker] when you look at what y i i i Since you're looking at something that's sort of in log domain, cepstral is like log d linearly transformed of a log domain, [comment] [vocalsound] it's probably not that terrible an assumption to pretend it's Gaussian anyway. And so the other things that get more [disfmarker] more tricky are, [vocalsound] uh, to handle the fact that it's not [disfmarker] not really Gaussian. And [disfmarker] and y you may [disfmarker] you may not really need that for this.
[speaker002:] Well, we probably won't get that far. Yeah.
[speaker003:] Yeah. So I think that would be [disfmarker] that would be the obvious thing to do.
[speaker002:] OK. OK.
[speaker007:] Well, we're not gonna build a parametric model of the [disfmarker] o o of the [disfmarker] of the feature.
[speaker002:] Yeah.
[speaker007:] Right? We're just gonna [disfmarker] we we're gonna use [vocalsound] like thresholding or something.
[speaker003:] No, I understand. It's just [disfmarker] it [disfmarker] it [disfmarker] No, it's more that [disfmarker] that if you felt something wasn't Gaussian and you were trying to [pause] normalize for some kind of, uh, bias of some sort, you might use a non parametric [vocalsound] measure,
[speaker007:] Right, right. OK.
[speaker003:] like you might use a median,
[speaker002:] m Median, yeah.
[speaker007:] Right.
[speaker003:] you know, and rank statistics, and all that sort of stuff.
[speaker002:] We could just plot [disfmarker] plot these for a speaker,
[speaker003:] But I mean, you shouldn't bother with it if it's roughly Gaussian.
[speaker002:] and get a bunch of histograms.
[speaker007:] Right.
[speaker003:] Just [disfmarker] Yeah.
[speaker002:] OK.
[speaker007:] OK.
[speaker002:] Right.
[speaker007:] Uh, yeah.
[speaker002:] Thanks.
[speaker003:] Sure. Uh, and I already [disfmarker] I already said what [pause] I was doing, which is [pause] mostly trying to give advice to Dave when he [disfmarker] he [disfmarker] [vocalsound] he actually does the real [vocalsound] work on this, uh, reverberation thing. But I think it's [disfmarker] it's [disfmarker] it's a real, uh [disfmarker] [vocalsound] it's a real learning experience for both of us. And [disfmarker] and, uh, I think it's [disfmarker] it's a problem [pause] ar [comment] problem area that people really haven't dealt with that much, as we know. So, [vocalsound] uh, w h he kind of did [disfmarker] he started off with what was [vocalsound] in some sense sort of the first obvious thing to do, although [pause] hardly anybody had done it yet. And, uh, it [disfmarker] it does work very well under some conditions and other conditions it doesn't.
[speaker007:] Mm hmm.
[speaker003:] And now we're understanding [disfmarker] trying to understand what those are. It it's [disfmarker] it's [disfmarker] it's fun. Do you want to add some anything? [disfmarker] to say anything?
[speaker006:] She just got back.
[speaker003:] How was y Did you catch fish, or [disfmarker]?
[speaker001:] No.
[speaker003:] No. [vocalsound] No fish. OK.
[speaker001:] No.
[speaker003:] You know, when Bush catches fish they actually put a bunch of fish in the lake for him.
[speaker001:] Oh.
[speaker002:] Really s really hungry fish.
[speaker008:] It's [pause] part of the budget.
[speaker003:] I'm [disfmarker] I'm not kidding. Really. They just [disfmarker] they [disfmarker] they pre stocked it with [disfmarker] with a [disfmarker] a [disfmarker]
[speaker006:] The Secret Service is out there throwing fish into the ocean [disfmarker] into the lake.
[speaker003:] I'm really not kidding.
[speaker008:] How they [disfmarker] They got, like, scuba gear on and, like, hooking them.
[speaker007:] But they didn't tell her.
[speaker006:] "Hey, I caught one [disfmarker] this one [disfmarker] and it's already cooked!"
[speaker007:] It [disfmarker] you know, to keep [disfmarker] to keep us, uh [disfmarker]
[speaker002:] It's already dead.
[speaker003:] Yeah. [vocalsound] So we're [pause] ready to increase our federal funding.
[speaker006:] I think we're done. Should we do, uh, simultaneous digits so that we actually have time for tea?
[speaker003:] Why [disfmarker] why don't we?
[speaker007:] OK.
[speaker003:] Yeah, let's do that.
[speaker007:] Hmm.
[speaker003:] I still don't know if these are gonna be any good but it sure does get us out of here quicker. A one, and a two, and a three.
[speaker006:] Ready?
[speaker003:] And you were worried we wouldn't have any overlap today.
[speaker006:] Got plenty of overlap.
[speaker007:] So, did you [disfmarker] Jeremy, did you know that whoever finishes last has to buy [pause] cappuccino for everybody?
[speaker006:] And [disfmarker] And we '