In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

The 6-class tagset I am referring to is mentioned in (1), which indicates there exist a widely applied classmap that maps the dialog acts onto 6 distinct classes: statements (S), questions (Q), backchannels (B), fillers (F) and disruptions (D), and (Z) unlabeled.

(2) gives the interlabeler agreement, but for all classes used in the original annotations. The provided data set seems to come with the consensus annotations, i.e. it doesn't comes with the annotations of each labeler, so I couldn't find a way to compute the interlabeler agreement myself.



Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.