In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

The 6-class tagset I am referring to is mentioned in (1), which indicates there exist a widely applied classmap that maps the dialog acts onto 6 distinct classes: statements (S), questions (Q), backchannels (B), fillers (F) and disruptions (D), and (Z) unlabeled.

(2) gives the interlabeler agreement, but for all classes used in the original annotations. The provided data set seems to come with the consensus annotations, i.e. it doesn't comes with the annotations of each labeler, so I couldn't find a way to compute the interlabeler agreement myself.


  • I haven't found any solution so far. Mar 28, 2016 at 18:23
  • So I am still interested if someone has any idea. Mar 28, 2016 at 18:23


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.