Timeline for Annotation agreement for multiple category assignment
Current License: CC BY-SA 3.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jun 17, 2020 at 9:49 | history | edited | CommunityBot |
Commonmark migration
|
|
| Aug 25, 2013 at 15:11 | comment | added | robert | The combined IAA doesn't tell you whether individual IAAs are roughly similar for all features or whether there are one or two features for which IAA is very low and for the others excellent. In that sense a combined IAA is less informative than single IAAs. | |
| Aug 25, 2013 at 15:01 | comment | added | lingo101 | +1 thanks for answering this, What do you mean by 'lose information by computing combined IAA'? What information is lost? as IAA is just an evaluation metric. In my task all the annotation tags belong to the same broad category. I ideally like like to capture partial agreement and assign high weightage to specific categories reflecting their importance to be annotated correctly | |
| Aug 25, 2013 at 14:54 | history | answered | robert | CC BY-SA 3.0 |