4

From what I understand:

  • a projective dependency parsers can only output projective tree
  • Wikipedia says: "a large majority of sentences in most languages are projective, i.e. they do not contain discontinuities. Only about 15-25% of actual sentences contain a discontinuity"

Therefore, assuming that in English about 15-25% of actual sentences contain a discontinuity, the maximum accuracy (i.e. percentage of correct parse trees for entire sentences) that can achieve a projective dependency parser in English would be 75-85% (since it would fail for all non-projective sentences).

Is this reasoning correct?

1 Answer 1

1

The reasoning is correct, except that parsers' accuracy is never measured in the percentage of correct parse trees for entire sentences. Parsers are evaluated by Labeled Attachment Score (LAS), Unlabeled Attachment Score (UAS), or F1 score, all over individual arcs. See this answer for details.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.