4

There are questions that are self consistent in the sense that they can be understood without a context. In other words, the sentence itself provide a clear information. An example of such a sentence would be:

The Georgetown experiment in 1954 involved fully automatic translation of more than sixty Russian sentences into English.

On the other hand, there are sentences that do not make much sense without a context. For example:

Generally, this task is much more difficult than supervised learning.

So, my question is: Is it easy (possible) to separate the questions of first type from the questions of the second type programmatically?

For example, I though that use of definite article the (as well as words like these, this, such) would be an indicator, that we have a sentence of the second type (since it use entities that have been defined earlier). However, I found examples where it does not work (the cases where the definition is in the same sentence). Is there any rule that would reliable classify any given sentence into one of the two earlier described categories?

8
  • I would start with detecting (1) pronouns; (2) adverbs and conjunctions like but, however, also, etc as they can join clauses or sentences. Then, filter out the sentences that have several logical clauses.
    – bytebuster
    Jul 27 '16 at 10:39
  • @bytebuster, why would you filter out the sentences with several logical clauses? As far as I understand, number of logical clauses does not discriminates between "self-consistent" and "not self-consistent" sentences.
    – Roman
    Jul 27 '16 at 13:09
  • 1
    Yes, correct. But keep in mind that striving to perfection quickly ends up with the full, sophisticated syntax decomposition. I understood that you need quick and rough solution. If that is not the case, and an accurate solution is needed instead, you may need to search for existing solutions before developing your own one.
    – bytebuster
    Jul 27 '16 at 14:37
  • 1
    @StoneyB, I assume that general terms (like "gods", "red", "country") do not require to be defined. They are defined (enough). Moreover, I apply the same assumption to named entities (like "Germany", "New Your" or "Georgetown experiment"). I assume that "Georgetown experiment" is something that can be uniquely identified by its name. In contrast, definitions of phrases like "these dogs" or "system of that kind" come from previous sentences.
    – Roman
    Jul 28 '16 at 11:56
  • 1
    @StoneyB, I do agree that "self-consistency" and "definiteness" are relative concepts and there is a "gray zone". However, from a practical point of view, it is almost always easy for a human to decide if a given sentences is informative without context or not. For example: "They were happy" and "Germany is located in Europa" are clearly belong to different classes.
    – Roman
    Jul 29 '16 at 7:40
1
+50

I think that the problem mostly narrows down to the reference of NPs, since verbs, adjectives, adverbs and all kinds of function words, but also indefinite or quantified NPs like a car or all humans should be unproblematic1.

I can't give a complete algorithm, but some indicators (some of them already mentioned) would be:

  1. Demonstrative pronouns and determiners like this, that, such etc., both in pronominal (This is a serious issue) and in a determiner (this task) use are certain candidates for context dependence.
    With a decent parser, you will be able to dereference (find the antecedent of) such items, but taking sentences in isolation, unless the reference relation is between several clauses of one sentences, such pronouns or determiners are highly context-dependent.
  2. The same applies for personal and possessive pronouns (he, his, it2 we, their, ...) - unless referring to an entity in the same sentence, they will not be understandable without context.
    Depending on whether the reader knows the text's spaker and addressee, first and second person pronouns (I, you, we etc.) might be less problematic.
  3. Proper individual names like Mary or Ms. Smith, but also *insert some pseudonym* usually don't have context-independent references either.
    You need to decide on your own whether Mary Smith can be understood without context or not; you probably would want to make exceptions for persons that are assumed to be known to everyone, like Mr. Obama or Mozart; for this kind of world knowledge, you'd need more advanced tools (first thought: look-up in an encyclopedia?) to find out to what degree the meaning of such names are assumed to be part of a regular speaker's knowledge or not.
    Proper names of places (China, Los Angeles, Hudson River) or major events (World War II) can probably be assumed to behave similarly to known persons, i.e. rather context-independent - again, dependent on how much world knowledge you 1) assume in the speaker and 2) are able to feed your system.
  4. You should consider making exceptions for NPs involving genitive or adjective attributes, or in combination with a PP, gerund VP or relative clause3: the murderer is context-dependent, but the murderer of Caesar is not (PP), the requirements vs. the requirements for EU membership (PP), the fountain vs. the fountain in front of the Eiffel tower (PP), the engineers vs. the engineers designing NASA's Mars robot (gerund VP), the mother vs. Albert Einstein's mother (genitive attribute), the president vs. the French president (adjective attribute), the woman vs. the woman who discovered radium (relative clause), ...
    You might need to elaborate more on this, e.g. it is also important that the references within the NP are clear (of Ceasar vs. of him), but in general I would say that adjuctions usually help disambiguating the referene of a definite NP.

You would need to test these heuristics out, might be that the restrictions are either to hard or too strong, but it would be a a first approach.
Your success will also depend on what other features your algorithm can make use of (pronoun resolution, world knowledge), what the reader might know about the text in advance (e.g. who wrote that text and thus who could be meant by context-dependent pronouns like we), what the reader might know in general (esp. the reference of names like well-known persons, geographic names or historical events) and of course what exactly you consider to be context-dependent or independent - this will always be a rather vague notion.

1 I admit that this is not always as simple, e.g. a participant is not clear without context (a participant in what?) despite it being indefinite, or all cookies (all cookies in the world or all cookies in the box on the table?) despite it being univerally quantified.
2 Note the difference between the semantically empty (and thus unproblematic) it in constructions like It isn't clear whether... vs. pronominal use (It has brown fur).
3 I think, however, that relative clauses work only to a very restricted extend; my example with The woman who discovered radium seems to work fine, but The woman who signed or The woman who washed clothes not so much. It seems to me that predicates without an object (no matter if the verb is by default intransitive, transitive or ditransitive; more objects always give more information) are always more context-dependent than ones with an object (The woman who signed vs. The woman who signed the contract between...), but even with that, it might not be clear who the referent is, as long as it is not a singleton set (there is only one woman who discovered radium, but many more who at some point washed clothes). Similarly, the president of the US is clear (there is only one), but the minister of the US is not (there is more than one minister and you need context to determine which one is meant), so even among very similar constructions, the degree of context-dependence might differ substantially.

1

Neither of your example sentences are entirely context-free. An AI might comment for each: 1) "I don't recall the experiment." 2) "I don't recall the task." Once you write a program that can identify which phrases have antecedents, and test whether those antecedents are in the same sentence, then it would be relatively simple to extend the program to handle multiple sentences (the 'context'), thus making the goal of the program obsolete -- you would have a context-sensitive program, so testing for context-free sentences wouldn't be necessary.

2
  • The second sentence in my example is obviously "context dependent". The phrases "this task" obviously refers to something that has been defined earlier and without this definition (without context) the sentence does not have much meaning. The first sentence was probably not best example since "Georgetown experiment" is not very well known "entity". So, the sentence is in a gray zone. But let's take a look at sentences like: "Germany is located in Europe", or "Albert Einstein was born in Germany". These two sentences are obviously context free. They provide a clear statement without a context.
    – Roman
    Aug 2 '16 at 7:58
  • Yes, "the Georgetown experiment", while unique, may not have been. "The" tells us that we must check our memory (contextual info) to find the most recently mentioned "Georgetown experiment". (If we recall none, then we will create a mention of one.) Even proper nouns may not be context free; (they carry an implicit "the";) for example, city names are often replicated in different states, so location context is needed to disambiguate when the state is not mentioned. The same is true for first or last name only references to people.
    – amI
    Aug 8 '16 at 20:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.