A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms

2
votes
2answers
41 views

What are the most authoratative references on the notion of shallow parsing?

What are the most authoratative references on the notion of shallow parsing (also known as text chunking) in NLP? I am looking for definitions, examples, and discussion of strings of words that ...
1
vote
0answers
20 views

Term for words or phrases signifying change in numeric quantities?

Phrase like "take away", "more than" ,"times" imply certain mathematical change (subtract,add,divide etc.) in the quantity in current context. For eg. The number of girls "exceeds" the number of boys ...
1
vote
1answer
31 views

Question type corpus

I'm looking for a corpus that contains questions and question types. Like in this article, but they didn't attach any link to their corpus. http://polibits.gelbukh.com/2009_40/40_01.pdf
1
vote
1answer
68 views

How many gaps should a sentence have to be solvable but not too easy?

At the moment I am coding an automatic cloze generator on Text on the following way: Use a summarizer to find relevant sentences in a text based on frequency Use Pos Tagging on the remaining ...
0
votes
0answers
26 views

How to identify mentions in a text?

I am looking for rule-based methods or any other methods to identify all mentions in a text. I have found several libraries that give coreferences but no exact options for only mentions. What I want ...
4
votes
2answers
60 views

Extracting Rare Words From A Corpus

This question might be too general, or opinion-based, but I was looking for advice on how to extract rare words from a very large corpus. The rare words wouldn't necessarily be consistent from ...
2
votes
1answer
62 views

Word Co-occurrence and collocation difference?

This Wikipedia page says, "In contrast to collocation, co-occurrence assumes interdependency of the two terms". But I'm not really sure what that means by interdependency of the two terms. Can someone ...
2
votes
0answers
43 views

What is the difference between AUG and CCG?

What is the difference between Applicative Universal Grammar and Combinatory Categorial Grammar? They both use type inference rules to define their grammars. Is it simply that CCG uses combinatory ...
3
votes
0answers
42 views

Inside-outside algorithm (PCFG learning) and binarization

I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
3
votes
2answers
77 views

How to identify corresponding sentences in source and translation texts?

I'm interested in creating files where a source text and translation are interleaved with each other, so that each sentence (or small group of sentences) is immediately followed by its translation. ...
0
votes
0answers
21 views

Finding semantic similarity between abstracts of academic papers

I am completely new to this area so please bear with me. I am looking for an automated way to compare the abstracts of academic papers and compute a measure of semantic similarity. What I would like ...
0
votes
1answer
93 views

Conversational English corpus for download

I have a project which requires a corpus of conversational English in plain text (although I can perform some processing as needed). Since I am a student, I need to find a corpus that is free and ...
1
vote
3answers
216 views

What is the relationship between lambda calculus and logical form?

I was first introduced to lambda calculus as a way to use syntax to compose the semantic value of a phrase from the semantic values of the components of that phrase. Lambda calculus does more than ...
0
votes
2answers
135 views

How to represent a dative verb in first order logic?

I understand that the representation of an intransitive verb, V in lambda calculus would be lambda x. V(x), where x is the subject. How do I represent an intransitive verb followed by a ...
3
votes
1answer
77 views

Detection if input sentence represents an incomplete sentence?

I am curious if there is an automated way to detect if a given string, representing a sentence, is an 'incomplete' sentence. By this I mean that either the text is not grammatically correct, or is ...
1
vote
1answer
64 views

Evaluate idea to autobuild russian-english parallel corpus

I was looking for russian-english parallel corpus, but have found none publicly available to the moment. If you know one, or parallel text database, I would be very grateful for one. (I heard of ...
0
votes
2answers
94 views

Is it possible to build thesaurus automatically?

Is it possible to build thesaurus by simply analyzing lots of text, or it's obligatory should be handmade? Also a question: is there free-to-download&use English language thesaurus?
2
votes
2answers
88 views

Determine adjective order algorithmically

Does NLTK (or any other Python natural language module) have the ability to determine the order of multiple modifier adjectives? For example: metal round huge bowl (incorrect) huge round metal bowl ...
1
vote
0answers
44 views

Textbooks in Formal Semantics / Montague semantics

I'm looking for a cheap, thorough but reasonably accessible introduction to formal semantics. There appear to be lots of options on the market. I assume there are plenty of experts in formal semantics ...
2
votes
0answers
72 views

What are the foundational papers in computational phonology?

I'm working on a paper on the history of computational phonology. As I understand it, Chomsky & Halle's SPE acted as a catalyst for research in the field, namely by laying the foundations for ...
3
votes
1answer
159 views

Combine dictionary lemmatization with stemmer

I'm doing lemmatization as part of a classifier right now. My question is, if it makes sense to first use a dictionary lookup, to find the lemmas (wordnet) and after that additionally, to apply a ...
-1
votes
1answer
118 views

Can the entropy per word be caculated precisely?And relation among information theory, semantics, and pragmatics

What we have gotten about the expected per word entropy of random yet grammatical text is just some upper bound of the the expected per word entropy, because we have not found the exact way to compute ...
6
votes
1answer
158 views

copyright issues when making a corpus from the web

I realize that this is probably technically off-topic as it relates to copyright legalities of corpus construction. However, it is a practically very important issue for corpus linguistics and so I ...
0
votes
0answers
13 views

Identifying styles of reasoning in text

I'm trying to programmatically identify in a text some elements of "style of reasoning". I'm more specifically thinking about syllogism, induction, abduction, deduction, etc. More generally i would ...
3
votes
0answers
95 views

Stanford NLP parsers and idioms that have common semantic meaning

I have parsed the following sentence in the Stanford CoreNLP demo page and the Stanford parser demo page. Although both result in a parse that can imply purpose semantics (hinging on the advcl and the ...
2
votes
1answer
68 views

Center of a set of words

Is there any available algorithm that can take a set of words and attempt to find a word that best represents the "center of mass" of all those words? This would be easy if we can define a distance ...
4
votes
3answers
158 views

Has anyone attempted to simulate the creation/development of a language?

I suspect this is a dream confined to sci-fi for at least a few decades, but, I'd like to know if anyone has ever tried to create a computer model for the creation of a language, or at least ...
1
vote
1answer
215 views

NLP conversion between parts of speech and pertainyms?

I would like to write a program that can automatically group e.g. 'happiness', 'happily', 'happy' into 'happy': What do I need to read to get a handle on this subject? What is it called? What is the ...
0
votes
0answers
39 views

Where to find a dataset of related/sister terms

I'm working on a Natural Language Processing project that requires me to automatically categorize various articles. I've tried creating categories based on wikipedia, freebase and dbpedia but often ...
5
votes
1answer
207 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
1
vote
5answers
301 views

Introduction to linguistics from a practical application standpoint

I currently have a project that I need to do that involves quite a bit of computational linguistics. My background in linguistics is very high level - I wonder if there are any good introductory ...
0
votes
0answers
39 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file ...
0
votes
1answer
150 views

Are there any words that have changed usage/meaning multiple times (multiple semantic shifts) from 1850s to present time [closed]

I am interested in semantic shift undergone by words, and I am aware of classic examples like 'gay', which has shifted in meaning since the 1900s. However, are there any words that have actually ...
2
votes
1answer
541 views

Why are functional/logic programming languages like Prolog or Haskell popular with computational linguistics and AI?

This may be the wrong place to be asking this, but I'm not entirely sure what kind of advantage using a language like Prolog gives you over an Object-Oriented language like Python. Also, is there a ...
1
vote
1answer
78 views

Looking for a Morphology Database

This is my first StackExchange post, so please let me know if I need to add additional information. I am looking for a comprehensive database that has words broken down by their morphology. For ...
4
votes
1answer
577 views

What is the entropy per word of random yet grammatical text?

It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem. The answerer made an estimation of the entropy ...
3
votes
2answers
185 views

Which dependency parsers take auxiliaries to to be heads over content verbs and prepositions to be heads over their complements?

The Universal Stanford Dependencies (USD) parsing scheme subordinates auxiliary verbs to content verbs and prepositions to their complements: ...
1
vote
2answers
195 views

Noise Removal -Text classification

I am doing a text classification task. My text is questions and answers in a community question answering website. I want to extract tags from the title , existing tags, and BODY of the questions and ...
-1
votes
1answer
36 views

“Rate” or “score” a word by various parameters

I’m working on a small project which involves a large list of words (single words, no sentence) and I would love to have a way to “rate” or “score” each word by some parameters. Right now I have two ...
-1
votes
2answers
175 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
3
votes
0answers
165 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
0
votes
0answers
64 views

Quality of multiple step translation

Say I have 2 dictionaries English<->Spanish Spanish<->French I want to translate from English to French. I wonder, how good will be quality of translation in this case? How much better is to ...
2
votes
1answer
154 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
0
votes
0answers
67 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
4
votes
2answers
120 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
1
vote
0answers
138 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...
4
votes
1answer
309 views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), ...
0
votes
2answers
102 views

Describing recursive structures with regular expresions as grammars

I found in a book about regular expression grammars something that said RE's can be used to describe sentences like this ‘the brown tea pot’ by using re like this np = ...
7
votes
3answers
710 views

Are there natural languages that do not obey Zipf's law?

Is there a natural language which is known not to follow Zipf's law? I'm interested to see if it's really universal. This is what Zipf's law states: Zipf's law states that given some corpus of ...
3
votes
2answers
196 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any ...