A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms

1
vote
1answer
15 views

Forced aligner in Spanish? (Similar to P2FA)

I am looking for a forced aligner in Spanish. Something similar to P2FA for American English. I want to force align simple sentences in Mexican Spanish for a project. Does anyone know one?
2
votes
2answers
58 views

Calculating writing system efficiency with respect to reading ambiguity?

I have been thinking of developing a software tool that would make it possible to calculate the efficiency of a particular writing system (attested rather than hypothetical) for a particular language ...
0
votes
1answer
33 views

Why does my P2FA skip every word?

I have a .wav file and a txt file that I am trying to use with the P2FA aligner. For some reason, it skips every word. I even tried running it with just two words: "the robotics". My text file is ...
1
vote
1answer
45 views

Measuring semantic complexity of a text

I do not have a linguistic background, but I am working on a research project that involves measuring the complexity of news. One of the metrics that I was interested in is the semantic complexity of ...
2
votes
2answers
53 views

What are the most authoratative references on the notion of shallow parsing?

What are the most authoratative references on the notion of shallow parsing (also known as text chunking) in NLP? I am looking for definitions, examples, and discussion of strings of words that ...
1
vote
0answers
23 views

Term for words or phrases signifying change in numeric quantities?

Phrase like "take away", "more than" ,"times" imply certain mathematical change (subtract,add,divide etc.) in the quantity in current context. For eg. The number of girls "exceeds" the number of boys ...
1
vote
1answer
35 views

Question type corpus

I'm looking for a corpus that contains questions and question types. Like in this article, but they didn't attach any link to their corpus. http://polibits.gelbukh.com/2009_40/40_01.pdf
1
vote
1answer
73 views

How many gaps should a sentence have to be solvable but not too easy?

At the moment I am coding an automatic cloze generator on Text on the following way: Use a summarizer to find relevant sentences in a text based on frequency Use Pos Tagging on the remaining ...
0
votes
0answers
28 views

How to identify mentions in a text?

I am looking for rule-based methods or any other methods to identify all mentions in a text. I have found several libraries that give coreferences but no exact options for only mentions. What I want ...
4
votes
2answers
72 views

Extracting Rare Words From A Corpus

This question might be too general, or opinion-based, but I was looking for advice on how to extract rare words from a very large corpus. The rare words wouldn't necessarily be consistent from ...
2
votes
1answer
78 views

Word Co-occurrence and collocation difference?

This Wikipedia page says, "In contrast to collocation, co-occurrence assumes interdependency of the two terms". But I'm not really sure what that means by interdependency of the two terms. Can someone ...
2
votes
0answers
43 views

What is the difference between AUG and CCG?

What is the difference between Applicative Universal Grammar and Combinatory Categorial Grammar? They both use type inference rules to define their grammars. Is it simply that CCG uses combinatory ...
3
votes
0answers
51 views

Inside-outside algorithm (PCFG learning) and binarization

I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
3
votes
2answers
89 views

How to identify corresponding sentences in source and translation texts?

I'm interested in creating files where a source text and translation are interleaved with each other, so that each sentence (or small group of sentences) is immediately followed by its translation. ...
0
votes
0answers
23 views

Finding semantic similarity between abstracts of academic papers

I am completely new to this area so please bear with me. I am looking for an automated way to compare the abstracts of academic papers and compute a measure of semantic similarity. What I would like ...
1
vote
2answers
119 views

Conversational English corpus for download

I have a project which requires a corpus of conversational English in plain text (although I can perform some processing as needed). Since I am a student, I need to find a corpus that is free and ...
1
vote
3answers
249 views

What is the relationship between lambda calculus and logical form?

I was first introduced to lambda calculus as a way to use syntax to compose the semantic value of a phrase from the semantic values of the components of that phrase. Lambda calculus does more than ...
0
votes
2answers
144 views

How to represent a dative verb in first order logic?

I understand that the representation of an intransitive verb, V in lambda calculus would be lambda x. V(x), where x is the subject. How do I represent an intransitive verb followed by a ...
3
votes
1answer
97 views

Detection if input sentence represents an incomplete sentence?

I am curious if there is an automated way to detect if a given string, representing a sentence, is an 'incomplete' sentence. By this I mean that either the text is not grammatically correct, or is ...
1
vote
1answer
71 views

Evaluate idea to autobuild russian-english parallel corpus

I was looking for russian-english parallel corpus, but have found none publicly available to the moment. If you know one, or parallel text database, I would be very grateful for one. (I heard of ...
0
votes
3answers
117 views

Is it possible to build thesaurus automatically?

Is it possible to build thesaurus by simply analyzing lots of text, or it's obligatory should be handmade? Also a question: is there free-to-download&use English language thesaurus?
2
votes
2answers
94 views

Determine adjective order algorithmically

Does NLTK (or any other Python natural language module) have the ability to determine the order of multiple modifier adjectives? For example: metal round huge bowl (incorrect) huge round metal bowl ...
1
vote
0answers
51 views

Textbooks in Formal Semantics / Montague semantics

I'm looking for a cheap, thorough but reasonably accessible introduction to formal semantics. There appear to be lots of options on the market. I assume there are plenty of experts in formal semantics ...
2
votes
0answers
73 views

What are the foundational papers in computational phonology?

I'm working on a paper on the history of computational phonology. As I understand it, Chomsky & Halle's SPE acted as a catalyst for research in the field, namely by laying the foundations for ...
3
votes
1answer
182 views

Combine dictionary lemmatization with stemmer

I'm doing lemmatization as part of a classifier right now. My question is, if it makes sense to first use a dictionary lookup, to find the lemmas (wordnet) and after that additionally, to apply a ...
-1
votes
1answer
123 views

Can the entropy per word be caculated precisely?And relation among information theory, semantics, and pragmatics

What we have gotten about the expected per word entropy of random yet grammatical text is just some upper bound of the the expected per word entropy, because we have not found the exact way to compute ...
6
votes
1answer
174 views

copyright issues when making a corpus from the web

I realize that this is probably technically off-topic as it relates to copyright legalities of corpus construction. However, it is a practically very important issue for corpus linguistics and so I ...
0
votes
0answers
14 views

Identifying styles of reasoning in text

I'm trying to programmatically identify in a text some elements of "style of reasoning". I'm more specifically thinking about syllogism, induction, abduction, deduction, etc. More generally i would ...
3
votes
0answers
103 views

Stanford NLP parsers and idioms that have common semantic meaning

I have parsed the following sentence in the Stanford CoreNLP demo page and the Stanford parser demo page. Although both result in a parse that can imply purpose semantics (hinging on the advcl and the ...
2
votes
1answer
72 views

Center of a set of words

Is there any available algorithm that can take a set of words and attempt to find a word that best represents the "center of mass" of all those words? This would be easy if we can define a distance ...
4
votes
3answers
159 views

Has anyone attempted to simulate the creation/development of a language?

I suspect this is a dream confined to sci-fi for at least a few decades, but, I'd like to know if anyone has ever tried to create a computer model for the creation of a language, or at least ...
1
vote
1answer
220 views

NLP conversion between parts of speech and pertainyms?

I would like to write a program that can automatically group e.g. 'happiness', 'happily', 'happy' into 'happy': What do I need to read to get a handle on this subject? What is it called? What is the ...
0
votes
0answers
41 views

Where to find a dataset of related/sister terms

I'm working on a Natural Language Processing project that requires me to automatically categorize various articles. I've tried creating categories based on wikipedia, freebase and dbpedia but often ...
5
votes
1answer
213 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
1
vote
5answers
303 views

Introduction to linguistics from a practical application standpoint

I currently have a project that I need to do that involves quite a bit of computational linguistics. My background in linguistics is very high level - I wonder if there are any good introductory ...
0
votes
0answers
39 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file ...
0
votes
1answer
161 views

Are there any words that have changed usage/meaning multiple times (multiple semantic shifts) from 1850s to present time [closed]

I am interested in semantic shift undergone by words, and I am aware of classic examples like 'gay', which has shifted in meaning since the 1900s. However, are there any words that have actually ...
2
votes
1answer
611 views

Why are functional/logic programming languages like Prolog or Haskell popular with computational linguistics and AI?

This may be the wrong place to be asking this, but I'm not entirely sure what kind of advantage using a language like Prolog gives you over an Object-Oriented language like Python. Also, is there a ...
1
vote
1answer
80 views

Looking for a Morphology Database

This is my first StackExchange post, so please let me know if I need to add additional information. I am looking for a comprehensive database that has words broken down by their morphology. For ...
4
votes
1answer
611 views

What is the entropy per word of random yet grammatical text?

It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem. The answerer made an estimation of the entropy ...
3
votes
2answers
194 views

Which dependency parsers take auxiliaries to to be heads over content verbs and prepositions to be heads over their complements?

The Universal Stanford Dependencies (USD) parsing scheme subordinates auxiliary verbs to content verbs and prepositions to their complements: ...
1
vote
2answers
211 views

Noise Removal -Text classification

I am doing a text classification task. My text is questions and answers in a community question answering website. I want to extract tags from the title , existing tags, and BODY of the questions and ...
-1
votes
1answer
38 views

“Rate” or “score” a word by various parameters

I’m working on a small project which involves a large list of words (single words, no sentence) and I would love to have a way to “rate” or “score” each word by some parameters. Right now I have two ...
-1
votes
2answers
186 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
3
votes
0answers
172 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
0
votes
0answers
65 views

Quality of multiple step translation

Say I have 2 dictionaries English<->Spanish Spanish<->French I want to translate from English to French. I wonder, how good will be quality of translation in this case? How much better is to ...
2
votes
1answer
188 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
0
votes
0answers
72 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
4
votes
2answers
120 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
1
vote
0answers
142 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...