A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms

2
votes
0answers
44 views

What are the foundational papers in computational phonology?

I'm working on a paper on the history of computational phonology. As I understand it, Chomsky & Halle's SPE acted as a catalyst for research in the field, namely by laying the foundations for ...
-1
votes
0answers
31 views

What are some good resources for teaching about different kinds of synthetic speech?

would like to organize a workshop where students develop different synthetic voices comparing different techniques. Are there any user friendly resources for developing or manipulating (rate, ...
2
votes
1answer
47 views

Combine dictionary lemmatization with stemmer

I'm doing lemmatization as part of a classifier right now. My question is, if it makes sense to first use a dictionary lookup, to find the lemmas (wordnet) and after that additionally, to apply a ...
-1
votes
1answer
90 views

Can the entropy per word be caculated precisely?And relation among information theory, semantics, and pragmatics

What we have gotten about the expected per word entropy of random yet grammatical text is just some upper bound of the the expected per word entropy, because we have not found the exact way to compute ...
5
votes
1answer
97 views

copyright issues when making a corpus from the web

I realize that this is probably technically off-topic as it relates to copyright legalities of corpus construction. However, it is a practically very important issue for corpus linguistics and so I ...
0
votes
0answers
9 views

Identifying styles of reasoning in text

I'm trying to programmatically identify in a text some elements of "style of reasoning". I'm more specifically thinking about syllogism, induction, abduction, deduction, etc. More generally i would ...
3
votes
0answers
45 views

Stanford NLP parsers and idioms that have common semantic meaning

I have parsed the following sentence in the Stanford CoreNLP demo page and the Stanford parser demo page. Although both result in a parse that can imply purpose semantics (hinging on the advcl and the ...
2
votes
0answers
29 views

Center of a set of words

Is there any available algorithm that can take a set of words and attempt to find a word that best represents the "center of mass" of all those words? This would be easy if we can define a distance ...
3
votes
3answers
139 views

Has anyone attempted to simulate the creation/development of a language?

I suspect this is a dream confined to sci-fi for at least a few decades, but, I'd like to know if anyone has ever tried to create a computer model for the creation of a language, or at least ...
1
vote
1answer
114 views

NLP conversion between parts of speech and pertainyms?

I would like to write a program that can automatically group e.g. 'happiness', 'happily', 'happy' into 'happy': What do I need to read to get a handle on this subject? What is it called? What is the ...
0
votes
0answers
29 views

Where to find a dataset of related/sister terms

I'm working on a Natural Language Processing project that requires me to automatically categorize various articles. I've tried creating categories based on wikipedia, freebase and dbpedia but often ...
4
votes
1answer
137 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
1
vote
2answers
122 views

Introduction to linguistics from a practical application standpoint

I currently have a project that I need to do that involves quite a bit of computational linguistics. My background in linguistics is very high level - I wonder if there are any good introductory ...
0
votes
0answers
37 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file ...
0
votes
1answer
104 views

Are there any words that have changed usage/meaning multiple times (multiple semantic shifts) from 1850s to present time [closed]

I am interested in semantic shift undergone by words, and I am aware of classic examples like 'gay', which has shifted in meaning since the 1900s. However, are there any words that have actually ...
2
votes
1answer
163 views

Why are functional/logic programming languages like Prolog or Haskell popular with computational linguistics and AI?

This may be the wrong place to be asking this, but I'm not entirely sure what kind of advantage using a language like Prolog gives you over an Object-Oriented language like Python. Also, is there a ...
1
vote
1answer
50 views

Looking for a Morphology Database

This is my first StackExchange post, so please let me know if I need to add additional information. I am looking for a comprehensive database that has words broken down by their morphology. For ...
4
votes
1answer
471 views

What is the entropy per word of random yet grammatical text?

It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem. The answerer made an estimation of the entropy ...
2
votes
0answers
71 views

Which dependency parsers take auxiliaries to to be heads over content verbs and prepositions to be heads over their complements?

The Universal Stanford Dependencies (USD) parsing scheme subordinates auxiliary verbs to content verbs and prepositions to their complements: ...
0
votes
0answers
33 views

Do stop words in any language significantly overlap content words in other languages?

I'm currently dealing with analyzing text with mixed languages. I could try to segment the articles by their language, and proceed with stop word removal and stemming, but I was wondering if the set ...
1
vote
2answers
171 views

Noise Removal -Text classification

I am doing a text classification task. My text is questions and answers in a community question answering website. I want to extract tags from the title , existing tags, and BODY of the questions and ...
-1
votes
1answer
35 views

“Rate” or “score” a word by various parameters

I’m working on a small project which involves a large list of words (single words, no sentence) and I would love to have a way to “rate” or “score” each word by some parameters. Right now I have two ...
-1
votes
2answers
159 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
2
votes
0answers
139 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
0
votes
0answers
63 views

Quality of multiple step translation

Say I have 2 dictionaries English<->Spanish Spanish<->French I want to translate from English to French. I wonder, how good will be quality of translation in this case? How much better is to ...
1
vote
0answers
85 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
0
votes
0answers
54 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
4
votes
2answers
114 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
1
vote
0answers
111 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...
4
votes
1answer
145 views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), ...
0
votes
2answers
97 views

Describing recursive structures with regular expresions as grammars

I found in a book about regular expression grammars something that said RE's can be used to describe sentences like this ‘the brown tea pot’ by using re like this np = ...
6
votes
3answers
504 views

Are there natural languages that do not obey Zipf's law?

Is there a natural language which is known not to follow Zipf's law? I'm interested to see if it's really universal. This is what Zipf's law states: Zipf's law states that given some corpus of ...
3
votes
2answers
168 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any ...
3
votes
0answers
118 views

Tool for building a corpus by crawling the web?

Often I want to make my own corpus of a new language I've become interested in. I'm very happy to make my own tools and have plenty of programming experience. I have made my own tool to gather plain ...
1
vote
1answer
150 views

Is perplexity in SRILM normalized for sentence length?

If I generate a language model with SRILM's ngram-count and then use ngram -unk -ppl text -lm model to get log probabilities and perplexity values, are the perplexities normalized for sentence length? ...
4
votes
6answers
212 views

Does the P versus NP conjecture in computer science have any direct relevance to linguistics?

“The P versus NP problem is a major unsolved problem in computer science. Informally, it asks whether every problem whose solution can be quickly verified by a computer can also be quickly solved by a ...
0
votes
0answers
69 views

Writer/math student seeking an overview of linguistics. Help?

I am a math and statistics student/enthusiast as well as a fiction writer with cultivated interest in a few foreign languages. Linguistics has held appeal to me for many years, but I admit to having ...
0
votes
0answers
43 views

Determining interests from Twitter text

I am not sure if this is the right place to post or if I should be posting CompSci so please feel free to redirect me to the most appropriate StackExchange. I would like to determine interests or ...
1
vote
2answers
177 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
1
vote
3answers
436 views

How would I parse the sentence, “I am not the alien here.”?

I am trying to construct a first-order logic representation of the following sentence. My general approach for constructing the representation is to parse the sentence into a phrase structure tree ...
4
votes
1answer
227 views

Identify author by a text's grammatical/syntactic structure

I'm interested in whether it is possible to classify texts by authorship using just syntactic/grammatical information. Let's take ten people and have them write three texts. About their favorite ...
2
votes
2answers
455 views

Are there any good open source English text to IPA/other phonetics alphabet transcription programs?

I'm writing a computer program which requires some of this functionality at one point, so I wanted to get into a (better-written) code and have a look, to get some inspiration. Are there any good ones ...
2
votes
2answers
228 views

The Liar's Paradox : a linguistic perspective

The sentence "This sentence is false." is a paradox (called the "liar's paradox) as even though being well formed it is a contradiction. While logicians can call this a case of un-decidability what ...
2
votes
1answer
123 views

Dictionaries for machine translation

I am doing research on machine translation in prolog and I am wondering if there are any suitable dictionaries available in text/xml format for machine translation. With suitable for machine ...
5
votes
2answers
218 views

What determines how natural a word sounds in a language?

What features of a word make a word sound natural in a language. For instance in two made up words 'mobify' sounds more natural in English than 'jlkrtz'.
-1
votes
1answer
109 views

What factors should I consider when setting a Linguistic Corpus price?

What are the factors that must be considered when setting a linguistic corpus price? Is there any standard model or something else I should follow?
3
votes
0answers
56 views

Are there standard test data sets for English stemmers / lemmatisers?

There is a lot of easily located material online which describes stemmers or provides implementations. There's a bit of discussion of metrics for quantifying how effective they are, and I've even ...
3
votes
2answers
93 views

What is the definition of “oracle information”?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
0
votes
1answer
324 views

Computationally differentiating between CVC, VCV and CV syllables

I want to develop a program which can differentiate between CVC, VCV, and CV syllable types. I'm having trouble knowing when vowel has ended in CVC and CV syllables. I want to read more about it. ...
3
votes
2answers
127 views

sentiment analytics

I've recently been tasked with programming a web crawler that searches through news articles for certain keywords--company names, for example--and then tries to determine if the article has a positive ...