A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms

0
votes
0answers
34 views

List of written English linguistic phenomena?

I am doing exploratory research in written-English syntactic constructs that show variability. Is there any list of known linguistic syntactic phenomena? For example, I am familiar with the dative ...
1
vote
1answer
62 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
2
votes
0answers
87 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
0
votes
0answers
55 views

Quality of multiple step translation

Say I have 2 dictionaries English<->Spanish Spanish<->French I want to translate from English to French. I wonder, how good will be quality of translation in this case? How much better is to ...
1
vote
0answers
42 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
0
votes
0answers
31 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
3
votes
2answers
92 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
1
vote
0answers
75 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...
4
votes
1answer
66 views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), ...
0
votes
2answers
84 views

Describing recursive structures with regular expresions as grammars

I found in a book about regular expression grammars something that said RE's can be used to describe sentences like this ‘the brown tea pot’ by using re like this np = ...
6
votes
3answers
296 views

Are there natural languages that do not obey Zipf's law?

Is there a natural language which is known not to follow Zipf's law? I'm interested to see if it's really universal. This is what Zipf's law states: Zipf's law states that given some corpus of ...
3
votes
2answers
104 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any ...
0
votes
0answers
57 views

Tool for building a corpus by crawling the web?

Often I want to make my own corpus of a new language I've become interested in. I'm very happy to make my own tools and have plenty of programming experience. I have made my own tool to gather plain ...
1
vote
1answer
51 views

Is perplexity in SRILM normalized for sentence length?

If I generate a language model with SRILM's ngram-count and then use ngram -unk -ppl text -lm model to get log probabilities and perplexity values, are the perplexities normalized for sentence length? ...
4
votes
6answers
181 views

Does the P versus NP conjecture in computer science have any direct relevance to linguistics?

“The P versus NP problem is a major unsolved problem in computer science. Informally, it asks whether every problem whose solution can be quickly verified by a computer can also be quickly solved by a ...
0
votes
0answers
55 views

Writer/math student seeking an overview of linguistics. Help?

I am a math and statistics student/enthusiast as well as a fiction writer with cultivated interest in a few foreign languages. Linguistics has held appeal to me for many years, but I admit to having ...
0
votes
0answers
39 views

Determining interests from Twitter text

I am not sure if this is the right place to post or if I should be posting CompSci so please feel free to redirect me to the most appropriate StackExchange. I would like to determine interests or ...
1
vote
2answers
141 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
1
vote
3answers
369 views

How would I parse the sentence, “I am not the alien here.”?

I am trying to construct a first-order logic representation of the following sentence. My general approach for constructing the representation is to parse the sentence into a phrase structure tree ...
2
votes
0answers
88 views

Identify author by a text's grammatical/syntactic structure

I'm interested in whether it is possible to classify texts by authorship using just syntactic/grammatical information. Let's take ten people and have them write three texts. About their favorite ...
2
votes
1answer
215 views

Are there any good open source English text to IPA/other phonetics alphabet transcription programs?

I'm writing a computer program which requires some of this functionality at one point, so I wanted to get into a (better-written) code and have a look, to get some inspiration. Are there any good ones ...
2
votes
2answers
195 views

The Liar's Paradox : a linguistic perspective

The sentence "This sentence is false." is a paradox (called the "liar's paradox) as even though being well formed it is a contradiction. While logicians can call this a case of un-decidability what ...
2
votes
1answer
91 views

Dictionaries for machine translation

I am doing research on machine translation in prolog and I am wondering if there are any suitable dictionaries available in text/xml format for machine translation. With suitable for machine ...
5
votes
2answers
188 views

What determines how natural a word sounds in a language?

What features of a word make a word sound natural in a language. For instance in two made up words 'mobify' sounds more natural in English than 'jlkrtz'.
-1
votes
1answer
102 views

What factors should I consider when setting a Linguistic Corpus price?

What are the factors that must be considered when setting a linguistic corpus price? Is there any standard model or something else I should follow?
3
votes
0answers
45 views

Are there standard test data sets for English stemmers / lemmatisers?

There is a lot of easily located material online which describes stemmers or provides implementations. There's a bit of discussion of metrics for quantifying how effective they are, and I've even ...
3
votes
2answers
86 views

What is the definition of “oracle information”?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
0
votes
1answer
231 views

Computationally differentiating between CVC, VCV and CV syllables

I want to develop a program which can differentiate between CVC, VCV, and CV syllable types. I'm having trouble knowing when vowel has ended in CVC and CV syllables. I want to read more about it. ...
3
votes
2answers
115 views

sentiment analytics

I've recently been tasked with programming a web crawler that searches through news articles for certain keywords--company names, for example--and then tries to determine if the article has a positive ...
1
vote
0answers
129 views

Fundamental features for program that helps you build a translator?

I'm an absolute rookie with this stuff, but I'm building a translation program, which will hopefully enable people to create their own translators to share with the world. I'm particularly excited for ...
0
votes
0answers
42 views

What is the role of syntax in semantic role labling?

For semantic role labeling process, is it enough to just using some corpora like FrameNet and PropBank, or we must have some syntactic annotated corpora using dependency grammar?
0
votes
0answers
27 views

Articles Books on Automated Writing Evaluation Techniques

I have long been out of the NLP game, but I am curious to get back in. I wanted to know about modern techniques for doing automated writing evaluation of English texts. I want to take essay-form ...
5
votes
1answer
121 views

Best method for building a learner corpus for DDL

I'm looking for a set of free and (somewhat) easy tools that I can use with my EFL writing students next semester. I want to analyze their initial essays and look for common errors that can be ...
2
votes
2answers
191 views

Checking grammar of non-English text (NLP)

I am writing a program that will take input from users in non-English languages (German, French, Spanish, Italian, and Portuguese) and will need to determine whether the input is grammatically ...
0
votes
1answer
105 views

How to convert IPA into CPA (Nuance)?

I'm working on speech project where the original authors chose to use the Computer Phonetic Alphabet (CPA), from Nuance, to store phonemes. The problem is that the dictionaries we want now to use ...
4
votes
1answer
149 views

Existing English word database with word forms?

Where can I find a database of English words that has the various forms for each word? Specifically, it would give the plural and singular form with its indefinite article for each noun, the various ...
2
votes
1answer
509 views

How to calculate the co-occurrence between two words in a window of text?

I want to build a keyword extractor based on the TextRank model as explained in RMPT04. But I don't understand how to calculate the co-occurrence between two words in a window of text explained in the ...
3
votes
1answer
121 views

Non-Projective Example

I'm looking for an example sentence with a non-projective dependency parse. It doesn't have to be in English, though such an example would be nice.
10
votes
3answers
296 views

Can parsing be classified to some complexity class (e.g. NP-complete)?

In computer science (especially computational complexity theory), problems can be classified to some complexity theory. For example, we say the travelling salesman problem belongs to NP-complete. ...
3
votes
1answer
91 views

Semantic frame representation of ATIS 3 corpora

Air Travel Information Service (ATIS) is a benchmark corpora/dataset in spoken language understanding field. Many papers make use of it to see how their algorithms perform. There are many tagging ...
3
votes
0answers
116 views

Calculating margin of error for precision and recall

I commonly calculate the precision and recall for information pulled from text but I'm not sure how to calculate the margin of error for those precision and recall values. So for example, if I have a ...
5
votes
1answer
311 views

What value does lexical density add to analysis?

I came across the concept of lexical density while reading "Embracing a New Creed: Lexical Patterning and the Encoding of Ideology"[1] by Oliver Mason and Rhiannon Platt and was wondering what ...
6
votes
1answer
973 views

Common English bigrams / trigrams - recognising that a jumble of letters contain only valid English words

I have a database of one million strings which I want to rank against one another so that I can tell which contain meaningful English words / sentences. These strings contain no spaces or ...
2
votes
2answers
172 views

Is there a computer program/script that can match a verb with its various conjugations?

For example, matching "protest" with "protested", "protesting", "protests", and also matching less regular conjugations, like "run", "ran", "running" and "grab", "grabbed", "grabbed". If there were ...
3
votes
5answers
416 views

Is there a way to prove one language is more efficient than another language for science?

English is widely regarded as the global language of science now. In China, we use simplified Chinese to write scientific textbooks, teach courses and do almost everything. Let's take the simplest ...
4
votes
3answers
359 views

Is there a branch of linguistics using Calculus as a mathematical tool?

Is there a branch of linguistics using Calculus as a mathematical tool? I mean, can we use differential or integrate in linguistic study?
8
votes
1answer
190 views

What is the Relationship Between Document Length and Unique Words

Sorry if my question is a little more mathematical in nature, but my question is: Suppose I took a document of some length whether it be news article, book, or something of that sort. What sort of ...
4
votes
2answers
119 views

Multilingual POS tagging set

As you know: Almost all languages have the lexical categories noun and verb, but beyond these there are significant variations in different languages. We want tag POS of some text of a lot of ...
0
votes
0answers
63 views

Which layers of the language is dealing with co-reference resolution and how to solve it computationaly?

Which layers of the language is dealing with co-reference resolution and what are the steps to solve this problem in NLP?
9
votes
1answer
246 views

The power of trigram language models (2nd order Markov models)

Many people in computational linguistics seem to mention the unexpected power of trigram (or 2nd order Markov) models for language modeling. For instance, it has been stated (verbally) to me on ...