A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms

0
votes
1answer
48 views

Introduction to linguistics from a practical application standpoint

I currently have a project that I need to do that involves quite a bit of computational linguistics. My background in linguistics is very high level - I wonder if there are any good introductory ...
0
votes
0answers
33 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file ...
0
votes
1answer
81 views

Are there any words that have changed usage/meaning multiple times (multiple semantic shifts) from 1850s to present time [closed]

I am interested in semantic shift undergone by words, and I am aware of classic examples like 'gay', which has shifted in meaning since the 1900s. However, are there any words that have actually ...
2
votes
1answer
65 views

Why are functional/logic programming languages like Prolog or Haskell popular with computational linguistics and AI?

This may be the wrong place to be asking this, but I'm not entirely sure what kind of advantage using a language like Prolog gives you over an Object-Oriented language like Python. Also, is there a ...
1
vote
1answer
44 views

Looking for a Morphology Database

This is my first StackExchange post, so please let me know if I need to add additional information. I am looking for a comprehensive database that has words broken down by their morphology. For ...
3
votes
1answer
273 views

What is the entropy per word of random yet grammatical text?

It has been suggested that to construct an uncrackable yet memorable passphrase with 256-bits of entropy, the passphrase should be manifested as a poem. The answerer made an estimation of the entropy ...
2
votes
0answers
54 views

Which dependency parsers take auxiliaries to to be heads over content verbs and prepositions to be heads over their complements?

The Universal Stanford Dependencies (USD) parsing scheme subordinates auxiliary verbs to content verbs and prepositions to their complements: ...
0
votes
0answers
30 views

Do stop words in any language significantly overlap content words in other languages?

I'm currently dealing with analyzing text with mixed languages. I could try to segment the articles by their language, and proceed with stop word removal and stemming, but I was wondering if the set ...
1
vote
2answers
143 views

Noise Removal -Text classification

I am doing a text classification task. My text is questions and answers in a community question answering website. I want to extract tags from the title , existing tags, and BODY of the questions and ...
-1
votes
1answer
35 views

“Rate” or “score” a word by various parameters

I’m working on a small project which involves a large list of words (single words, no sentence) and I would love to have a way to “rate” or “score” each word by some parameters. Right now I have two ...
-1
votes
2answers
151 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
2
votes
0answers
121 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
0
votes
0answers
62 views

Quality of multiple step translation

Say I have 2 dictionaries English<->Spanish Spanish<->French I want to translate from English to French. I wonder, how good will be quality of translation in this case? How much better is to ...
1
vote
0answers
59 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
0
votes
0answers
45 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
4
votes
2answers
108 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
1
vote
0answers
90 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...
4
votes
1answer
98 views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), ...
0
votes
2answers
96 views

Describing recursive structures with regular expresions as grammars

I found in a book about regular expression grammars something that said RE's can be used to describe sentences like this ‘the brown tea pot’ by using re like this np = ...
6
votes
3answers
379 views

Are there natural languages that do not obey Zipf's law?

Is there a natural language which is known not to follow Zipf's law? I'm interested to see if it's really universal. This is what Zipf's law states: Zipf's law states that given some corpus of ...
3
votes
2answers
126 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any ...
2
votes
0answers
80 views

Tool for building a corpus by crawling the web?

Often I want to make my own corpus of a new language I've become interested in. I'm very happy to make my own tools and have plenty of programming experience. I have made my own tool to gather plain ...
1
vote
1answer
95 views

Is perplexity in SRILM normalized for sentence length?

If I generate a language model with SRILM's ngram-count and then use ngram -unk -ppl text -lm model to get log probabilities and perplexity values, are the perplexities normalized for sentence length? ...
4
votes
6answers
195 views

Does the P versus NP conjecture in computer science have any direct relevance to linguistics?

“The P versus NP problem is a major unsolved problem in computer science. Informally, it asks whether every problem whose solution can be quickly verified by a computer can also be quickly solved by a ...
0
votes
0answers
65 views

Writer/math student seeking an overview of linguistics. Help?

I am a math and statistics student/enthusiast as well as a fiction writer with cultivated interest in a few foreign languages. Linguistics has held appeal to me for many years, but I admit to having ...
0
votes
0answers
43 views

Determining interests from Twitter text

I am not sure if this is the right place to post or if I should be posting CompSci so please feel free to redirect me to the most appropriate StackExchange. I would like to determine interests or ...
1
vote
2answers
164 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
1
vote
3answers
418 views

How would I parse the sentence, “I am not the alien here.”?

I am trying to construct a first-order logic representation of the following sentence. My general approach for constructing the representation is to parse the sentence into a phrase structure tree ...
4
votes
1answer
158 views

Identify author by a text's grammatical/syntactic structure

I'm interested in whether it is possible to classify texts by authorship using just syntactic/grammatical information. Let's take ten people and have them write three texts. About their favorite ...
2
votes
1answer
286 views

Are there any good open source English text to IPA/other phonetics alphabet transcription programs?

I'm writing a computer program which requires some of this functionality at one point, so I wanted to get into a (better-written) code and have a look, to get some inspiration. Are there any good ones ...
2
votes
2answers
214 views

The Liar's Paradox : a linguistic perspective

The sentence "This sentence is false." is a paradox (called the "liar's paradox) as even though being well formed it is a contradiction. While logicians can call this a case of un-decidability what ...
2
votes
1answer
109 views

Dictionaries for machine translation

I am doing research on machine translation in prolog and I am wondering if there are any suitable dictionaries available in text/xml format for machine translation. With suitable for machine ...
5
votes
2answers
208 views

What determines how natural a word sounds in a language?

What features of a word make a word sound natural in a language. For instance in two made up words 'mobify' sounds more natural in English than 'jlkrtz'.
-1
votes
1answer
105 views

What factors should I consider when setting a Linguistic Corpus price?

What are the factors that must be considered when setting a linguistic corpus price? Is there any standard model or something else I should follow?
3
votes
0answers
55 views

Are there standard test data sets for English stemmers / lemmatisers?

There is a lot of easily located material online which describes stemmers or provides implementations. There's a bit of discussion of metrics for quantifying how effective they are, and I've even ...
3
votes
2answers
88 views

What is the definition of “oracle information”?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
0
votes
1answer
259 views

Computationally differentiating between CVC, VCV and CV syllables

I want to develop a program which can differentiate between CVC, VCV, and CV syllable types. I'm having trouble knowing when vowel has ended in CVC and CV syllables. I want to read more about it. ...
3
votes
2answers
121 views

sentiment analytics

I've recently been tasked with programming a web crawler that searches through news articles for certain keywords--company names, for example--and then tries to determine if the article has a positive ...
1
vote
0answers
145 views

Fundamental features for program that helps you build a translator?

I'm an absolute rookie with this stuff, but I'm building a translation program, which will hopefully enable people to create their own translators to share with the world. I'm particularly excited for ...
0
votes
0answers
47 views

What is the role of syntax in semantic role labling?

For semantic role labeling process, is it enough to just using some corpora like FrameNet and PropBank, or we must have some syntactic annotated corpora using dependency grammar?
0
votes
0answers
29 views

Articles Books on Automated Writing Evaluation Techniques

I have long been out of the NLP game, but I am curious to get back in. I wanted to know about modern techniques for doing automated writing evaluation of English texts. I want to take essay-form ...
7
votes
1answer
152 views

Best method for building a learner corpus for DDL

I'm looking for a set of free and (somewhat) easy tools that I can use with my EFL writing students next semester. I want to analyze their initial essays and look for common errors that can be ...
2
votes
2answers
284 views

Checking grammar of non-English text (NLP)

I am writing a program that will take input from users in non-English languages (German, French, Spanish, Italian, and Portuguese) and will need to determine whether the input is grammatically ...
0
votes
1answer
125 views

How to convert IPA into CPA (Nuance)?

I'm working on speech project where the original authors chose to use the Computer Phonetic Alphabet (CPA), from Nuance, to store phonemes. The problem is that the dictionaries we want now to use ...
4
votes
1answer
155 views

Existing English word database with word forms?

Where can I find a database of English words that has the various forms for each word? Specifically, it would give the plural and singular form with its indefinite article for each noun, the various ...
2
votes
1answer
945 views

How to calculate the co-occurrence between two words in a window of text?

I want to build a keyword extractor based on the TextRank model as explained in RMPT04. But I don't understand how to calculate the co-occurrence between two words in a window of text explained in the ...
3
votes
1answer
143 views

Non-Projective Example

I'm looking for an example sentence with a non-projective dependency parse. It doesn't have to be in English, though such an example would be nice.
10
votes
3answers
329 views

Can parsing be classified to some complexity class (e.g. NP-complete)?

In computer science (especially computational complexity theory), problems can be classified to some complexity theory. For example, we say the travelling salesman problem belongs to NP-complete. ...
3
votes
1answer
112 views

Semantic frame representation of ATIS 3 corpora

Air Travel Information Service (ATIS) is a benchmark corpora/dataset in spoken language understanding field. Many papers make use of it to see how their algorithms perform. There are many tagging ...
3
votes
0answers
128 views

Calculating margin of error for precision and recall

I commonly calculate the precision and recall for information pulled from text but I'm not sure how to calculate the margin of error for those precision and recall values. So for example, if I have a ...