We changed our privacy policy. Read more.

Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
3
votes
1answer
65 views

Combinatory categorial grammar for English

I am working on theoretical NLP things, in particular to do with combinatory categorial grammar (CCG). I don't have much knowledge of CCG, or of grammar in general. I was wondering how much of English ...
3
votes
1answer
892 views

Lexeme vs. Lemma

A lexeme to me has always been a fairly abstract entity and a lemma a concrete form that is often used to represent an lexeme. It is surprising to me, then, that the process in NLP is almost always ...
3
votes
2answers
93 views

Computational applications of construction grammars

Are there NLP applications (either natural language understanding or generation) which make use of the Construction Grammar framework? On a related note, does there exist a logically organized list ...
3
votes
1answer
58 views

Is there a computer-readable Hiberno-English pronunciation dictionary?

For American English, there's the CMUDict, but is there one for Irish pronunciation? If there isn't, is there a way to translate American to Irish pronunciation?
3
votes
2answers
575 views

Lexical Distance, is there a table?

I was looking (for a statistics project) to the Lexical Distance between languages and I came across this post Worldwide map or data for linguistic distance? I was wondering if there is any "...
3
votes
1answer
365 views

Is there a programmatically accessible/structured (JSON, XML, etc) dictionary that includes IPA

Thus far I have the CMU Pronouncing Dictionary, which uses a custom set of phonemes represented in ASCII text. Just the words and pronunciations is nice, but it would be great to have actual IPA ...
3
votes
1answer
89 views

How is "complexity" calculated on thesaurus.com?

On thesaurus.com, you can filter synonyms by their "complexity." Does anyone know the criteria they use to determine a word's complexity?
3
votes
2answers
88 views

What are the most authoratative references on the notion of shallow parsing?

What are the most authoratative references on the notion of shallow parsing (also known as text chunking) in NLP? I am looking for definitions, examples, and discussion of strings of words that ...
3
votes
2answers
149 views

How to identify corresponding sentences in source and translation texts?

I'm interested in creating files where a source text and translation are interleaved with each other, so that each sentence (or small group of sentences) is immediately followed by its translation. ...
3
votes
3answers
2k views

What is the relationship between lambda calculus and logical form?

I was first introduced to lambda calculus as a way to use syntax to compose the semantic value of a phrase from the semantic values of the components of that phrase. Lambda calculus does more than ...
3
votes
2answers
150 views

Center of a set of words

Is there any available algorithm that can take a set of words and attempt to find a word that best represents the "center of mass" of all those words? This would be easy if we can define a distance ...
3
votes
2answers
380 views

Probabilities for 2-grams are higher than 1-grams in arpa file produced by kenlm

I'm using the 1 billion word language corpus to build a model with 1 and 2-grams. When using the lmplz program that comes with kenlm, I noticed that the arpa file seems to have higher probabilities ...
3
votes
2answers
497 views

Which dependency parsers take auxiliaries to to be heads over content verbs and prepositions to be heads over their complements?

The Universal Stanford Dependencies (USD) parsing scheme subordinates auxiliary verbs to content verbs and prepositions to their complements: http://nlp.stanford.edu/~manning/papers/...
3
votes
3answers
2k views

How to determine whether a given sentence is demanding an answer or is providing some information?

I tried with basic thing like whether question starts with who/what/.. but there are a lot many sentences which do not start with interrogative words but still demands an answer like "hotels in ...
3
votes
2answers
422 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any position) ...
3
votes
1answer
208 views

Dictionaries for machine translation

I am doing research on machine translation in prolog and I am wondering if there are any suitable dictionaries available in text/xml format for machine translation. With suitable for machine ...
3
votes
1answer
173 views

Is there a measure of how easy a sentence is to parse as a Natural Language problem?

Reading the news report for the AP Twitter hoax: Breaking: Two Explosions in the White House and Barack Obama is injured. I'm thinking this is the most unambiguous and perfect stock market bomb. ...
3
votes
1answer
435 views

Useful Features of Semantic Graphs

If this question is too general, please let me know, and I will revise it. I am developing a program that measures all sorts of "features" of a sentence, everything from sentence length, to average ...
3
votes
1answer
125 views

How can we perform WSD using semantic relatedness measures?

I am focusing on knowledge based on Word-sense disambiguation (WSD). I have come across algorithms like Lesk, extended Lesk, etc., which perform WSD based on gloss definitions of senses of each word ...
3
votes
1answer
286 views

Dimensional reduction with synonomy and polysemy

I was wondering something for a computer science project I am doing. Documents usually have too many distinct words to process on a computer efficiently. One solution is to map all words to a single ...
3
votes
1answer
226 views

What markers can one use to automatically detect a prepositional phrase in an English sentence?

I'm currently working on a project for which I have a need to identify certain aspects of a sentence. What markers can I use to algorithmically detect a prepositional phrase in a sentence? Obviously, ...
3
votes
1answer
602 views

Entity level Sentiment Analysis

I've been working on document level sentiment analysis over the last year. Document level sentiment analysis provides the sentiment of the complete document. For example - The text "Nokia is good but ...
3
votes
1answer
58 views

What is the definition of a causally coherent text?

I am trying to measure the causal coherence of text documents using NLP techniques to test a hypothesis (as far as I understand, there are different types of coherence in text but I am focusing on ...
3
votes
1answer
703 views

How to interpret the dependency parse tree of an English Slot Grammar?

I am reading the paper titled Deep parsing in Watson (DOI: 10.1147/JRD.2012.2185409) and need help understanding this figure: This is the paragraph that describes the tree in the figure above: An ...
3
votes
2answers
205 views

context-free grammar

How we could create a context-free grammar that generates sentences of arbitrary length like: the cat died. the cat the dog chased died. the cat the dog the rat bit chased died. the cat the dog the ...
3
votes
1answer
143 views

Benchmark data sets for negation detection systems

I am looking for data sets that I could use to train and benchmark negation detection systems.
3
votes
1answer
377 views

Different discounting methods with SRILM toolikt

I want to do some smoothing on a corpus and compare the results. for train language model without smoothing I used "-addsmooth 0" option now I should add two different smoothing and compare them, I ...
3
votes
1answer
693 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
3
votes
2answers
136 views

What is the definition of "oracle information"?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
3
votes
1answer
175 views

Textual Commitment

I am working on question answering problem. The major task is to understand text and convert complex sentences to simpler sentences i.e Textual Commitments using Conventional implicature and ...
3
votes
0answers
35 views

Computer analysis of ESL learners' mistakes

This is a very broad question; I'm trying to get a sense of the current state of this subfield of NLP and what relevant resources may already exist, so even tangential answers will be welcome. To what ...
3
votes
0answers
47 views

How to incorporate sentence end marker in POS tagging with viterbi algorithm?

I am self-reading the NLP book by Dan Jurafsky. In the book, the following equation is given for incorporating the sentence end marker in the Viterbi algorithm for POS tagging. I am confused why the ...
3
votes
0answers
88 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
3
votes
0answers
57 views

State of the art in controlled english languages?

https://en.wikipedia.org/wiki/Controlled_natural_language lists some controlled languages, of which Attempto Controlled English seems to be the most recent. However, are there any Attempto extensions, ...
3
votes
0answers
70 views

Computational linguist's estimate of minimum hours of speech needed to train a neural net to recognize speech

From a computational linguist's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 hours ...
3
votes
0answers
76 views

Does StanfordNLP have a problem with adverbs?

I suspect not, and I'm being dumb, but ... Usain ran quickest. is parsed (https://corenlp.run) as NNP VBZ JJS. Why JJS (Adjective, superlative) and not RBS (Adverb, superlative)? Using extended ...
3
votes
0answers
33 views

What is the term for a specific type of collocation analysis

I am trying to write a text processing script in R. I am interested in finding a word (from a list of words I have selected) only if it is in the same sentence as another word. Eventually I would ...
3
votes
0answers
144 views

Are there any computational linguists who still use prolog?

My understanding is that in the 90's and early 2000's, expert systems and logical rules dominated the field of natural language processing/computational linguistics, but that for the last 10 years, ...
3
votes
0answers
76 views

What features are good for dependency parsing?

I am trying to implement a graph based dependency parser. Since I come from a computer engineering perspective, I have trouble finding the features. Assuming that we have a (head,dependent) relation ...
3
votes
1answer
180 views

How to proceed with this Maasai translation?

The problem statement is as follows: Question: Indicate which translation goes with each Maasai sentence. My current approach: The word {word1} appears a total of 8 times in the Maasai sentences ...
3
votes
0answers
86 views

Is there a phrasal verb corpus somewhere online?

I'm working on a project where I have syntactic frames in the form of something like "N.agent V PP.stimulus", where each PP consists of a P and a N. I have a set list of verbs, and a list of PPs for ...
3
votes
0answers
103 views

How to get morphological information from Stanford POS tagger?

I'm using the Stanford POS tagger to process German text and I'm interested in assessing the number (singular/plural) of the nouns in the sentence, so that I can classify them accordingly. This is ...
3
votes
0answers
106 views

n-gram language model smoothing [closed]

I use the corpora of webtext to train n-gram model in NLTK.And i use katz back-off smoothing to solve 0 count-problem.But one problem is:while the smoothing used in based-on characters language model,...
3
votes
0answers
161 views

Distribution of the set of meanings of a given word, in a corpus

I am looking to know about the distribution of word senses, of a particular word in a corpus. How often a word sense will occur out of all the occurrences of that word with any meaning. For example: ...
3
votes
0answers
25 views

Publication venues focusing on reproducing results

Is there any publication venue for natural language processing focusing on reproducing results from other papers?

1
3 4
5
6 7
13