Natural Language Processing: Computer programming techniques designed to aid in processing human language.

learn more… | top users | synonyms

-1
votes
0answers
11 views

simple english abbrevations database [on hold]

I am searching for a simple database which contains mappings for common English abbreviations for a NLP application. Nothing fancy or specific, just maybe 100-1000 cases. Searching the web does give ...
1
vote
0answers
15 views

VerbNet semantic roles and preposition groups - how to determine matches

Using verbnet to test whether a sentence matches a frame, how does one determine whether the semantic role specified in the verbnet frame is appearing in the sentence or not? e.g. on this verbnet ...
0
votes
0answers
3 views

Identifying styles of reasoning in text

I'm trying to programmatically identify in a text some elements of "style of reasoning". I'm more specifically thinking about syllogism, induction, abduction, deduction, etc. More generally i would ...
0
votes
1answer
35 views

What is state of the art in the field of NLP? [closed]

I am new to Natural Language Processing, I think NLP is a challenging field, the syntax and semantic ambiguities could cause a lot of problems. For example I think for these problems machine ...
1
vote
0answers
23 views

Any NLP performance timeline?

I am looking for any plots, etc. that show performance metrics on various NLP tasks as a function of year. E.g. [the following ...
0
votes
0answers
10 views

difference between the binary format of KenLM and SRILM

I wonder what is the difference between the binary format of KenLM and SRILM, when we convert the arpa models into their binary format.
0
votes
0answers
33 views

RegEx Cooking Book for NLP Tasks

I've seen all kinds of collections and libraries of RegEx'es - most are for DOM parsing and Internet related. What about linguistic tasks? For example I use ([^\W\dA-Z && (I|X|L|V|.)])\1{2} to ...
2
votes
1answer
52 views

What do WordNet::Similarity scores mean?

I am using WordNet Interface in NLTK, which facilitates computation of a number of similarity metrics: Path similarity Leacock-Chodorow Similarity Wu-Palmer Similarity Resnik Similarity ...
0
votes
0answers
43 views

NLP system with end-to-end ambiguity support?

I've noticed that most NLP systems I can easily investigate on the Internet don't handle ambiguity at all, or only handle within components of the pipeline and not between components. For instance it ...
1
vote
1answer
71 views

NLP conversion between parts of speech and pertainyms?

I would like to write a program that can automatically group e.g. 'happiness', 'happily', 'happy' into 'happy': What do I need to read to get a handle on this subject? What is it called? What is the ...
0
votes
0answers
22 views

adjective features - similar to beth Levin's verb classes?

Beth Levin published research on verb classes/alternations - is there similar for the adjective category of words? I can see references to countable/uncountable, gradable,absolute, of quantity/quality ...
0
votes
0answers
27 views

Where to find a dataset of related/sister terms

I'm working on a Natural Language Processing project that requires me to automatically categorize various articles. I've tried creating categories based on wikipedia, freebase and dbpedia but often ...
0
votes
1answer
87 views

Introduction to linguistics from a practical application standpoint

I currently have a project that I need to do that involves quite a bit of computational linguistics. My background in linguistics is very high level - I wonder if there are any good introductory ...
2
votes
1answer
35 views

Probabilities for 2-grams are higher than 1-grams in arpa file produced by kenlm

I'm using the 1 billion word language corpus to build a model with 1 and 2-grams. When using the lmplz program that comes with kenlm, I noticed that the arpa file seems to have higher probabilities ...
1
vote
2answers
159 views

Noise Removal -Text classification

I am doing a text classification task. My text is questions and answers in a community question answering website. I want to extract tags from the title , existing tags, and BODY of the questions and ...
1
vote
0answers
56 views

Punctuation and spaces in other common languages?

For example, in Chinese, a full stop is 。 (U+3002) and a space is   (U+3000). I need to break paragraphs into sentences and I want to make it compatible with as many languages as possible. What other ...
1
vote
1answer
61 views

recognizing if a message is question or not?

Although there are appreciable comments and an answer after this question (thank to Robert and Acattle), I am much seeking for a Knowledge branch, (e.g. an "NLP sub-task") than an individual research: ...
2
votes
1answer
73 views

Spelling Correction on Romanized Devanagari texts

Has anything been done in this regard? I am looking for research that has been conducted for spell checking of Romanized Devanagari text. I suppose well researched English spell checking algorithms ...
2
votes
2answers
104 views

How to determine whether a given sentence is demanding an answer or is providing some information?

I tried with basic thing like whether question starts with who/what/.. but there are a lot many sentences which do not start with interrogative words but still demands an answer like "hotels in ...
1
vote
1answer
34 views

Tokenizing first and last name as one token

Is is possible to tokenize a text in tokens such that first and last name are combined in one token? For example if my text is: text = "Barack Obama is the President" Then: text.split() ...
-1
votes
2answers
154 views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean ...
1
vote
1answer
66 views

Where to study probability and natural language processing from? [duplicate]

I am a programmer and I am interested in Natural Language Processing. I studied it a bit in college, but it was years ago and anyway it wasn't enough for a good knowledge of the field. I'm ...
2
votes
2answers
242 views

How to generate grammatically correct sentences?

I'd like to give something like this: # John # eat + past # apple and get back the grammatically correct sentence: John ate an apple. Which software can I use for such generation?
0
votes
0answers
51 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
1
vote
2answers
77 views

annotation tool to work with XML Schema

Is there an annotation tool which can create annotation tasks automatically using an XML schema? The desirable annotation markup may be specified with an XML schema file. I'd like to be able to ...
2
votes
1answer
304 views

Filling in incomplete sentences using NLP and Python

I am trying to leverage NLTK and Python to perform some sentence completion. The sentences I'm working with are incomplete and pretty much just read as garbage. An example sentence would be something ...
4
votes
1answer
117 views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), ...
2
votes
1answer
123 views

Help understanding “degree of overall vocabulary divergence”

There was an article published with a diagram showing Lexical Difference: http://elms.wordpress.com/2008/03/04/lexical-distance-among-languages-of-europe/. It cites a Russian source "K. Tyshchenko ...
1
vote
1answer
117 views

Is perplexity in SRILM normalized for sentence length?

If I generate a language model with SRILM's ngram-count and then use ngram -unk -ppl text -lm model to get log probabilities and perplexity values, are the perplexities normalized for sentence length? ...
0
votes
0answers
58 views

Is there a corpus of English adjective, adverb, etc metadata?

For example. In the sentence fragment "red leather stool", red is a color, leather is a covering of the stool, and stool is a chair. Is there any database, corpus or repository, that lists the ...
3
votes
0answers
78 views

Where can I find Japanese-English (manually) word-aligned corpora?

I'm looking for as many very reliable Japanese-English corpora as possible so I'd like to ask: Are there any other manually aligned corpora besides KFFT's and Utiyama's? What are the most accurate ...
2
votes
1answer
165 views

List of words in Hebrew

Where can I found a list of all the words in Hebrew including plurals, inflections, etc.? I have only found some lists that are based on wikipedia corpus or subtitles curpus, which include many errors ...
0
votes
0answers
43 views

Determining interests from Twitter text

I am not sure if this is the right place to post or if I should be posting CompSci so please feel free to redirect me to the most appropriate StackExchange. I would like to determine interests or ...
2
votes
0answers
41 views

Semi-automatic annotation tool like '@nnotate'

Is there an annotation tool for linguistic structure that compares to @nnotate? One of the major features of annotate is the annotation is semi-automatic, i.e., it uses a language model to make ...
4
votes
2answers
309 views

Expressing Context Free Grammar from academic article with Python's NLTK

Please forgive the potentially noob question, but I'm trying to get started with semantic text analysis, particularly in the legal space. I found a very good paper which describes a context free ...
0
votes
0answers
296 views

Extracting subjective phrases from sentences

I have a set of sentences from which I want to extract all the subjective phrases. For eg., from I am pleased to learn that the president has been reelected., I want to extract am pleased. What is ...
1
vote
2answers
171 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
1
vote
0answers
49 views

Algorithm for determining the subject of a NL sentence / question [duplicate]

I'm trying to write code that takes in a natural language sentence and determines what that sentence is about. Not from a list of possible subjects, but just from the input text, the NL sentence. ...
1
vote
3answers
427 views

How would I parse the sentence, “I am not the alien here.”?

I am trying to construct a first-order logic representation of the following sentence. My general approach for constructing the representation is to parse the sentence into a phrase structure tree ...
10
votes
2answers
616 views

Is there a favoured data structure for storing ambiguous parse trees in Natural Language Processing?

I know a bit about parsing computer languages. Generally they try to resolve all ambiguities when parsing or abort the parse and throw an error. This means you either got nothing because there was an ...
2
votes
1answer
344 views

Word Sense Disambiguation for common groups of words

Let's say the dictionary has two definitions for live: Live: I live by the sea. Live: The match was shown live on the sports channel. and also contains the following definition: ...
1
vote
1answer
132 views

Algorithm for converting an English sentence or phrase into a function call [closed]

Let's say I have a command line app that has the following functions: function createABox() { console.log("hey"); }; function deleteABox() { console.log("wutsup"); }; The command line app can take ...
1
vote
0answers
37 views

Automatic evaluation of written English - e.g. item descriptions

I'm looking for S/W that evaluates the quality of short English texts, e.g. in terms of grammar, syntax, maybe style or ethnicity. My interest is, for example, in descriptions of items offered for ...
-1
votes
1answer
106 views

What factors should I consider when setting a Linguistic Corpus price?

What are the factors that must be considered when setting a linguistic corpus price? Is there any standard model or something else I should follow?
3
votes
2answers
88 views

What is the definition of “oracle information”?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
4
votes
3answers
211 views

Which language has verb/noun compounding features?

Often languages have compounding phrases with the same Part Of Speech (POS) and it becomes a morphological analysis problem in Natural Language Processing (NLP). The most notorious being infinite ...
3
votes
2answers
123 views

sentiment analytics

I've recently been tasked with programming a web crawler that searches through news articles for certain keywords--company names, for example--and then tries to determine if the article has a positive ...
0
votes
0answers
50 views

What is the role of syntax in semantic role labling?

For semantic role labeling process, is it enough to just using some corpora like FrameNet and PropBank, or we must have some syntactic annotated corpora using dependency grammar?
2
votes
2answers
313 views

Checking grammar of non-English text (NLP)

I am writing a program that will take input from users in non-English languages (German, French, Spanish, Italian, and Portuguese) and will need to determine whether the input is grammatically ...
10
votes
3answers
344 views

Can parsing be classified to some complexity class (e.g. NP-complete)?

In computer science (especially computational complexity theory), problems can be classified to some complexity theory. For example, we say the travelling salesman problem belongs to NP-complete. ...