A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms (1)

3
votes
2answers
304 views

Can we conclude that morpheme is ALWAYS greater than syllable?

A morpheme is the most smallest meaningful unit of language. A syllable is the smallest piece of pronunciation that has a vowel in it. Definitions are taken from this link. I don't know why, but can ...
-1
votes
0answers
22 views

What are some good books/MOOCs in field of computational semantic analysis?

I have recently started learning Natural Language Processing and while reading research papers I came across terms like "Latent Dirichlet Allocation", "Latent Semantic Analysis", "Gaussian ...
1
vote
1answer
34 views

Semantic predicate-argument relations reflected in syntax

I am a computational linguist and work on event extraction. One of the subtasks is very similar to finding predicate-argument relations, e.g. the agent and patient of a predicate. I want to build a ...
2
votes
0answers
19 views

How do I distinguish between traits and states using NLP?

In an English sentence: Harry was displeased. – displeased is a state Harry was benevolent. – benevolent is a trait Given an adjective, how can I distinguish between a trait and a state? ...
2
votes
1answer
52 views

Is there any comprehensive list of all the possible syntactic combinations of English sentences?

In constituent analysis, we break down sentences into their main parts of speech (Det., N, Adj, V, etc.). English sentences have recursive syntactic patterns. For example, a simple sentence in English ...
1
vote
0answers
24 views

collection of derivative nouns

I am a researcher in Computational Linguistics. Recently, my research interests led me towards the analysis derivative nouns, specifically nouns derived from other nouns. For example, India to Indian, ...
0
votes
0answers
38 views

how the word “car” is related with the word “driver”

how the word "car" is related with the word "driver?" I was looking through the list of relationship terms like hyponym, hypernym, part-of, consist-of. But this is a relationship that one is operating ...
0
votes
0answers
30 views

word relatedness, defining character of a word

How can NLP tell the word "stool" is closely related to the word "dirty?" When the word relationship is based on a corpus, most likely the word "stool" is related to some medical terms such as "bloody"...
1
vote
0answers
15 views

Matching Textgrid transcript to sound in Praat

I'm measuring the vowels in a whole boatload of recordings of the same item (e.g. 100 recordings of different people saying "my dog") in Praat. I am not very experienced in Praat, but figured out how ...
1
vote
0answers
32 views

The usage frequency of individual English words

I'm very new to NLP and I'm sure this question is a rookie one. In NLP for English language, how do we tell if a word is commonly used, from one that is not commonly used? What is the simplest measure?...
0
votes
0answers
15 views

Calculate score from dependency parse tree [closed]

Is there any way to get confidence score or any score from dependency parse tree of a sentence using ntlk or something? Any advices and suggestions will be greatly appreciated!
1
vote
0answers
22 views

Open corpora for modern English

I need a corpus of modern English, with part-of-speech tags, in order to train language models, specifically a part-of-speech tagger. The domain I am doing this in is the Hansard, the transcript of ...
0
votes
0answers
16 views

Why does Caching language model perform poorly in speech recognition?

I was recently reading about Cache Language Model. In this wiki article, it's written Cache Language Model performs better in Speech recognition than traditional N-gram method. But in a Stanford NLP ...
2
votes
0answers
20 views

Publication venues focusing on reproducing results

Is there any publication venue for natural language processing focusing on reproducing results from other papers?
0
votes
0answers
30 views

Calculating a matrix of term co-occurrences, including with themselves, within a window

Here I am building on this question, adding the possibility that a term has been inserted within the window of another term of the same type. Here, I have inserted an A as the third character, from ...
2
votes
0answers
14 views

NER model training question

I have a question on NER? Suppose I have set of documents and do manual tagging for all the names in that document. Now based on those tagged words I train my model (using CRF), i.e. add the tagged ...
3
votes
0answers
39 views

Automatic Summarization Evaluation - BLEU vs. ROUGE

With the results of two different summary systems (sys1 and sys2) and the same reference summaries, I evaluated them with both BLEU and ROUGE. The problem is: All ROUGE scores of sys1 was higher than ...
2
votes
0answers
22 views

Estimating the size of training data for grammer extraction

I have a dependency treebank including 100 sentences, which I divide into a training set and a test set. I extract some rules ((DS,PS) pairs) to convert the treebank to phrase structures. When I ...
3
votes
1answer
113 views

Giving grammar without useless symbols / ε-productions

I hope some people here are firm with computational linguistics, since I couldn't find any question here about this topic yet. Question 1 As the title says, I'm trying to give an equivalent ...
1
vote
1answer
58 views

Who is corpus annotator

I'm a beginner of nlp. I'm wondering who is annotator of corpus usually ? Who does actually do works of annotating ? Researchers?
1
vote
2answers
34 views

Spoken Language Dataset of L2 Acquisition

Is there a publicly available dataset of spoken language for L2 acquisition? I would prefer children learning an L2, but any age range is fine. It would be great, but not necessary, to have speaking ...
1
vote
1answer
40 views

List of Spaced Named Entities for English

I am writing a tokenizer for a small NLP project. After the first attempt (basically splitting at white spaces) didn't lead to good results at all, I am now starting from scratch. I would like to be ...
3
votes
0answers
35 views

Are there any publicly available spell checking corpora?

I need some corpora that contain sentences with misspelled word(s) in order to evaluate the performance of my own spell checking approach. So, the corpora should define the right word alongside the ...
0
votes
3answers
60 views

How to learn computer syllabification of IPA?

As in title. Lets say we have uhm anything (hollywood): /hɑˈliwʊˌd/ now how to make algorithm that will find all syllables in this IPA transcription: /hɑˈliwʊˌd/ => /hɑ.li.wʊd/ We can do this,...
1
vote
1answer
39 views

Lexical Distance, is there a table?

I was looking (for a statistics project) to the Lexical Distance between languages and I came across this post Worldwide map or data for linguistic distance? I was wondering if there is any "...
3
votes
1answer
35 views

Is there a programmatically accessible/structured (JSON, XML, etc) dictionary that includes IPA

Thus far I have the CMU Pronouncing Dictionary, which uses a custom set of phonemes represented in ASCII text. Just the words and pronunciations is nice, but it would be great to have actual IPA ...
2
votes
2answers
43 views

Dataset of special noun phrases

I'm looking for a dataset of noun phrases that are special in a particular way. I'm not able to pinpoint the key features of these noun phrases that distinguish them from other ones, however. Here are ...
1
vote
1answer
37 views

Named Entity Recognition on Upper Case Text

How to extract entities from upper case text. I use - http://corenlp.run/ with test data - I KNOW TOM LIVES IN LONDON. LONDON - Location TOM - not identified relation not identified with test ...
1
vote
0answers
34 views

Where can I find a vowel analyzer app or program?

I'm looking for a smartphone app or computer program that will listen to me pronouncing a vowel and will tell me where exactly the vowel is located in the IPA vowel chart. Does anyone know of apps or ...
0
votes
0answers
37 views

Guessing if a string of Latin alphabet characters is likely to be a word

I have text from documents that were OCR'd. As some of the original document images were poor quality, some of the extracted text is garbage. Here's an example of a line of garbage. j-uti- l-rt.i ...
3
votes
1answer
42 views

What are good (state of the art?) methods for automatic grammar correction?

I'm just beginning to study automatic grammar correction, and was wondering what good methods are for this problem. I have a system that will select spelling candidates for each term, individually, ...
2
votes
0answers
27 views

OpenNLP - Is training still required for abbreviation even with abbreviation dictionary?

I just used OpenNLP for a small program where I was supposed to segment a paragraph into sentences. Although I was able to complete the task after reading some documentation and going through their ...
1
vote
0answers
22 views

Is there any alternative sentence/questions generator tools available for input pharse/keyword

For example: "Please turn on kitchen lights". it should generate all possible and alternative sentence such as, 1. turn on lights. 2. switch off lights. 3. switch on kitchen lights. 4. please turn off ...
1
vote
1answer
60 views

Ambiguity, PCFG grammar

I know that the sentence "time flies like an arrow" could have lots of meaning and there is an ambiguity but I draw a tree and I got confused that which meaning is more suitable for this tree. S→ NP ...
1
vote
0answers
57 views

Conditional IF vs. non-conditional IF

Using regular expressions, I'm trying to detect conditional clauses in sentences. In cases where the sentences starts with the conditional clause and the comma is correctly present (e.g., "If I see a ...
1
vote
0answers
20 views

Is there a Python lib to calculate HTER?

Is there a Python lib that calculates HTER - Human-targeted Translation Error Rate? Ideally it would expose a function that takes as parameters 1) at least one golden translation and 2) the ...
3
votes
2answers
122 views

context-free grammar

How we could create a context-free grammar that generates sentences of arbitrary length like: the cat died. the cat the dog chased died. the cat the dog the rat bit chased died. the cat the dog the ...
1
vote
0answers
23 views

Finding specific syntactic combinations in a tagged text (Python, TreeTagger)

I am trying to write a python program that can 1) tag a text using TreeTagger, and 2) identify certain syntactic combinations within the tagged text. I've got TreeTagger up and running in python; it ...
1
vote
0answers
14 views

What tokenization scheme was used for the conll-X arabic corpus?

I wanted to know what tokenization scheme was used to tokenize the conll-X arabic corpus which was used for the 2006 shared task on dependency parsing ?
1
vote
2answers
60 views

How difficult is grammar induction/sentence generation? [closed]

I. Are any simple algorithms which attempt to "learn" the grammar of a language? Example: I feed into the program a few thousand books worth of English, and want a program which could analyse the ...
1
vote
2answers
38 views

Is there a structured list of language families using ISO language codes?

I'd love to find a machine-readable list of language families that use the three-letter ISO language codes. It would be like: Germanic: eng, enm, deu, dut, ... Romance: fra, ita, spa, ... Does such ...
1
vote
0answers
20 views

How are the ideas from the paper “Modelling Linguistic Expressions Using Fuzzy Relations” currently used in Computational Linguistics/NLP?

The paper written by De Cock, Bodenhofer, and Kerre. A link to the paper: Modelling Linguistic Expressions Using Fuzzy Relations
1
vote
1answer
28 views

Comprehensive list of NER labeling schemes with pros/cons

Are there any reference document(s) that give a comprehensive list of NER labeling schemes (e.g., IOB1, IOB2, or IOBES) along with their pros/cons, and ideally some pointers to publications? I am ...
0
votes
1answer
41 views

Generating Essay (Set of correlated sentenses) from a set of keywords

I originally belong to Computer Vision world. Recently I worked on Scene Understanding. There, I accept an image and generate a sentence explaining the contents of the scene. Now, my professor wants ...
4
votes
3answers
74 views

Can training a Part-of-Speech tagger and parser at the same time improve parsing results?

I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
1
vote
0answers
28 views

an open source lexicographical framework

I am looking for a lightweight open source framework for lexicographical experiments: building vocabularies, converting from one type to another, merging, dealing with multilingual issues, ... google ...
3
votes
2answers
69 views

Open source probabilistic dialogue state tracker

Do you know of any simple (form filling) dialogue state tracking systems with a graphical model based dialogue state representation? I'm looking for one to get familiar with the overall model and ...
0
votes
0answers
21 views

WordNet - Parts-Of-Speech required?

To figure out if the two words are SYNONYMS (SIMILAR_TO), do I need to find the Parts-Of-Speech for the two words first? Can I do this in a single 'operation' in the WordNet or will I have to loop ...
0
votes
0answers
15 views

WordNet - Multiple relationships possible between two words?

Can there be more tha one relationship (SYNONYMS, HOLONYM, etc) between two words in WordNet? Logically, I would say no but with different senses, is it possible?
1
vote
1answer
25 views

Compare and rank text based on content

I am building a crowd sourcing site for a research project where people can come and post public issues they face everyday. It has all the basic features Reddit has. People can view these issues ...