A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms (1)

2
votes
0answers
17 views

Estimating the size of training data for grammer extraction

I have a dependency treebank including 100 sentences, which I divide into a training set and a test set. I extract some rules ((DS,PS) pairs) to convert the treebank to phrase structures. When I ...
3
votes
0answers
90 views

Giving grammar without useless symbols / ε-productions

I hope some people here are firm with computational linguistics, since I couldn't find any question here about this topic yet. Question 1 As the title says, I'm trying to give an equivalent ...
1
vote
1answer
52 views

Who is corpus annotator

I'm a beginner of nlp. I'm wondering who is annotator of corpus usually ? Who does actually do works of annotating ? Researchers?
1
vote
2answers
32 views

Spoken Language Dataset of L2 Acquisition

Is there a publicly available dataset of spoken language for L2 acquisition? I would prefer children learning an L2, but any age range is fine. It would be great, but not necessary, to have speaking ...
1
vote
1answer
37 views

List of Spaced Named Entities for English

I am writing a tokenizer for a small NLP project. After the first attempt (basically splitting at white spaces) didn't lead to good results at all, I am now starting from scratch. I would like to be ...
0
votes
2answers
44 views

Tone of Voice Interpretation [on hold]

I found the term Tone of Voice on web. But no where I could find any clear meaning attached to it.Can any body pls help me explain what Tone of Voice actually is. I'm interested in Tone of Voice in ...
3
votes
0answers
30 views

Are there any publicly available spell checking corpora?

I need some corpora that contain sentences with misspelled word(s) in order to evaluate the performance of my own spell checking approach. So, the corpora should define the right word alongside the ...
0
votes
3answers
55 views

How to learn computer syllabification of IPA?

As in title. Lets say we have uhm anything (hollywood): /hɑˈliwʊˌd/ now how to make algorithm that will find all syllables in this IPA transcription: /hɑˈliwʊˌd/ => /hɑ.li.wʊd/ We can do this,...
1
vote
1answer
38 views

Lexical Distance, is there a table?

I was looking (for a statistics project) to the Lexical Distance between languages and I came across this post Worldwide map or data for linguistic distance? I was wondering if there is any "...
3
votes
1answer
34 views

Is there a programmatically accessible/structured (JSON, XML, etc) dictionary that includes IPA

Thus far I have the CMU Pronouncing Dictionary, which uses a custom set of phonemes represented in ASCII text. Just the words and pronunciations is nice, but it would be great to have actual IPA ...
2
votes
2answers
35 views

Dataset of special noun phrases

I'm looking for a dataset of noun phrases that are special in a particular way. I'm not able to pinpoint the key features of these noun phrases that distinguish them from other ones, however. Here are ...
1
vote
1answer
31 views

Named Entity Recognition on Upper Case Text

How to extract entities from upper case text. I use - http://corenlp.run/ with test data - I KNOW TOM LIVES IN LONDON. LONDON - Location TOM - not identified relation not identified with test ...
1
vote
0answers
31 views

Where can I find a vowel analyzer app or program?

I'm looking for a smartphone app or computer program that will listen to me pronouncing a vowel and will tell me where exactly the vowel is located in the IPA vowel chart. Does anyone know of apps or ...
0
votes
0answers
37 views

Guessing if a string of Latin alphabet characters is likely to be a word

I have text from documents that were OCR'd. As some of the original document images were poor quality, some of the extracted text is garbage. Here's an example of a line of garbage. j-uti- l-rt.i ...
3
votes
1answer
39 views

What are good (state of the art?) methods for automatic grammar correction?

I'm just beginning to study automatic grammar correction, and was wondering what good methods are for this problem. I have a system that will select spelling candidates for each term, individually, ...
2
votes
0answers
24 views

OpenNLP - Is training still required for abbreviation even with abbreviation dictionary?

I just used OpenNLP for a small program where I was supposed to segment a paragraph into sentences. Although I was able to complete the task after reading some documentation and going through their ...
1
vote
0answers
13 views

Is there any alternative sentence/questions generator tools available for input pharse/keyword

For example: "Please turn on kitchen lights". it should generate all possible and alternative sentence such as, 1. turn on lights. 2. switch off lights. 3. switch on kitchen lights. 4. please turn off ...
1
vote
1answer
52 views

Ambiguity, PCFG grammar

I know that the sentence "time flies like an arrow" could have lots of meaning and there is an ambiguity but I draw a tree and I got confused that which meaning is more suitable for this tree. S→ NP ...
1
vote
0answers
57 views

Conditional IF vs. non-conditional IF

Using regular expressions, I'm trying to detect conditional clauses in sentences. In cases where the sentences starts with the conditional clause and the comma is correctly present (e.g., "If I see a ...
1
vote
0answers
18 views

Is there a Python lib to calculate HTER?

Is there a Python lib that calculates HTER - Human-targeted Translation Error Rate? Ideally it would expose a function that takes as parameters 1) at least one golden translation and 2) the ...
3
votes
2answers
120 views

context-free grammar

How we could create a context-free grammar that generates sentences of arbitrary length like: the cat died. the cat the dog chased died. the cat the dog the rat bit chased died. the cat the dog the ...
1
vote
0answers
21 views

Finding specific syntactic combinations in a tagged text (Python, TreeTagger)

I am trying to write a python program that can 1) tag a text using TreeTagger, and 2) identify certain syntactic combinations within the tagged text. I've got TreeTagger up and running in python; it ...
1
vote
0answers
11 views

What tokenization scheme was used for the conll-X arabic corpus?

I wanted to know what tokenization scheme was used to tokenize the conll-X arabic corpus which was used for the 2006 shared task on dependency parsing ?
1
vote
2answers
54 views

How difficult is grammar induction/sentence generation? [closed]

I. Are any simple algorithms which attempt to "learn" the grammar of a language? Example: I feed into the program a few thousand books worth of English, and want a program which could analyse the ...
1
vote
2answers
38 views

Is there a structured list of language families using ISO language codes?

I'd love to find a machine-readable list of language families that use the three-letter ISO language codes. It would be like: Germanic: eng, enm, deu, dut, ... Romance: fra, ita, spa, ... Does such ...
1
vote
0answers
20 views

How are the ideas from the paper “Modelling Linguistic Expressions Using Fuzzy Relations” currently used in Computational Linguistics/NLP?

The paper written by De Cock, Bodenhofer, and Kerre. A link to the paper: Modelling Linguistic Expressions Using Fuzzy Relations
1
vote
1answer
24 views

Comprehensive list of NER labeling schemes with pros/cons

Are there any reference document(s) that give a comprehensive list of NER labeling schemes (e.g., IOB1, IOB2, or IOBES) along with their pros/cons, and ideally some pointers to publications? I am ...
0
votes
1answer
41 views

Generating Essay (Set of correlated sentenses) from a set of keywords

I originally belong to Computer Vision world. Recently I worked on Scene Understanding. There, I accept an image and generate a sentence explaining the contents of the scene. Now, my professor wants ...
4
votes
3answers
71 views

Can training a Part-of-Speech tagger and parser at the same time improve parsing results?

I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
1
vote
0answers
28 views

an open source lexicographical framework

I am looking for a lightweight open source framework for lexicographical experiments: building vocabularies, converting from one type to another, merging, dealing with multilingual issues, ... google ...
2
votes
2answers
39 views

Open source probabilistic dialogue state tracker

Do you know of any simple (form filling) dialogue state tracking systems with a graphical model based dialogue state representation? I'm looking for one to get familiar with the overall model and ...
0
votes
0answers
20 views

WordNet - Parts-Of-Speech required?

To figure out if the two words are SYNONYMS (SIMILAR_TO), do I need to find the Parts-Of-Speech for the two words first? Can I do this in a single 'operation' in the WordNet or will I have to loop ...
0
votes
0answers
13 views

WordNet - Multiple relationships possible between two words?

Can there be more tha one relationship (SYNONYMS, HOLONYM, etc) between two words in WordNet? Logically, I would say no but with different senses, is it possible?
1
vote
1answer
20 views

Compare and rank text based on content

I am building a crowd sourcing site for a research project where people can come and post public issues they face everyday. It has all the basic features Reddit has. People can view these issues ...
1
vote
2answers
45 views

Unable to understand meaning of tag NONE *-1 in Penn Treebank example

I am completely naive and new to NLP. I am following a course on NLP on coursera. As I was studying about parse tree, I came across following sentence to parse: Because the CD had an effective yield ...
1
vote
0answers
31 views

I am looking for Danish/Dutch/English/Finnish/French/German/Italian/Norwegian/Spanish/Swedish/Turkish sms corpora

for my dissertation I am looking for sms corpora. I am mainly interested in automatic sms notifications that are sent to users when they buy things online or pay using credit cards (confirmation ...
1
vote
1answer
53 views

Any suggestions for real-time phonetic analysis packages?

I'm writing some software that will need to do a bit of phonetic analysis. Are there any programs, libraries, or software packages that I can extend to my program which are commonly used for real-time ...
0
votes
0answers
52 views

How many meaningful English phrases can be created using 4 or fewer words?

Prompted by this exchange on Information Security Stack Exchange, regarding whether a passphrase consisting of 4 English words might be easier or harder to crack than a password of 8 random characters,...
0
votes
0answers
46 views

Automatically turn a question into a statement?

What's a practical way to programmatically convert questions into statements with placeholders? For example: in: 'Who is the president of the Argentina?' out: ['The president of Argentina is ____.', ...
1
vote
1answer
87 views

Can we form a statement in english with verb without noun

I am working on NLP project, I saw during processing of large number of documents that there is always a noun either before or after a verb and both are strongly related. I just need to verify my ...
1
vote
1answer
80 views

GermaNLTK: not finding files [python]

Following the instructions of GermaNLTK I tried to install the german NLTK in Python. (I want to use the synsets for semantic-taging.) But I couldn't find the files germanet.py and GermanetDBBuilder....
1
vote
0answers
60 views

how to choose a threshold for Jiang-Conrath Similarity?

I want to compare two sets of keywords. After searching I understood that Jiang-Conrath Similarity is closer correlating with human judgement. I read this definition: Jiang-Conrath Similarity ...
0
votes
0answers
10 views

What is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset? The 6-class tagset I am ...
0
votes
1answer
166 views

Effectiveness of a script [closed]

For an alphabet, with each letter we have a minimum number of dots/ pixels required to represent it. For convenience one takes such a value for the whole alphabet but actually in addition to this it ...
0
votes
0answers
56 views

How to do a vowel continuum using Praat?

I was going to make a vowel continuum using two real sounds. I used the script below but the sounds I made all sounded similar...which means I didn't succeed in making a continuum... http://www....
2
votes
0answers
26 views

What are the fillers in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, which label(s) correspond to the Filler class? I have read a couple of article (e.g. (1)) saying there exist a widely applied classmap that ...
4
votes
0answers
125 views

The expressive power of languages : Information content in a sentence : How do we measure it

What is your name Isme shoma chi e Two sentences - same content. My question is about the way to measure information content in a language. How do we do this? Because quite evidently count of the ...
1
vote
1answer
88 views

Representing prepositions in lambda calculus/logic notation

How would I represent 'for' in "Are you here for a conference?" conference could be represented as lam x.conference(x). a conference could be represented as lam Q x.(conference(x) & Q(x)) I ...
2
votes
1answer
70 views

Question about Range of BLEU

I read that range of BLEU is 0 to 1.(from "BLEU" page on wikipedia) But i found some paper says like "we achieve a significant gain of 5.0 BLEU points over non-attentional systems that already ...
3
votes
1answer
48 views

How is “complexity” calculated on thesaurus.com?

On thesaurus.com, you can filter synonyms by their "complexity." Does anyone know the criteria they use to determine a word's complexity?