A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

learn more… | top users | synonyms (1)

0
votes
0answers
10 views

Are there any publicly available spell checking corpora?

I need some corpora that contain sentences with misspelled word(s) in order to evaluate the performance of my own spell checking approach. So, the corpora should define the right word alongside the ...
0
votes
3answers
48 views

How to learn computer syllabification of IPA?

As in title. Lets say we have uhm anything (hollywood): /hɑˈliwʊˌd/ now how to make algorithm that will find all syllables in this IPA transcription: /hɑˈliwʊˌd/ => /hɑ.li.wʊd/ We can do ...
0
votes
1answer
32 views

Lexical Distance, is there a table?

I was looking (for a statistics project) to the Lexical Distance between languages and I came across this post Worldwide map or data for linguistic distance? I was wondering if there is any ...
2
votes
1answer
27 views

Is there a programmatically accessible/structured (JSON, XML, etc) dictionary that includes IPA

Thus far I have the CMU Pronouncing Dictionary, which uses a custom set of phonemes represented in ASCII text. Just the words and pronunciations is nice, but it would be great to have actual IPA ...
2
votes
2answers
31 views

Dataset of special noun phrases

I'm looking for a dataset of noun phrases that are special in a particular way. I'm not able to pinpoint the key features of these noun phrases that distinguish them from other ones, however. Here are ...
0
votes
1answer
22 views

Named Entity Recognition on Upper Case Text

How to extract entities from upper case text. I use - http://corenlp.run/ with test data - I KNOW TOM LIVES IN LONDON. LONDON - Location TOM - not identified relation not identified with test ...
1
vote
0answers
30 views

Where can I find a vowel analyzer app or program?

I'm looking for a smartphone app or computer program that will listen to me pronouncing a vowel and will tell me where exactly the vowel is located in the IPA vowel chart. Does anyone know of apps or ...
0
votes
0answers
35 views

Guessing if a string of Latin alphabet characters is likely to be a word

I have text from documents that were OCR'd. As some of the original document images were poor quality, some of the extracted text is garbage. Here's an example of a line of garbage. j-uti- l-rt.i ...
2
votes
1answer
32 views

What are good (state of the art?) methods for automatic grammar correction?

I'm just beginning to study automatic grammar correction, and was wondering what good methods are for this problem. I have a system that will select spelling candidates for each term, individually, ...
2
votes
0answers
21 views

OpenNLP - Is training still required for abbreviation even with abbreviation dictionary?

I just used OpenNLP for a small program where I was supposed to segment a paragraph into sentences. Although I was able to complete the task after reading some documentation and going through their ...
1
vote
0answers
12 views

Is there any alternative sentence/questions generator tools available for input pharse/keyword

For example: "Please turn on kitchen lights". it should generate all possible and alternative sentence such as, 1. turn on lights. 2. switch off lights. 3. switch on kitchen lights. 4. please turn off ...
1
vote
1answer
39 views

Ambiguity, PCFG grammar

I know that the sentence "time flies like an arrow" could have lots of meaning and there is an ambiguity but I draw a tree and I got confused that which meaning is more suitable for this tree. S→ NP ...
1
vote
0answers
56 views

Conditional IF vs. non-conditional IF

Using regular expressions, I'm trying to detect conditional clauses in sentences. In cases where the sentences starts with the conditional clause and the comma is correctly present (e.g., "If I see a ...
1
vote
0answers
17 views

Is there a Python lib to calculate HTER?

Is there a Python lib that calculates HTER - Human-targeted Translation Error Rate? Ideally it would expose a function that takes as parameters 1) at least one golden translation and 2) the ...
3
votes
2answers
116 views

context-free grammar

How we could create a context-free grammar that generates sentences of arbitrary length like: the cat died. the cat the dog chased died. the cat the dog the rat bit chased died. the cat the dog the ...
1
vote
0answers
18 views

Finding specific syntactic combinations in a tagged text (Python, TreeTagger)

I am trying to write a python program that can 1) tag a text using TreeTagger, and 2) identify certain syntactic combinations within the tagged text. I've got TreeTagger up and running in python; it ...
1
vote
0answers
9 views

What tokenization scheme was used for the conll-X arabic corpus?

I wanted to know what tokenization scheme was used to tokenize the conll-X arabic corpus which was used for the 2006 shared task on dependency parsing ?
1
vote
2answers
52 views

How difficult is grammar induction/sentence generation? [closed]

I. Are any simple algorithms which attempt to "learn" the grammar of a language? Example: I feed into the program a few thousand books worth of English, and want a program which could analyse the ...
1
vote
2answers
38 views

Is there a structured list of language families using ISO language codes?

I'd love to find a machine-readable list of language families that use the three-letter ISO language codes. It would be like: Germanic: eng, enm, deu, dut, ... Romance: fra, ita, spa, ... Does such ...
1
vote
0answers
20 views

How are the ideas from the paper “Modelling Linguistic Expressions Using Fuzzy Relations” currently used in Computational Linguistics/NLP?

The paper written by De Cock, Bodenhofer, and Kerre. A link to the paper: Modelling Linguistic Expressions Using Fuzzy Relations
0
votes
1answer
16 views

Comprehensive list of NER labeling schemes with pros/cons

Are there any reference document(s) that give a comprehensive list of NER labeling schemes (e.g., IOB1, IOB2, or IOBES) along with their pros/cons, and ideally some pointers to publications? I am ...
0
votes
1answer
40 views

Generating Essay (Set of correlated sentenses) from a set of keywords

I originally belong to Computer Vision world. Recently I worked on Scene Understanding. There, I accept an image and generate a sentence explaining the contents of the scene. Now, my professor wants ...
4
votes
3answers
69 views

Can training a Part-of-Speech tagger and parser at the same time improve parsing results?

I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
1
vote
0answers
27 views

an open source lexicographical framework

I am looking for a lightweight open source framework for lexicographical experiments: building vocabularies, converting from one type to another, merging, dealing with multilingual issues, ... google ...
2
votes
2answers
36 views

Open source probabilistic dialogue state tracker

Do you know of any simple (form filling) dialogue state tracking systems with a graphical model based dialogue state representation? I'm looking for one to get familiar with the overall model and ...
0
votes
0answers
16 views

WordNet - Parts-Of-Speech required?

To figure out if the two words are SYNONYMS (SIMILAR_TO), do I need to find the Parts-Of-Speech for the two words first? Can I do this in a single 'operation' in the WordNet or will I have to loop ...
0
votes
0answers
11 views

WordNet - Multiple relationships possible between two words?

Can there be more tha one relationship (SYNONYMS, HOLONYM, etc) between two words in WordNet? Logically, I would say no but with different senses, is it possible?
1
vote
1answer
17 views

Compare and rank text based on content

I am building a crowd sourcing site for a research project where people can come and post public issues they face everyday. It has all the basic features Reddit has. People can view these issues ...
1
vote
2answers
43 views

Unable to understand meaning of tag NONE *-1 in Penn Treebank example

I am completely naive and new to NLP. I am following a course on NLP on coursera. As I was studying about parse tree, I came across following sentence to parse: Because the CD had an effective yield ...
1
vote
0answers
31 views

I am looking for Danish/Dutch/English/Finnish/French/German/Italian/Norwegian/Spanish/Swedish/Turkish sms corpora

for my dissertation I am looking for sms corpora. I am mainly interested in automatic sms notifications that are sent to users when they buy things online or pay using credit cards (confirmation ...
1
vote
1answer
53 views

Any suggestions for real-time phonetic analysis packages?

I'm writing some software that will need to do a bit of phonetic analysis. Are there any programs, libraries, or software packages that I can extend to my program which are commonly used for real-time ...
0
votes
0answers
50 views

How many meaningful English phrases can be created using 4 or fewer words?

Prompted by this exchange on Information Security Stack Exchange, regarding whether a passphrase consisting of 4 English words might be easier or harder to crack than a password of 8 random ...
0
votes
0answers
45 views

Automatically turn a question into a statement?

What's a practical way to programmatically convert questions into statements with placeholders? For example: in: 'Who is the president of the Argentina?' out: ['The president of Argentina is ____.', ...
1
vote
1answer
86 views

Can we form a statement in english with verb without noun

I am working on NLP project, I saw during processing of large number of documents that there is always a noun either before or after a verb and both are strongly related. I just need to verify my ...
1
vote
1answer
66 views

GermaNLTK: not finding files [python]

Following the instructions of GermaNLTK I tried to install the german NLTK in Python. (I want to use the synsets for semantic-taging.) But I couldn't find the files germanet.py and ...
1
vote
0answers
60 views

how to choose a threshold for Jiang-Conrath Similarity?

I want to compare two sets of keywords. After searching I understood that Jiang-Conrath Similarity is closer correlating with human judgement. I read this definition: Jiang-Conrath Similarity ...
0
votes
0answers
10 views

What is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset? The 6-class tagset I am ...
0
votes
1answer
166 views

Effectiveness of a script [closed]

For an alphabet, with each letter we have a minimum number of dots/ pixels required to represent it. For convenience one takes such a value for the whole alphabet but actually in addition to this it ...
0
votes
0answers
51 views

How to do a vowel continuum using Praat?

I was going to make a vowel continuum using two real sounds. I used the script below but the sounds I made all sounded similar...which means I didn't succeed in making a continuum... ...
2
votes
0answers
23 views

What are the fillers in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, which label(s) correspond to the Filler class? I have read a couple of article (e.g. (1)) saying there exist a widely applied classmap that ...
4
votes
0answers
123 views

The expressive power of languages : Information content in a sentence : How do we measure it

What is your name Isme shoma chi e Two sentences - same content. My question is about the way to measure information content in a language. How do we do this? Because quite evidently count of the ...
1
vote
1answer
86 views

Representing prepositions in lambda calculus/logic notation

How would I represent 'for' in "Are you here for a conference?" conference could be represented as lam x.conference(x). a conference could be represented as lam Q x.(conference(x) & Q(x)) I ...
2
votes
1answer
70 views

Question about Range of BLEU

I read that range of BLEU is 0 to 1.(from "BLEU" page on wikipedia) But i found some paper says like "we achieve a significant gain of 5.0 BLEU points over non-attentional systems that already ...
3
votes
1answer
47 views

How is “complexity” calculated on thesaurus.com?

On thesaurus.com, you can filter synonyms by their "complexity." Does anyone know the criteria they use to determine a word's complexity?
0
votes
0answers
20 views

Looking for open source software to do Dependency Graph Matching

There is plenty of open source dependency parsers. Is there an open source software to perform dependency graph matching, preferably easy to interface to one or many dependency parsers? My application ...
4
votes
1answer
77 views

How do we measure the degree of similarity between words?

Consider these words: reminder - remainder They are very similar in sound and letters. Yet they are far from each other in meaning. In computational linguistics, do we have algorithms to measure ...
1
vote
1answer
37 views

Data sets for sequential short text classification

I am looking for data sets that I could use to perform sequential short text classification (multilabel is OK). By short text I mean ~100 words max. By sequential I mean that the texts should follow ...
0
votes
1answer
94 views

finding the language stem of vowelless Hebrew

I am looking for tools to find the language stem in vowelless Hebrew, preferably a full list of suffixes and prefixes with the stem. A small list can be found on wikipedia. An extensive list can be ...
1
vote
2answers
61 views

How to assess the language register of speech?

I am looking for ways to automatically assess the language register of a person's speech: formal, informal, ... or through some grading mechanism that would associate a 'score' depending on the ...
1
vote
0answers
44 views

Why use (k+1) instead of k in numerator of BM25 scoring formula [closed]

BM25 uses this nonlinear transformation to scale the term frequency: where x is a term frequency. Why is k+1 used in numerator instead of just k? Wouldn't formula below work equally well? It ...