Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
3
votes
1answer
348 views

Is there a programmatically accessible/structured (JSON, XML, etc) dictionary that includes IPA

Thus far I have the CMU Pronouncing Dictionary, which uses a custom set of phonemes represented in ASCII text. Just the words and pronunciations is nice, but it would be great to have actual IPA ...
2
votes
2answers
153 views

Dataset of special noun phrases

I'm looking for a dataset of noun phrases that are special in a particular way. I'm not able to pinpoint the key features of these noun phrases that distinguish them from other ones, however. Here are ...
1
vote
1answer
72 views

Named Entity Recognition on Upper Case Text

How to extract entities from upper case text. I use - http://corenlp.run/ with test data - I KNOW TOM LIVES IN LONDON. LONDON - Location TOM - not identified relation not identified with test ...
4
votes
1answer
1k views

Where can I find a vowel analyzer app or program?

I'm looking for a smartphone app or computer program that will listen to me pronouncing a vowel and will tell me where exactly the vowel is located in the IPA vowel chart. Does anyone know of apps or ...
4
votes
1answer
86 views

What are good (state of the art?) methods for automatic grammar correction?

I'm just beginning to study automatic grammar correction, and was wondering what good methods are for this problem. I have a system that will select spelling candidates for each term, individually, ...
2
votes
0answers
124 views

OpenNLP - Is training still required for abbreviation even with abbreviation dictionary?

I just used OpenNLP for a small program where I was supposed to segment a paragraph into sentences. Although I was able to complete the task after reading some documentation and going through their ...
1
vote
0answers
128 views

Is there any alternative sentence/questions generator tools available for input pharse/keyword

For example: "Please turn on kitchen lights". it should generate all possible and alternative sentence such as, 1. turn on lights. 2. switch off lights. 3. switch on kitchen lights. 4. please turn off ...
1
vote
1answer
176 views

Ambiguity, PCFG grammar

I know that the sentence "time flies like an arrow" could have lots of meaning and there is an ambiguity but I draw a tree and I got confused that which meaning is more suitable for this tree. S→ NP ...
1
vote
0answers
282 views

Conditional IF vs. non-conditional IF

Using regular expressions, I'm trying to detect conditional clauses in sentences. In cases where the sentences starts with the conditional clause and the comma is correctly present (e.g., "If I see a ...
1
vote
0answers
617 views

Is there a Python lib to calculate HTER?

Is there a Python lib that calculates HTER - Human-targeted Translation Error Rate? Ideally it would expose a function that takes as parameters 1) at least one golden translation and 2) the ...
3
votes
2answers
205 views

context-free grammar

How we could create a context-free grammar that generates sentences of arbitrary length like: the cat died. the cat the dog chased died. the cat the dog the rat bit chased died. the cat the dog the ...
1
vote
0answers
75 views

Finding specific syntactic combinations in a tagged text (Python, TreeTagger)

I am trying to write a python program that can 1) tag a text using TreeTagger, and 2) identify certain syntactic combinations within the tagged text. I've got TreeTagger up and running in python; it ...
1
vote
0answers
40 views

What tokenization scheme was used for the conll-X arabic corpus?

I wanted to know what tokenization scheme was used to tokenize the conll-X arabic corpus which was used for the 2006 shared task on dependency parsing ?
1
vote
2answers
147 views

How difficult is grammar induction/sentence generation? [closed]

I. Are any simple algorithms which attempt to "learn" the grammar of a language? Example: I feed into the program a few thousand books worth of English, and want a program which could analyse the ...
2
votes
2answers
91 views

Is there a structured list of language families using ISO language codes?

I'd love to find a machine-readable list of language families that use the three-letter ISO language codes. It would be like: Germanic: eng, enm, deu, dut, ... Romance: fra, ita, spa, ... Does such ...
1
vote
0answers
39 views

How are the ideas from the paper “Modelling Linguistic Expressions Using Fuzzy Relations” currently used in Computational Linguistics/NLP?

The paper written by De Cock, Bodenhofer, and Kerre. A link to the paper: Modelling Linguistic Expressions Using Fuzzy Relations
1
vote
1answer
57 views

Comprehensive list of NER labeling schemes with pros/cons

Are there any reference document(s) that give a comprehensive list of NER labeling schemes (e.g., IOB1, IOB2, or IOBES) along with their pros/cons, and ideally some pointers to publications? I am ...
1
vote
1answer
68 views

Generating Essay (Set of correlated sentenses) from a set of keywords

I originally belong to Computer Vision world. Recently I worked on Scene Understanding. There, I accept an image and generate a sentence explaining the contents of the scene. Now, my professor wants ...
5
votes
4answers
209 views

Can training a Part-of-Speech tagger and parser at the same time improve parsing results?

I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
1
vote
0answers
52 views

an open source lexicographical framework

I am looking for a lightweight open source framework for lexicographical experiments: building vocabularies, converting from one type to another, merging, dealing with multilingual issues, ... google ...
3
votes
2answers
642 views

Open source probabilistic dialogue state tracker

Do you know of any simple (form filling) dialogue state tracking systems with a graphical model based dialogue state representation? I'm looking for one to get familiar with the overall model and ...
2
votes
2answers
267 views

Unable to understand meaning of tag NONE *-1 in Penn Treebank example

I am completely naive and new to NLP. I am following a course on NLP on coursera. As I was studying about parse tree, I came across following sentence to parse: Because the CD had an effective yield ...
1
vote
0answers
66 views

I am looking for Danish/Dutch/English/Finnish/French/German/Italian/Norwegian/Spanish/Swedish/Turkish sms corpora

for my dissertation I am looking for sms corpora. I am mainly interested in automatic sms notifications that are sent to users when they buy things online or pay using credit cards (confirmation ...
1
vote
1answer
114 views

Any suggestions for real-time phonetic analysis packages?

I'm writing some software that will need to do a bit of phonetic analysis. Are there any programs, libraries, or software packages that I can extend to my program which are commonly used for real-time ...
1
vote
0answers
171 views

How many meaningful English phrases can be created using 4 or fewer words?

Prompted by this exchange on Information Security Stack Exchange, regarding whether a passphrase consisting of 4 English words might be easier or harder to crack than a password of 8 random characters,...
1
vote
1answer
171 views

Can we form a statement in english with verb without noun

I am working on NLP project, I saw during processing of large number of documents that there is always a noun either before or after a verb and both are strongly related. I just need to verify my ...
1
vote
1answer
551 views

GermaNLTK: not finding files [python]

Following the instructions of GermaNLTK I tried to install the german NLTK in Python. (I want to use the synsets for semantic-taging.) But I couldn't find the files germanet.py and GermanetDBBuilder....
2
votes
1answer
372 views

how to choose a threshold for Jiang-Conrath Similarity?

I want to compare two sets of keywords. After searching I understood that Jiang-Conrath Similarity is closer correlating with human judgement. I read this definition: Jiang-Conrath Similarity ...
0
votes
0answers
72 views

What is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset? The 6-class tagset I am ...
0
votes
1answer
174 views

Effectiveness of a script [closed]

For an alphabet, with each letter we have a minimum number of dots/ pixels required to represent it. For convenience one takes such a value for the whole alphabet but actually in addition to this it ...
2
votes
0answers
182 views

What are the fillers in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, which label(s) correspond to the Filler class? I have read a couple of article (e.g. (1)) saying there exist a widely applied classmap that ...
4
votes
0answers
238 views

The expressive power of languages : Information content in a sentence : How do we measure it

What is your name Isme shoma chi e Two sentences - same content. My question is about the way to measure information content in a language. How do we do this? Because quite evidently count of the ...
2
votes
1answer
398 views

Representing prepositions in lambda calculus/logic notation

How would I represent 'for' in "Are you here for a conference?" conference could be represented as lam x.conference(x). a conference could be represented as lam Q x.(conference(x) & Q(x)) I ...
2
votes
1answer
307 views

Question about Range of BLEU

I read that range of BLEU is 0 to 1.(from "BLEU" page on wikipedia) But i found some paper says like "we achieve a significant gain of 5.0 BLEU points over non-attentional systems that already ...
3
votes
1answer
89 views

How is “complexity” calculated on thesaurus.com?

On thesaurus.com, you can filter synonyms by their "complexity." Does anyone know the criteria they use to determine a word's complexity?
5
votes
1answer
726 views

How do we measure the degree of similarity between words?

Consider these words: reminder - remainder They are very similar in sound and letters. Yet they are far from each other in meaning. In computational linguistics, do we have algorithms to measure ...
1
vote
1answer
136 views

Data sets for sequential short text classification

I am looking for data sets that I could use to perform sequential short text classification (multilabel is OK). By short text I mean ~100 words max. By sequential I mean that the texts should follow ...
0
votes
1answer
263 views

finding the language stem of vowelless Hebrew

I am looking for tools to find the language stem in vowelless Hebrew, preferably a full list of suffixes and prefixes with the stem. A small list can be found on wikipedia. An extensive list can be ...
1
vote
2answers
203 views

How to assess the language register of speech?

I am looking for ways to automatically assess the language register of a person's speech: formal, informal, ... or through some grading mechanism that would associate a 'score' depending on the person'...
1
vote
0answers
84 views

Why use (k+1) instead of k in numerator of BM25 scoring formula [closed]

BM25 uses this nonlinear transformation to scale the term frequency: where x is a term frequency. Why is k+1 used in numerator instead of just k? Wouldn't formula below work equally well? It is ...
2
votes
1answer
129 views

Is there a term to describe comparing two documents to determine if they have the same topic?

I am looking for an NLP field analogous to face verification in Computer Vision, where two images of human faces are compared, and the class label describes whether the images are of the same person. ...
1
vote
2answers
874 views

Praat script to delete line breaks in TextGrid intervals?

Can anyone make a PRAAT script that deletes line breaks from intervals in Text Grids. I did a bunch of transcribing of a word/sentence list. I copy and pasted from a text file that had line breaks ...
1
vote
0answers
98 views

Structured database of the ACL Anthology data set?

Is there any structured database of the ACL Anthology (former website; new website)? By structured database I mean some SQL dump (NoSQL is fine too) that would contain all papers' meta information (...
2
votes
1answer
167 views

What are the upsides of using dependency parsing over constituency parsing?

I am looking for an exhaustive list of upsides of using dependency parsing over constituency parsing (if possible, with references for each upside).
0
votes
0answers
68 views

Why doesn't GeneTag use BIO for its annotations?

GeneTag (1) is a tagged corpus for gene/protein named entity recognition. The corpus is annotated as follows: P00089778A0000 The_TAG concentration_TAG of_TAG alpha_GENE1 2_GENE1 -_GENE1 ...
1
vote
0answers
36 views

Running cTAKES using all cores available

When running cTAKES on several text documents, is there any way to perform the processing using all the cores available? E.g. it is taking around one day to process 2000 of my documents, as it is ...
3
votes
1answer
142 views

Benchmark data sets for negation detection systems

I am looking for data sets that I could use to train and benchmark negation detection systems.
2
votes
2answers
566 views

Meaning of surface expressions

Reading this paper I came across term "surface expression". What does it mean?
2
votes
1answer
553 views

Negation detection software

I am looking for negation detection software or libraries. Linux, Microsoft Windows or Mac OS X are all OK. Any price and license is good too. I am mostly interested in the quality of the detection. ...
1
vote
0answers
29 views

Extracting the list of diseases as well as their negation from a physician note using cTAKES

E.g. I have the following physician note: The patient has diabetes. The patient does not have the flu. I would like to extract from it the information that diabetes and not flu are mentioned. How ...

1
5 6
7
8 9
13