Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
3 votes
2 answers
155 views

What is the definition of "oracle information"?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...
Renklauf's user avatar
  • 133
3 votes
1 answer
191 views

Textual Commitment

I am working on question answering problem. The major task is to understand text and convert complex sentences to simpler sentences i.e Textual Commitments using Conventional implicature and ...
samuelhard's user avatar
3 votes
0 answers
48 views

Computer analysis of ESL learners' mistakes

This is a very broad question; I'm trying to get a sense of the current state of this subfield of NLP and what relevant resources may already exist, so even tangential answers will be welcome. To what ...
TKR's user avatar
  • 10.9k
3 votes
0 answers
61 views

How to incorporate sentence end marker in POS tagging with viterbi algorithm?

I am self-reading the NLP book by Dan Jurafsky. In the book, the following equation is given for incorporating the sentence end marker in the Viterbi algorithm for POS tagging. I am confused why the ...
user3680660's user avatar
3 votes
0 answers
131 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
MTD's user avatar
  • 31
3 votes
0 answers
61 views

State of the art in controlled english languages?

https://en.wikipedia.org/wiki/Controlled_natural_language lists some controlled languages, of which Attempto Controlled English seems to be the most recent. However, are there any Attempto extensions, ...
danbst's user avatar
  • 131
3 votes
0 answers
75 views

Computational linguist's estimate of minimum hours of speech needed to train a neural net to recognize speech

From a computational linguist's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 hours ...
Lars Ericson's user avatar
3 votes
0 answers
81 views

Does StanfordNLP have a problem with adverbs?

I suspect not, and I'm being dumb, but ... Usain ran quickest. is parsed (https://corenlp.run) as NNP VBZ JJS. Why JJS (Adjective, superlative) and not RBS (Adverb, superlative)? Using extended ...
havlock's user avatar
  • 133
3 votes
0 answers
44 views

Grammar induction from grammaticality rules

Let's have formalisation of grammaticality judgments in some deduction system. Is it possible to learn/induce grammar from rules that govern grammaticality judgments? Is there theory, that connects ...
TomR's user avatar
  • 499
3 votes
0 answers
36 views

What is the term for a specific type of collocation analysis

I am trying to write a text processing script in R. I am interested in finding a word (from a list of words I have selected) only if it is in the same sentence as another word. Eventually I would ...
Sebastian Zeki's user avatar
3 votes
0 answers
206 views

Are there any computational linguists who still use prolog?

My understanding is that in the 90's and early 2000's, expert systems and logical rules dominated the field of natural language processing/computational linguistics, but that for the last 10 years, ...
lightning's user avatar
  • 345
3 votes
1 answer
312 views

How to proceed with this Maasai translation?

The problem statement is as follows: Question: Indicate which translation goes with each Maasai sentence. My current approach: The word {word1} appears a total of 8 times in the Maasai sentences ...
Prajneya Kumar's user avatar
3 votes
0 answers
95 views

Is there a phrasal verb corpus somewhere online?

I'm working on a project where I have syntactic frames in the form of something like "N.agent V PP.stimulus", where each PP consists of a P and a N. I have a set list of verbs, and a list of PPs for ...
kimcog's user avatar
  • 31
3 votes
0 answers
59 views

Connections between combinatory categorial grammars and abstract categorial grammars?

Are there connections/translation or common tools usage/adaptation between combinatory (concrete) categorial grammars (incl. Lambek calculus) and abstract categorial grammars? Can tools for one of ...
TomR's user avatar
  • 499
3 votes
0 answers
110 views

How to get morphological information from Stanford POS tagger?

I'm using the Stanford POS tagger to process German text and I'm interested in assessing the number (singular/plural) of the nouns in the sentence, so that I can classify them accordingly. This is ...
Miluleh's user avatar
  • 86
3 votes
0 answers
110 views

n-gram language model smoothing [closed]

I use the corpora of webtext to train n-gram model in NLTK.And i use katz back-off smoothing to solve 0 count-problem.But one problem is:while the smoothing used in based-on characters language model,...
Tina_seven's user avatar
3 votes
0 answers
180 views

Distribution of the set of meanings of a given word, in a corpus

I am looking to know about the distribution of word senses, of a particular word in a corpus. How often a word sense will occur out of all the occurrences of that word with any meaning. For example: ...
Frames Catherine White's user avatar
3 votes
0 answers
27 views

Publication venues focusing on reproducing results

Is there any publication venue for natural language processing focusing on reproducing results from other papers?
Franck Dernoncourt's user avatar
3 votes
1 answer
200 views

Giving grammar without useless symbols / ε-productions

I hope some people here are firm with computational linguistics, since I couldn't find any question here about this topic yet. Question 1 As the title says, I'm trying to give an equivalent ...
Kendel Ventonda's user avatar
3 votes
0 answers
67 views

Are there any publicly available spell checking corpora?

I need some corpora that contain sentences with misspelled word(s) in order to evaluate the performance of my own spell checking approach. So, the corpora should define the right word alongside the ...
talha06's user avatar
  • 139
3 votes
0 answers
289 views

Downloadable list of Romance-language cognates?

I'm looking for tables of cognates between French, Spanish and Italian (and potentially Latin, Portuguese, Catalan, etc.), so I can run some Python on them. If they could have extra information such ...
Emile's user avatar
  • 163
3 votes
0 answers
213 views

Inside-outside algorithm (PCFG learning) and binarization

I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
mushin's user avatar
  • 31
3 votes
1 answer
2k views

Detection if input sentence represents an incomplete sentence?

I am curious if there is an automated way to detect if a given string, representing a sentence, is an 'incomplete' sentence. By this I mean that either the text is not grammatically correct, or is ...
mrquintopolous's user avatar
3 votes
0 answers
155 views

What are the foundational papers in computational phonology?

I'm working on a paper on the history of computational phonology. As I understand it, Chomsky & Halle's SPE acted as a catalyst for research in the field, namely by laying the foundations for two-...
fenceop's user avatar
  • 320
3 votes
0 answers
498 views

Stanford NLP parsers and idioms that have common semantic meaning

I have parsed the following sentence in the Stanford CoreNLP demo page and the Stanford parser demo page. Although both result in a parse that can imply purpose semantics (hinging on the advcl and the ...
matanox's user avatar
  • 299
3 votes
0 answers
72 views

Any NLP performance timeline?

I am looking for any plots, etc. that show performance metrics on various NLP tasks as a function of year. E.g. the following figure shows the evolution of performance of face recognition systems:
Franck Dernoncourt's user avatar
3 votes
0 answers
211 views

Where can I find Japanese-English (manually) word-aligned corpora?

I'm looking for as many very reliable Japanese-English corpora as possible so I'd like to ask: Are there any other manually aligned corpora besides KFFT's and Utiyama's? What are the most accurate ...
user2779's user avatar
3 votes
0 answers
339 views

Calculating margin of error for precision and recall

I commonly calculate the precision and recall for information pulled from text but I'm not sure how to calculate the margin of error for those precision and recall values. So for example, if I have a ...
mmoosman's user avatar
  • 156
2 votes
2 answers
279 views

How to find most common expressions starting with "iron"?

I want to find a list of 2-word expressions starting with iron: i.e. ironing board, iron filings, iron bridge Can you suggest a vocabulary tool for that?
bandybabboon's user avatar
2 votes
3 answers
2k views

How can I do data augmentation for text classification?

I am working on a text classification project. Some properties of my data set: Total number of samples: 33200 Total number of classes: 1131 Class distribution is highly skewed (about 35% of the ...
Musfiqur Rahman's user avatar
2 votes
1 answer
598 views

How to detect verb in a sentence where the verb is invisible in the sentence?

In case of some Indo-European languages it seems there is no visible verb in the sentence. This is specially visible in languages like Bangla, Hindi etc. For example the sentence Who is there? is ...
Yeasin Ar Rahman's user avatar
2 votes
3 answers
520 views

How to learn computer syllabification of IPA?

As in title. Lets say we have uhm anything (hollywood): /hɑˈliwʊˌd/ now how to make algorithm that will find all syllables in this IPA transcription: /hɑˈliwʊˌd/ => /hɑ.li.wʊd/ We can do this, ...
ElSajko's user avatar
  • 129
2 votes
5 answers
1k views

Algorithm for figuring out the pronunciation of a word

Wondering how we pronounce words. I feel like I learned this when I was a kid in school with all the language rules, but now I can't remember. I am trying to think about how we pronounce words. How ...
Lance's user avatar
  • 4,336
2 votes
1 answer
916 views

looking for corpus of dialogue recording in appointment between doctors and patients

I am looking for a public corpus of dialogue recording in short/medium appointment between doctors and patients, aims to study speech variation, the prosody of speech, measuring speech' rhythm, ...
Andy.Jian's user avatar
2 votes
1 answer
428 views

Why do we need machine translation evaluation?

Why is it that we need machine translation evaluation? If we have subjective evaluation measures why do we need automatic evaluation? As most of the automatic evaluation metrics are unable to capture ...
user1186's user avatar
2 votes
2 answers
776 views

Finding phonetic similarity of names in different languages

I am trying to come up with a way using Python to find phonetic similarities between how differently written names with different meanings in different languages might sound alike. Names can be ...
Lndit39's user avatar
  • 21
2 votes
1 answer
141 views

Get Prolog (other functional programming language) rules/facts from LKB or similar system

My goal is to take simple sentence such as Grass is green and convert it to Prolog rule/fact. It does not have to be Prolog, but any other functional programming language with which I can perform ...
user1700890's user avatar
2 votes
1 answer
96 views

Do language models ignore word order in the context?

Most tutorials I've seen on language models illustrate MLE estimation by counting. For example, P("mice"|"three blind") = count("three blind mice") / count("three blind") But joint probability is ...
Kevin Binz's user avatar
2 votes
1 answer
109 views

Generating Essay (Set of correlated sentenses) from a set of keywords

I originally belong to Computer Vision world. Recently I worked on Scene Understanding. There, I accept an image and generate a sentence explaining the contents of the scene. Now, my professor wants ...
Adorn's user avatar
  • 131
2 votes
2 answers
651 views

Open source probabilistic dialogue state tracker

Do you know of any simple (form filling) dialogue state tracking systems with a graphical model based dialogue state representation? I'm looking for one to get familiar with the overall model and ...
Igor Shalyminov's user avatar
2 votes
2 answers
321 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
Alexander T's user avatar
2 votes
2 answers
199 views

Context-Free grammars and Language

As someone trained in neither, how could you explain the analogies between context free grammars / languages and certain programming languages in computer science? Have I misunderstood whether there ...
user54963's user avatar
2 votes
3 answers
183 views

To which extent language exists disconnected from the physical world?

If I would put you in a closed room with a computer containing terabytes of alien written symbols. Those aliens are from another dimension where the physical laws are different and our understanding ...
user3091275's user avatar
2 votes
2 answers
133 views

Speech and Language Processing without Representation of Language?

While reading in the literature about text processing I found this scientific paper about text classification using artificial neural nets. The authors feed their convolutional neural network with ...
Tobias Scheithauer's user avatar
2 votes
2 answers
1k views

Linguistics concept about meaning of words according to a context

Several linguistics questions about the meaning in context of words: How is called in linguistics the fact some words have a meaning only with other words? How is it called when a word changes ...
Quidam's user avatar
  • 632

1
4 5
6
7 8
14