Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

2
votes
0answers
24 views

Word length as a function of word frequency?

I was wondering if any studies have been done in corpus linguistics which look at word length (number of phonemes per word) as a function of the word's frequency of use? Thanks! EDIT: Never mind, ...
2
votes
0answers
9 views

How to convert CHAT to TextGrid in a batch?

Siarad corpus is a corpus of spoken Welsh (~40 hours, all transcribed, glossed and translated!). I want to analyze some conversations using Praat. Praat uses the TextGrid format, but the Siarad corpus ...
1
vote
0answers
19 views

Computational applications of construction grammars

Are there NLP applications (either natural language understanding or generation) which make use of the Construction Grammar framework? On a related note, does there exist a logically organized list ...
2
votes
0answers
44 views

Is “help” a causal verb?

As part of my research, I extract causal (cause-effect) relations from natural text. Sometimes, there are words in the text that signal a causal relation like "because" or "since." And, some other ...
0
votes
0answers
21 views

parsing British National Corpus into words

I need to calculate inverse document frequency from BNC. Does anybody has any code or know how to parse this dataset to extract texts? After extracting texts do I need to stem(get the base form of ...
-2
votes
1answer
31 views

For each word in a corpus, find how many senses it has according to WordNet [closed]

I've come across this exercise in my studies and I do not know how to challenge, I've tried to follow examples though I can never find anything online that truly is symmetrical to what I'm trying to ...
3
votes
1answer
45 views

Why not use a Lookup taggers?

I do understand that a lookup tagger is one of the simplest ones to implement as it is able to map each word a single POS. Why shouldn't we use it compared to bigram tagger?
0
votes
1answer
44 views

Jiang & Conrath when two words are the same

I would like to normalize the result of Jiang & Conrath similarity measure by dividing it by the maximum value(normally should be when both synsets are the same). I am using the implementation of ...
5
votes
1answer
88 views

Statistical Methods in Etymology

Etymologists tend to categorize the probability of theories under formulaic labels. These range from "uncertain" over "tentative" or "not convincing" to "established", "accepted" or "nonsense". P ...
2
votes
0answers
50 views

Are there any computational linguists who still use prolog?

My understanding is that in the 90's and early 2000's, expert systems and logical rules dominated the field of natural language processing/computational linguistics, but that for the last 10 years, ...
0
votes
1answer
39 views

The determiner “a” in lambda form

In the sentence: A man loves Mary The lambda notation of the determiner 'a' is: λY.λX.∃z.Y(z)∧X(z) What about the general determiner 'a'? Is the lambda notation the same? or it should be: λX.∃z....
1
vote
3answers
57 views

Looking for tool to split german text into sentences

I want to train a german embedding and need to split text into sentences. That is not easy since "z. B." and "Dr." are not endings of a sentence. Does anybody know a tool to do that for german texts? ...
0
votes
1answer
80 views

Syntax tree for this sentence [closed]

I am trying to find best way to get a syntax tree for this sentence: Planting seeds helps you grow your farm I thought of this: -------- S1 --------- | | --...
2
votes
2answers
108 views

Given both a word and the corresponding IPA, how to match/map the letters together?

Given both the word and the corresponding IPA equivalent, is there any stable algorithm for mapping the letter of each word to the IPA letter? For example, given close-quote and IPA kloʊzkwoʊt -- I'd ...
6
votes
2answers
89 views

Dataset/Database similar to WALS in Vowel/Phonology

I am wondering if there is any database similar to The World Atlas of Language Structures (WALS)(https://wals.info/). In the case that it is specifically more geared towards phonological aspects of ...
0
votes
1answer
59 views

How to find the 'average' of a word [closed]

I am trying to extract words that are similar between several documents. I would then like to extract the 'average' of the similar words Input Document 1 Document 2 ...
2
votes
0answers
33 views

Software for finding syllogisms in treebank data?

Is there treebank search software that can locate a syllogism, identifying its major and minor premises and terms? cf. Eyal Mozes, “A Deductive Database Based on Aristotelian Logic,” Journal of ...
0
votes
0answers
34 views

What do you call the process of resolving the subject of a conjunct?

I have the sentence We kick ass and take names. Running this sentence through Google's dependency parser gives: As you can see, "we" is tagged as the subject of "kick". However "we" is not tagged ...
3
votes
1answer
1k views

Are European Union parallel multilingual texts ideal for machine learning of machine translation?

Are European Union parallel multilingual texts - regulations, directives, especially the debates of European parliament - ideal for machine learning of machine translation, e.g. with neural networks? ...
0
votes
0answers
10 views

Lemmas that fit semantic restrictions of arguments in verbnet

VerbNet produces for each argument of a verb a label denoting semantic restrictions on that argument if such exist. These labels are not actual lemmas, but rather general qualities like "abstract", "...
5
votes
2answers
91 views

Can we simulate the pronunciation of sounds that we can't make?

There's certain non-filled places in the IPA chart because we physically can't pronounce them. For example, a velar trill or glottal trill. Using computers, is it possible that we could simulate how ...
1
vote
1answer
25 views

Dataset of subject-verb-object/adverb-verb/adjective-noun pairs

Does there exist a dataset which contains a list of subject-verb-object triplets or adverb-verb/adjective-noun pairs that occur within a certain (large) corpus? If not, what would be the most ...
1
vote
1answer
46 views

How can I identify Grammatical Categories in a sentence?

Please excuse the fact that I'm not an academically trained Linguist. I am working on a computer program with example sentences and their equivalents in different languages. The idea I am trying to ...
0
votes
0answers
26 views

What are the “expressive” parts of a language actually called?

Languages provide ways to express: Ordering Temporal (yesterday, today), Spatial (above, below, before, after, inside, outside, ...), Quantitative (larger, smaller,...) Relationships Spatial (...
2
votes
5answers
140 views

Algorithm for figuring out the pronunciation of a word

Wondering how we pronounce words. I feel like I learned this when I was a kid in school with all the language rules, but now I can't remember. I am trying to think about how we pronounce words. How ...
1
vote
0answers
15 views

Why does matching any root of a question to any root of potential answers gives better text understanding results?

I'm trying to find a way to prevent Intelligent Agents with Reading Comprehension and Question Answering abilities to answer question from documents from a given dataset. After dependency parsing we ...
3
votes
1answer
42 views

What is the definition of a causally coherent text?

I am trying to measure the causal coherence of text documents using NLP techniques to test a hypothesis (as far as I understand, there are different types of coherence in text but I am focusing on ...
2
votes
0answers
35 views

How to quantify and compare different ways of segmenting and transliterating (reading) a text in terms of uncertainty/leeway?

I. Let us say we have a syllabary of n symbols. II. Let us have three ways or methods of transliterating a text written using the symbols of the syllabary: The first method considers the syllabary ...
1
vote
1answer
38 views

What are the most relevant ways to store expressions in NLP?

I am trying to understand the best ways to store expressions for NLP from an exercise I received Consider the following two expressions, which have the same value. Which one will typically be ...
1
vote
0answers
14 views

Is there any detailed documentation of VerbNet's semantic representation?

In VerbNet, each frame has a semantic representation like this: cause(Agent, E) manner(during(E), directed motion, Agent) !contact(during(E), Agent, Patient) manner(end(E),forceful, Agent) ...
1
vote
0answers
37 views

Resource for getting agentive noun from verb automatically

I am trying to get (in some automated fashion) the agentive noun of a given verb. For instance we have buy, buyer sell, seller invest, investor I was wondering whether there is some resource that ...
1
vote
2answers
42 views

Corpus for simple or basic english

I'm trying to find a good, extensive corpus that uses "simple" or "basic" English, in the sense that it should be easily understandable to people who are not proficient in the English language. For ...
1
vote
1answer
39 views

What statistical test is appropriate in a corpus analysis of pronoun resolution preferences?

I have extracted data from a corpus that collected sentences with an antecedent and a next sentence with a pronoun or a stressed pronoun in subject position. Now, the anaphora can either refer back to ...
0
votes
1answer
45 views

Relationship between topics and speech acts/dialogue acts in a sentence

I am still ambiguous about the relationship between topics and speech acts/dialogue acts in a sentence. Are the topics selected as conditional on speech acts/dialogue acts (or vice versa) in a ...
2
votes
1answer
33 views

what does the average lemmatization length tell us about a body of text? [closed]

In computational linguistics or in NLP, what does the value of average lemmatized length tells us about a document?
1
vote
1answer
107 views

Bing Translate isn't same as the previous translation [duplicate]

When I translate "How to use something" in Bing Translate to Chinese, it shows "如何使用某物", but if I translate back, it will show "How to use a thing". What's the hell? When I'am translating other ...
2
votes
2answers
565 views

How can I do data augmentation for text classification?

I am working on a text classification project. Some properties of my data set: Total number of samples: 33200 Total number of classes: 1131 Class distribution is highly skewed (about 35% of the ...
0
votes
0answers
12 views

Automatic Semantic Clustering and Tagging of sentences using NLP

NLP Analysis for keyword clustering I have a set of keywords for search engines and I would like to create a python script to classify and tag them under unknown categories. To make it clear I ...
2
votes
1answer
118 views

What is the state of the art for diacritic restoration?

Diacritic restoration is a term for guessing the original form of a text, after it's been converted to ASCII in a lossy way. In Lingála, for example, writing in ASCII merges two pairs of vowels and ...
4
votes
1answer
78 views

Dependency parsing that preserves structural ambiguities?

Does a (publicly available) dependency parser exist, that either preserves structural ambiguities in its output or that allows me to generate all possible parse trees for a given input? I am ...
2
votes
0answers
52 views

What features are good for dependency parsing?

I am trying to implement a graph based dependency parser. Since I come from a computer engineering perspective, I have trouble finding the features. Assuming that we have a (head,dependent) relation ...
0
votes
1answer
33 views

What are the various approaches to detect whether a sentence is complete or not?

I was working on creating a question answering system. Now I wanted to deal with incomplete or partial sentences. So the first step to this would be detecting whether the question entered by the user ...
1
vote
1answer
39 views

Search tool question

The World Wide Web provides access to an extremely rich collection of written texts and transcriptions of dialogue from both current and historical sources. But I often have trouble searching for ...
3
votes
1answer
82 views

What language pairs are underserved, and would most benefit from machine-learned bilingual tools?

What language pairs are under-served by current resources — like human translators, bilingual dictionaries, and parallel corpuses — relative to their linguistic importance, economic potential, or ...
-3
votes
1answer
33 views

Similarity, Relatedness and Association [closed]

From the NLP point of view. what are the major differences between words synonym, similarity, relatedness and association. With examples if possible. Thank you
3
votes
0answers
116 views

What is the intuition behind the rules of Hobbs Algorithm?

I am trying to understand the Hobbs Algorithm. I am able to follow the algorithm and solve tree walking questions to find the antecedent of a pronoun, but I do not get the intuition behind the rules ...
3
votes
1answer
94 views

How to proceed with this Maasai translation?

The problem statement is as follows: Question: Indicate which translation goes with each Maasai sentence. My current approach: The word {word1} appears a total of 8 times in the Maasai sentences ...
2
votes
2answers
110 views

linguistics competitions?

Looking for Linguistics Competitions suitable for MSc or PhD students in Computational Linguistics. I don't see anything current on Kaggle, and I am looking into TREC. added: recurring preferred (...
2
votes
1answer
73 views

Do language models ignore word order in the context?

Most tutorials I've seen on language models illustrate MLE estimation by counting. For example, P("mice"|"three blind") = count("three blind mice") / count("three blind") But joint probability is ...
-2
votes
1answer
75 views

Word Lists of Various Languages [closed]

I was looking for lists of words (preferably txt files) in various languages I was looking for just lists of words without any additional data spanning as many languages as possible. Thanks