Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
2
votes
2answers
94 views

Finding phonetic similarity of names in different languages

I am trying to come up with a way using Python to find phonetic similarities between how differently written names with different meanings in different languages might sound alike. Names can be ...
0
votes
1answer
38 views

How can you computationally apply a grammar rule to a sentence?

I would like to use a rigorous and comprehensive theory of the grammar of English to formulate some grammar rule and then computationally/programmatically check whether a sentence abides by it (not as ...
0
votes
0answers
18 views

Other name for "Predeterminer"/"Noun Premodifier" Dependency Relation?

I'm reading a paper which makes use of word dependency relationships from the Stanford Dependencies (SD) list. One such relation they refer to as "Predeterminer" and "Noun Premodifer&...
0
votes
0answers
25 views

Is there any rule based algorithm that can assess whether a word has "neutral" connotation?

I would like to see a system that can convert any sentence to its most neutral phrasing. Maybe Wordnet, which is a network of related words, has this kind of semantic information inside it. However, I'...
0
votes
0answers
25 views

Vocabulary Rate for Spanish

I am searching for a resource in Spanish that contains the Spanish Vocabulary Rate, classifying words for their usage level, similar to this Italian one: Nuovo Vocabolario di Base della lingua ...
0
votes
0answers
23 views

What’s a standard contemporary algorithm for term extraction?

What is a standard algorithm for extracting likely glossary terms or key words from a source text, nowadays?
4
votes
2answers
89 views

How to define sentence complexity?

I am not a pure linguist but rather at the intersection of computational linguistics, NLP and computer science. Thus please be cautious with me and my ignorance. I am looking for definitions of ...
9
votes
2answers
628 views

Does lexeme and stem mean the same?

Wikipedia says following about lexeme: A lexeme is a unit of lexical meaning... For example, in English, run, runs, ran and running are forms of the same lexeme, which can be represented as ...
1
vote
0answers
39 views

Turing-completeness of Minimalism and HPSG

I read several times that HPSG and Minimalism are Turing-complete. Could someone explain (or tell me some references) why this is the case? And does this constitute a major problem since natural ...
0
votes
1answer
162 views

Can someone explain to me the Zipf–Mandelbrot law?

I really can't understand. It's about linguistics and I can't understand anything because there are mathematical formulas in it that I can't understand at all. Can anyone explain this with ...
1
vote
0answers
20 views

Which syntactic dependency parsers perform best on search query phrases?

Lots of NLP libraries contain syntactic dependencies parsers (e.g. spaCy, NLTK, Stanford NLP, Spark NLP...). As I understand it (please correct me if I'm wrong), these are mostly designed to parse ...
3
votes
1answer
49 views

Bilingual corpora work from the late 1980s

Does anyone know if the paper by Warwick and Russell (often cited as below) exists? I have looked on the EURALEX website and the authors are not listed as speakers in the 4th Conference. Maybe the ...
1
vote
1answer
55 views

Book suggestions for a concise introduction to computational linguistics?

I am fairly new to the field of linguistics and am looking for a book as a fairly concise basic introduction to computational linguistics (I already have some computer science background). What is a ...
0
votes
3answers
80 views

Can I simply check the unicode or UTF-8 mapping of character to infer the language?

I am given a language detection problem. I was wondering if it could be solved just by looking at the encoding map of characters used and decide which language it is. Is there too much overlap of ...
1
vote
1answer
36 views

Large parallel corpus of English and Farsi text

hope you are doing well. I am looking for a large parallel corpus of English and Farsi text, professionally written or edited. I would be more than happy to have your suggestions. Thank you all.
-1
votes
4answers
698 views

Is the way words are used the biggest obstacle in understanding science and technology? [closed]

Do I have a point to say that, in the area of science, people have difficulties understanding it mostly due to the way words are used to describe whatever it may be? One may understand the words ...
3
votes
0answers
39 views

Computer analysis of ESL learners' mistakes

This is a very broad question; I'm trying to get a sense of the current state of this subfield of NLP and what relevant resources may already exist, so even tangential answers will be welcome. To what ...
3
votes
1answer
79 views

Combinatory categorial grammar for English

I am working on theoretical NLP things, in particular to do with combinatory categorial grammar (CCG). I don't have much knowledge of CCG, or of grammar in general. I was wondering how much of English ...
0
votes
1answer
32 views

Looking for a test that produces data similar to Eye-Tracking tests

I was conducting a study about Shell Nouns and how they affect the brain. The issue was that corona came up and the university is still shut down and everything is only online. For my study I worked ...
1
vote
0answers
55 views

How to determine structure of answer for a wh- question

Consider a wh-question (in english language) such as "Who closed the door?". Personally, I can determine that an answer will look like "NP closed the door.", where NP would be a ...
1
vote
0answers
39 views

*Compact* Context-Free Grammar for English

I have seen that similar questions have been asked here, but the common answer is to look at Generalized Phrase Structure Grammar. Then, on the internet I just find slides from computational ...
1
vote
1answer
43 views

SubCategorization Frame of a verb

I am working on verbal clustering. And to train my model, I need features like SCF of the verbs. To understand what it is, I read that an SCF is a structure which gives the syntactic nature of the ...
1
vote
1answer
44 views

Is there any method to summarize and gain the big picture from an article?

Background Recently I just develop a method to summarize and find the big picture of an article, especially the ones that are so abstract and introduce too many new terms. The method is as follow: ...
1
vote
0answers
33 views

NLP methods specific to a language?

What NLP methods / algorithms depend on the features existing only in some languages? For example, does French has any NLP algorithms that English NLP and Spanish NLP do not have?
2
votes
1answer
77 views

Are there any set guidelines for the lifespan of a (spoken) corpus?

Are there any set guidelines on how long a (spoken) corpus stays relevant / is reliable to use? The only major Dutch spoken corpus is from 2004, and I was wondering if using this corpus would cause a ...
2
votes
1answer
144 views

Indo-European cognate calculator

There are Indo-European cognate pairs that are phonetically exact and regular in the sense that their phonematic make-up is completely explained by systematic application of the relevant sound rules ...
1
vote
0answers
60 views

Is there a basis set of words for a language? [duplicate]

We define a word in a language using a set of other, agreed-upon words. In linear algebra, the set of basis vectors for a space are the minimum number of vectors needed to describe any other vector in ...
1
vote
2answers
231 views

How to extract specific data from a TextGrid file?

I'm new here. Just found that there is a linguistics community on stack exchange! I have a TextGrid file that has been output from a forced aligner, webMAUS and I mainly want to understand how to ...
11
votes
2answers
599 views

How to best clean a large historical corpus ridden with OCR errors

Overview: I have a very large corpus of historical news papers (17th-20th cent.). The word count is about 20 bln. It's raw OCR-ed data in txt-files of about 150 GB. One newspaper issue per file (some ...
0
votes
0answers
33 views

Automating the identification of a language grammar based on samples -- is this something that is done, and what is it called?

I'm trying (not very successfully) to find research papers to help with a project. Suppose you had a relatively small sample of a target language (e.g. a bible translation) and you would like to write ...
0
votes
1answer
66 views

What is the more natural parsing, the one that leads to the preferred reading of the sentence

I have those rules: and those two possible parse trees: I am asked for the next question: What is the more natural parsing, the one that leads to the preferred reading of the sentence? Can anyone ...
1
vote
2answers
118 views

What is the percentage of words that are phonemically regular in english?

I know that English has a deep orthography. I am wondering whether someone could tell me what the percentage of English words are governed by regular letter-sound rules? Thank you
3
votes
0answers
49 views

How to incorporate sentence end marker in POS tagging with viterbi algorithm?

I am self-reading the NLP book by Dan Jurafsky. In the book, the following equation is given for incorporating the sentence end marker in the Viterbi algorithm for POS tagging. I am confused why the ...
1
vote
1answer
68 views

how to interpret probabilities of sequences given by ngram language modelling?

Question about ngram models, might be a stupid question: With ngram models, the probability of a sequence is the product of the conditional probabilities of the n-grams into which the sequence can be ...
1
vote
1answer
47 views

Is there any tool where I can effectively find some examples of a specific sound change in world's languages?

For example, I have once read about an example of the sound change g > dʐ. I need it now but I cannot find it. Is there anything like "sound change corpus" where I can effectively find ...
0
votes
0answers
1k views

ValueError: Can not squeeze dim[1], expected a dimension of 1

I want to buil a sequential LSTM model that predicts binary classification at every time step. More exactly, I want to predict an output for every paragraph in my texts (48 is the number of paragraphs)...
1
vote
0answers
38 views

Corpus of Taboo card game?

Has anyone constructed a corpus of people playing the card game Taboo, in a purely text-based setting, like a computer chat, rather than face-to-face with audio or video? The closest I've found are ...
-1
votes
1answer
109 views

Is the word "Language" in "Natural Language Processing" plural or singular, count or mass? [closed]

I want to translate the word language in the term NLP to the Arabic language. so I wonder, In Natural Language Processing, if the word language is countable or uncountable? whether it is plural or ...
0
votes
1answer
54 views

What algorithms can associate words together from texts?

What algorithms can associate words together from texts? I was wondering how this can be achieved. Thanks.
1
vote
1answer
170 views

How to extract Subject-Verb-Object from a sentence?

Given a corpus of sentences, is there a way to extract subject-verb-object triplets? What is the state-of-art in detecting SVO triplets?
4
votes
1answer
137 views

Is it possible to produce a list of syntactic rules for a language?

I recently started a new job as an applied linguist engineer and one of the first tasks I was ask to do was to provide a list of syntactic rules that can produce French sentences (for an ...
1
vote
0answers
137 views

Automatic sentence negation

I am looking for an automatic sentence negation tool. Something that will be able to perform conversions like: "this ball is large" ---> "this ball is small" "you should ...
1
vote
1answer
99 views

Popular book(s) recommendation for start learning Linguistics keeping an interest in the Indus Valley script in mind

Recently, I have gathered enough interest in the subject Linguistics. As I came to know that Indus Valley scripts are among the last remaining undeciphered scripts of the ancient world, I gained more ...
0
votes
1answer
103 views

Is formal semantics useful for computational linguistics and NLP?

I browsed the table of content of Cann's Formal Semantics. Cann's book is for linguistics, and am I right that it is helpful for computational linguistics and natural language processing? But it also ...
1
vote
1answer
101 views

Seq2seq translation model. ValueError: An operation has `None` for gradient

So I'm trying to build a seq2seq encoder-decoder network for a translation task. I've been stuck now for a while, I have no idea how to fix the error I'm getting and would appreciate any help. My code ...
1
vote
1answer
100 views

How to determine grammatical complexity using quantitative features?

I'm doing a research on defining the complexity of language used in technical documentations for technologies (libraries and modules) used in data science and machine learning engineering. And I'm ...
3
votes
0answers
92 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
2
votes
0answers
74 views

How to find the characteristics of a bunch of word Clusters?

My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases. Unlike ...
1
vote
1answer
59 views

Is there a website, dataset, API or NLP library which can give me the English meaning, POS and conjugated forms of a word from any major language?

Is there a website or dataset which can give me the following info all at once: (1) English meaning of a word/lexeme (2) part of speech (3) all conjugated forms of the lexeme, whether verb, noun or ...
1
vote
2answers
69 views

Is it possible to test statistical significance of difference between two distance/similarity scores?

I have a corpus consisting of tweets by men and another corpus of female tweets. I was thinking of using a word embeddings approach (e.g., glove and fasttext) and examine the cosine similarity between ...

1
2 3 4 5
13