Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
2
votes
1answer
1k views

Split a sentence using nltk and python

I am working on a task which involves information extraction, for which I require splitting a complex sentence into a bunch of simple sentences. For instance, In optics a ray is an idealized model ...
1
vote
0answers
58 views

Is there a basis set of words for a language? [duplicate]

We define a word in a language using a set of other, agreed-upon words. In linear algebra, the set of basis vectors for a space are the minimum number of vectors needed to describe any other vector in ...
1
vote
2answers
43 views

How to extract specific data from a TextGrid file?

I'm new here. Just found that there is a linguistics community on stack exchange! I have a TextGrid file that has been output from a forced aligner, webMAUS and I mainly want to understand how to ...
10
votes
2answers
571 views

How to best clean a large historical corpus ridden with OCR errors

Overview: I have a very large corpus of historical news papers (17th-20th cent.). The word count is about 20 bln. It's raw OCR-ed data in txt-files of about 150 GB. One newspaper issue per file (some ...
2
votes
1answer
66 views

Non-projective tree sentences

I'm trying to generate the non-projective tree of the sentence: "A hearing is scheduled on the issue today." But with the Stanford Core NLP tool (https://corenlp.run/), I obtain a projective ...
0
votes
0answers
28 views

Automating the identification of a language grammar based on samples — is this something that is done, and what is it called?

I'm trying (not very successfully) to find research papers to help with a project. Suppose you had a relatively small sample of a target language (e.g. a bible translation) and you would like to write ...
3
votes
1answer
229 views

VerbNet semantic roles and preposition groups - how to determine matches

Using verbnet to test whether a sentence matches a frame, how does one determine whether the semantic role specified in the verbnet frame is appearing in the sentence or not? e.g. on this verbnet ...
16
votes
6answers
10k views

Convert audio recording of word to IPA representation

Are the any open source tools/software libraries to convert an audio clip to its IPA representation? If so, are they accurate? If not, why not? Here is a Gaelic word I wish to convert: Ogg format: ...
0
votes
1answer
55 views

What is the more natural parsing, the one that leads to the preferred reading of the sentence

I have those rules: and those two possible parse trees: I am asked for the next question: What is the more natural parsing, the one that leads to the preferred reading of the sentence? Can anyone ...
0
votes
0answers
43 views

Are there any theoretical properties of punctuation marks that allow to identify them without understanding the text?

Imaging that you have discovered a stone with written text in an ancient (or alien!) language that doesn't resemble any known language. Is there a way to show that some of the symbols are likely ...
4
votes
1answer
167 views

How to extract grammar rules from a language (grammar induction?) using a neural network like a LSTM

I have a simple artificial language. It has about 200 words and it has a grammar. I am trying to figure out how to learn that grammar, which I think is called grammar induction, then print those rules....
4
votes
0answers
42 views

How to incorporate sentence end marker in POS tagging with viterbi algorithm?

I am self-reading the NLP book by Dan Jurafsky. In the book, the following equation is given for incorporating the sentence end marker in the Viterbi algorithm for POS tagging. I am confused why the ...
2
votes
2answers
69 views

What is the percentage of words that are phonemically regular in english?

I know that English has a deep orthography. I am wondering whether someone could tell me what the percentage of English words are governed by regular letter-sound rules? Thank you
1
vote
1answer
1k views

Add-1 laplace smoothing for bigram implementation8

I am doing an exercise where I am determining the most likely corpus from a number of corpora when given a test sentence. I am trying to test an and-1 (laplace) smoothing model for this exercise. I ...
3
votes
1answer
131 views

How do I draw CCG derivations in LaTeX?

I have been trying to find an easy way to draw CCG derivations in Latex but nothing seems to work. I am working on a presentation, and I found this github repo but it for some reason when I try it it ...
2
votes
1answer
260 views

Jiang & Conrath when two words are the same

I would like to normalize the result of Jiang & Conrath similarity measure by dividing it by the maximum value(normally should be when both synsets are the same). I am using the implementation of ...
7
votes
1answer
352 views

Representing knowledge extracted from output of dependency parsing

I am working on a problem to represent knowledge extracted from a paragraph and rank it to produce abstractive summaries. I have implemented dependency parsing using Stanford NLP, which gives dot ...
1
vote
1answer
41 views

how to interpret probabilities of sequences given by ngram language modelling?

Question about ngram models, might be a stupid question: With ngram models, the probability of a sequence is the product of the conditional probabilities of the n-grams into which the sequence can be ...
1
vote
1answer
37 views

Is there any tool where I can effectively find some examples of a specific sound change in world's languages?

For example, I have once read about an example of the sound change g > dʐ. I need it now but I cannot find it. Is there anything like "sound change corpus" where I can effectively find ...
0
votes
0answers
248 views

ValueError: Can not squeeze dim[1], expected a dimension of 1

I want to buil a sequential LSTM model that predicts binary classification at every time step. More exactly, I want to predict an output for every paragraph in my texts (48 is the number of paragraphs)...
1
vote
0answers
33 views

Corpus of Taboo card game?

Has anyone constructed a corpus of people playing the card game Taboo, in a purely text-based setting, like a computer chat, rather than face-to-face with audio or video? The closest I've found are ...
-1
votes
1answer
75 views

Is the word “Language” in “Natural Language Processing” plural or singular, count or mass? [closed]

I want to translate the word language in the term NLP to the Arabic language. so I wonder, In Natural Language Processing, if the word language is countable or uncountable? whether it is plural or ...
0
votes
1answer
48 views

What algorithms can associate words together from texts?

What algorithms can associate words together from texts? I was wondering how this can be achieved. Thanks.
0
votes
0answers
19 views

Method in deep learning with domain specific corpus for a text classification

I'm searching a method to classify a text (5 classes) with a little corpus and which is domain specific (in pharmaceutical area). I tried some models on python like random forest or multinomial naive ...
1
vote
0answers
39 views

How to extract Subject-Verb-Object from a sentence?

Given a corpus of sentences, is there a way to extract subject-verb-object triplets? What is the state-of-art in detecting SVO triplets?
4
votes
1answer
119 views

Is it possible to produce a list of syntactic rules for a language?

I recently started a new job as an applied linguist engineer and one of the first tasks I was ask to do was to provide a list of syntactic rules that can produce French sentences (for an ...
1
vote
2answers
98 views

Is there software (eg. desktop or mobile app) out there that helps learners learn all the sounds of the world with the IPA?

I wished there was one where the app would synthesise a sound for some phoneme X, displaying the IPA symbol at the same time, then ask the user to repeat the sound, which the software checks for the ...
0
votes
2answers
167 views

Transcription of this computer-generated pronunciation of 1991 in Danish

I came across this Google Translate pronunciation of 1991 (which it appears to be interpreting as the year rather than the cardinal or ordinal); click the thumbnail for the video on YouTube: I don’t ...
1
vote
1answer
78 views

Popular book(s) recommendation for start learning Linguistics keeping an interest in the Indus Valley script in mind

Recently, I have gathered enough interest in the subject Linguistics. As I came to know that Indus Valley scripts are among the last remaining undeciphered scripts of the ancient world, I gained more ...
10
votes
1answer
274 views

What statistical methods are used to test whether a corpus of symbols is linguistic?

In their 2009 paper on the Indus Script, Rao et al. describe a test for deciding whether a corpus of symbols is in fact a collection of texts in some language. Over-simplifying a bit, the approach ...
1
vote
0answers
70 views

Automatic sentence negation

I am looking for an automatic sentence negation tool. Something that will be able to perform conversions like: "this ball is large" ---> "this ball is small" "you should ...
10
votes
4answers
2k views

Is there free and open Chinese corpus?

The corpus in NLTK sinica can be used for research. There are two shortcomings for sinica to be used in research. too small it is a traditional Chinese corpus Can someone here introduce a big and ...
4
votes
2answers
306 views

How to interpret this form of Heaps' Law?

Heaps' Law basically is an empirical function that says the number of distinct words you'll find in a document grows as a function to the length of the document. The equation given in the Wikipedia ...
5
votes
3answers
594 views

Are there tools to build domain specific corpus? [closed]

I would like to build a domain specific corpus. By this I mean a corpus from a specific knowledge area, for instance Law, Psychiatry, or Klingon language. I am currently using a Wikipedia corpus, and ...
0
votes
1answer
74 views

Is formal semantics useful for computational linguistics and NLP?

I browsed the table of content of Cann's Formal Semantics. Cann's book is for linguistics, and am I right that it is helpful for computational linguistics and natural language processing? But it also ...
1
vote
1answer
84 views

Seq2seq translation model. ValueError: An operation has `None` for gradient

So I'm trying to build a seq2seq encoder-decoder network for a translation task. I've been stuck now for a while, I have no idea how to fix the error I'm getting and would appreciate any help. My code ...
0
votes
0answers
61 views

How is the 'naturalness' of speech measured?

Aside from subjective listening tests, are there other ways of measuring the 'naturalness' of speech, especially synthetic speech? Are there specific features of the speech signal that correlate well ...
0
votes
0answers
36 views

How can I compare the grammatical complexity between two texts using their sentences dependency length?

This is a continuation to the following thread. I have two texts, common English texts such as news articles and informative texts versus a technical textbook. I want to compare the grammatical ...
4
votes
2answers
580 views

dependency or constituency treebank?

Most Treebank conversion which I found in the web are from constituency treebank to dependency treebank, I wonder why there is little works in the opposite direction? Does it mean that nowadays ...
1
vote
1answer
76 views

How to determine grammatical complexity using quantitative features?

I'm doing a research on defining the complexity of language used in technical documentations for technologies (libraries and modules) used in data science and machine learning engineering. And I'm ...
3
votes
0answers
86 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
3
votes
0answers
63 views

How to find the characteristics of a bunch of word Clusters?

My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases. Unlike ...
1
vote
1answer
41 views

Is there a website, dataset, API or NLP library which can give me the English meaning, POS and conjugated forms of a word from any major language?

Is there a website or dataset which can give me the following info all at once: (1) English meaning of a word/lexeme (2) part of speech (3) all conjugated forms of the lexeme, whether verb, noun or ...
1
vote
2answers
59 views

Is it possible to test statistical significance of difference between two distance/similarity scores?

I have a corpus consisting of tweets by men and another corpus of female tweets. I was thinking of using a word embeddings approach (e.g., glove and fasttext) and examine the cosine similarity between ...
0
votes
0answers
10 views

Searching using a set of words/tags

I’m looking for some recommendations on ways to search a set of words to find the closest result. For example: When I search against news data api like google news: {Shell, oil, gas, energy, Dutch} ...
0
votes
1answer
127 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file README.SWBD-QUERIES....
1
vote
0answers
49 views

How to find most frequent bigram letters in R [closed]

I want to find the most frequent bigram letters in a text in R. Example: text = "Hello my name is Ana" Output: "he", "ll", "om", "yn", "am", "ei" "sa" "na" Any help would be appreaicted.
2
votes
3answers
1k views

How can I do data augmentation for text classification?

I am working on a text classification project. Some properties of my data set: Total number of samples: 33200 Total number of classes: 1131 Class distribution is highly skewed (about 35% of the ...
7
votes
2answers
542 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
28
votes
3answers
6k views

Why don't you get back the original text when you use translation software to translate something into another language and then back into English?

I translated "How to use Web?" into some other language using machine translation, but after I translated the result back into English, it is not the same as the first text I put into the translator. ...

1
2 3 4 5
13