Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
1
vote
1answer
47 views

Seq2seq translation model. ValueError: An operation has `None` for gradient

So I'm trying to build a seq2seq encoder-decoder network for a translation task. I've been stuck now for a while, I have no idea how to fix the error I'm getting and would appreciate any help. My code ...
-1
votes
0answers
53 views

Question about alphabetical order [migrated]

The Wikipedia entry about "Alphabetical order", says: To determine which of two strings of characters comes first when arranging in alphabetical order, their first letters are compared. If ...
0
votes
0answers
28 views

How can I compare the grammatical complexity between two texts using their sentences dependency length?

This is a continuation to the following thread. I have two texts, common English texts such as news articles and informative texts versus a technical textbook. I want to compare the grammatical ...
0
votes
0answers
54 views

How is the 'naturalness' of speech measured?

Aside from subjective listening tests, are there other ways of measuring the 'naturalness' of speech, especially synthetic speech? Are there specific features of the speech signal that correlate well ...
1
vote
1answer
64 views

How to determine grammatical complexity using quantitative features?

I'm doing a research on defining the complexity of language used in technical documentations for technologies (libraries and modules) used in data science and machine learning engineering. And I'm ...
3
votes
0answers
69 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
2
votes
0answers
54 views

How to find the characteristics of a bunch of word Clusters?

My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases. Unlike ...
1
vote
1answer
40 views

Is there a website, dataset, API or NLP library which can give me the English meaning, POS and conjugated forms of a word from any major language?

Is there a website or dataset which can give me the following info all at once: (1) English meaning of a word/lexeme (2) part of speech (3) all conjugated forms of the lexeme, whether verb, noun or ...
1
vote
2answers
51 views

Is it possible to test statistical significance of difference between two distance/similarity scores?

I have a corpus consisting of tweets by men and another corpus of female tweets. I was thinking of using a word embeddings approach (e.g., glove and fasttext) and examine the cosine similarity between ...
0
votes
0answers
9 views

Searching using a set of words/tags

I’m looking for some recommendations on ways to search a set of words to find the closest result. For example: When I search against news data api like google news: {Shell, oil, gas, energy, Dutch} ...
1
vote
0answers
39 views

How to find most frequent bigram letters in R [closed]

I want to find the most frequent bigram letters in a text in R. Example: text = "Hello my name is Ana" Output: "he", "ll", "om", "yn", "am", "ei" "sa" "na" Any help would be appreaicted.
1
vote
1answer
62 views

What branch in computational linguistics should I study if I am interested in machine translation?

I am graduate student and I am doing a Master of Translation and interpretation Arabic English. I need to pursue study in machine translation but I do not know where exactly to start, NLP, ...
1
vote
1answer
39 views

Non-projective tree sentences

I'm trying to generate the non-projective tree of the sentence: "A hearing is scheduled on the issue today." But with the Stanford Core NLP tool (https://corenlp.run/), I obtain a projective ...
1
vote
0answers
21 views

Why should we assign the head to a word as early as possible in shift-reduce dependency parsing?

This is about dependency parsing. The operation set of a shift-reduce parser was changed so that an arc is added as early as possible. It's claimed that "the longer a word has to wait to get assigned ...
0
votes
0answers
17 views

About Feature Engineering Tips When “discriminative algorithm care about no modeling the probability of the language”

I was going over my old NLP course slides and one of the pages is about using Structured Perceptron for tagging. It claims that because the algorithm is discriminative, it doesn't care about modeling ...
1
vote
0answers
41 views

Determining the semantic “complexity” of a grammar computationally from text

I'm working on a computational text analysis project which uses ngram data from journal articles, and I'm trying to find a way to measure some aspect of the semantic "complexity" of the grammar in one ...
6
votes
1answer
58 views

What does 'MSP' stand for in the context of Chinese parts of speech?

The Part-Of-Speech Tagging Guidelines for the PennChineseTreebank(3.0) uses several acronyms without defining them. I am a hobbyist student of Chinese linguistics as part of my study of Chinese. I ...
0
votes
1answer
53 views

Checking Definitions for Self-Consistency and Cycles

I am building a "self-contained" set of definitions, and would like to ensure that the definitions: Do not contain circular definitions (which might include other words within that cycle, not just a ...
0
votes
1answer
63 views

Is there software (eg. desktop or mobile app) out there that helps learners learn all the sounds of the world with the IPA?

I wished there was one where the app would synthesise a sound for some phoneme X, displaying the IPA symbol at the same time, then ask the user to repeat the sound, which the software checks for the ...
0
votes
0answers
25 views

Can levels of nesting in conjunctions be unambiguously systematically parsed?

This question on NLP asks for the how of parsing, and the given answer shows how the state-of-the-art isn't at that level. But whether this is a hard problem or not is not my question: what I ask is, ...
2
votes
2answers
82 views

Similar term as phonetics, but for written text

I try to find any term that can specify a descriptive field of study that is interested in language notation. It should contain parts of written text (general text form - not only handwritten): ...
2
votes
2answers
234 views

How to find most common expressions starting with “iron”?

I want to find a list of 2-word expressions starting with iron: i.e. ironing board, iron filings, iron bridge Can you suggest a vocabulary tool for that?
2
votes
1answer
185 views

Is Hebrew a language which can be transliterated programmatically according to a small set of clear rules?

English transliteration seems to require understanding the meaning of the expression you are transliterating. Anything that requires human-level intelligence to parse the sentence for transliteration/...
1
vote
0answers
43 views

Stance Detection with Dependencies Tree and POS Tagging

I'm working on a thing at the moment and I'm trying to do what's basically written on the title of this post. Disclaimer: I'm not trying to get my job done by others. Just share ideas and gathering ...
3
votes
1answer
130 views

How to extract grammar rules from a language (grammar induction?) using a neural network like a LSTM

I have a simple artificial language. It has about 200 words and it has a grammar. I am trying to figure out how to learn that grammar, which I think is called grammar induction, then print those rules....
2
votes
0answers
38 views

Word alignment for Switchboard Dialogue Acts Corpus

I am trying to connect the dialogue acts of the Switchboard Dialogue Acts Corpus with the word alignment timing information available here. I can see how it is possible to match up every utterance ...
-1
votes
4answers
223 views

Are natural languages turing complete? [closed]

Motivated by: Is there a linguistics equivalent to Turing completeness? Can be natural languages be considered turing complete? Surely on the day to day basis there is a lot of ambiguity that mainly ...
0
votes
0answers
24 views

Appropriate language models to use on dialogue/conversational language

I have used the Google LM 1B corpus in the past for testing written language, e.g. other periodicals. However, I'm now using text from an IM chat, which is conversational. I would like to measure ...
0
votes
0answers
14 views

Are there any publicly available NLG systems with controlled vocabularies?

I think it could be cool to practice a language (especially as a beginner) with NLG generated texts (OpenAI’s GPT-2 produces impressive texts) which have controlled vocabularies - for example, limited ...
0
votes
0answers
24 views

Abstractive Summarization, simple models

I should examine how different models for abstractive summarization generalize. The plan is to train them with different training data and observe how the summarizations produced are affected by this. ...
1
vote
1answer
299 views

Lexeme vs. Lemma

A lexeme to me has always been a fairly abstract entity and a lemma a concrete form that is often used to represent an lexeme. It is surprising to me, then, that the process in NLP is almost always ...
0
votes
1answer
42 views

Multiple elongations in English Dataset

I am studying different research works in Authorship analysis from English data set. I have some features which can be a great tool for authorship analysis. Some of the common features are: Total ...
0
votes
0answers
14 views

NLP/Computer linguistic : Difference between knowledge based approaches and superficially Text Summarization Methods and examples

irst of all, sorry for my bad English. What the Main difference between such two approaches ? And what makes a system or a Textsummarization-Approach Knowledge based? Is it based on the inner work of ...
0
votes
0answers
49 views

Complex/Compund sentence to simple Spacy

I want to use Spacy and Python and convert a sentence to simple one irrespective being a complex or a compound sentence.
0
votes
0answers
21 views

Automated Verb Correction for Subject Agreement Using Penn Treebank Tags

I'm working on a software method to correct the verb in an English sentence based on the subject count (singular or plural) and using a corpus of verbs tagged with their Penn Treebank Tags. (I have ...
0
votes
1answer
58 views

Indo-European Etymological Dictionaries Online database (by Brill, Leiden University)

The Indo-European Etymological Dictionaries Online database (by Brill) already includes eleven dictionaries https://linguistics.stackexchange.com/a/6356/22504 I've read about this "database" before. ...
6
votes
1answer
49 views

Corpus of English sentences written by non-native speakers?

I am working on a hobby project which tends to help the non-native speakers figure out if the sentences they write are good enough and sounds like written by English native speakers. Any relevant info ...
2
votes
1answer
86 views

How do I draw CCG derivations in LaTeX?

I have been trying to find an easy way to draw CCG derivations in Latex but nothing seems to work. I am working on a presentation, and I found this github repo but it for some reason when I try it it ...
0
votes
3answers
40 views

Which is the most recommended corpus for training a POS Tagger?

The tagger is for English and I will use the universal dependency tag set. I am looking for a corpus that best represents nowadays English.
0
votes
0answers
25 views

What English corpus for syntactic parsing should I work with?

I'm working on a syntactic parser (constituent structure based) and I need a corpus with just sentences, not phrases. What corpus should I use? Is there a corpus tagged with the Universal Dependency ...
0
votes
0answers
37 views

Annotating the vocabulary using Word2vec model

I am trying to annotate the vocabulary in the corpus. I have trained the word2vec model on the corpus I have grouped the words which are related based on the score as key as the first word as the key ...
1
vote
1answer
47 views

Comparing corpora

So first, a disclaimer: I'm less than beginner level in everything that has to do with programming. I'm analysing the occurrences of English code-switching/translanguaging in a particular Polish-...
-1
votes
1answer
60 views

Is there specific grammar used in Newspaper headlines?

I need to find some general rules used in Newspaper headlines. I will use computational linguistics (nltk python library) to develop classification algorithm to distinguish news and not news by ...
3
votes
3answers
515 views

Relationship between complexity of a sentence and the average distance between the tokens in which we relate

I am a PhD student in Statistics and I need more understandings in Linguistics for my PhD research. Say we are given two sentences of SAME LENGTH -- sentence A and B. Sentence A is simple (simple ...
3
votes
3answers
107 views

What is a good introduction to formal language theory for linguistics?

I know formal languages are widely used in linguistics, especially for computational linguistics. However, I do not understand where this connection started - Wikipedia says that formal language ...
2
votes
2answers
125 views

Context-Free grammars and Language

As someone trained in neither, how could you explain the analogies between context free grammars / languages and certain programming languages in computer science? Have I misunderstood whether there ...
2
votes
0answers
69 views

Addressing the problem of symmetry in metric space based representations of words in computational linguistics

In the field of computational linguistics it's very common to represent words / sentences/ etc as mathematical objects and then use said representations to elicit certain linguistic tasks. The most ...
0
votes
1answer
132 views

Find the 5 most-different-from-each other adjectives in the English language

I am trying to find a set of N common adjectives that are the least-used with each other in English. TLDR: Basically if you were creating a new language that was only going to have N adjectives and ...
1
vote
0answers
123 views

What semantic frameworks are there for computational linguistics?

Besides Frege's principle of compositionality are there any other philosophical frameworks of language to form distributional semantics in the English language? Edit - Although I'm still yet to ...
6
votes
1answer
76 views

How to make a Corpus? (selecting a good structure)

I'm making a Corpus. I have searched for good practices on how to build it. I've downloaded some Corpus to check their internal structure and the extension file, but I didn't find many. So, I am lost ...

1
2 3 4 5
12