Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
3
votes
0answers
36 views

How can I calculate the morphological similarity between sentences?

For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences. To get those aspects I use datasets that are annotated for semantic ...
2
votes
0answers
54 views

How to find the characteristics of a bunch of word Clusters?

My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases. Unlike ...
1
vote
1answer
39 views

Is there a website, dataset, API or NLP library which can give me the English meaning, POS and conjugated forms of a word from any major language?

Is there a website or dataset which can give me the following info all at once: (1) English meaning of a word/lexeme (2) part of speech (3) all conjugated forms of the lexeme, whether verb, noun or ...
1
vote
2answers
50 views

Is it possible to test statistical significance of difference between two distance/similarity scores?

I have a corpus consisting of tweets by men and another corpus of female tweets. I was thinking of using a word embeddings approach (e.g., glove and fasttext) and examine the cosine similarity between ...
0
votes
0answers
9 views

Searching using a set of words/tags

I’m looking for some recommendations on ways to search a set of words to find the closest result. For example: When I search against news data api like google news: {Shell, oil, gas, energy, Dutch} ...
1
vote
0answers
38 views

How to find most frequent bigram letters in R [closed]

I want to find the most frequent bigram letters in a text in R. Example: text = "Hello my name is Ana" Output: "he", "ll", "om", "yn", "am", "ei" "sa" "na" Any help would be appreaicted.
1
vote
1answer
61 views

What branch in computational linguistics should I study if I am interested in machine translation?

I am graduate student and I am doing a Master of Translation and interpretation Arabic English. I need to pursue study in machine translation but I do not know where exactly to start, NLP, ...
1
vote
0answers
27 views

What's origin of word “br” in Yemeni accent?

Hello everyone What's etymology of (ber بر )in Yemeni accent that mean light of moon ? I find nearest words in Egyptian dictionary and amhra refer to light but in fus7a classic Arabic nearst to it ...
1
vote
1answer
39 views

Non-projective tree sentences

I'm trying to generate the non-projective tree of the sentence: "A hearing is scheduled on the issue today." But with the Stanford Core NLP tool (https://corenlp.run/), I obtain a projective ...
1
vote
0answers
21 views

Why should we assign the head to a word as early as possible in shift-reduce dependency parsing?

This is about dependency parsing. The operation set of a shift-reduce parser was changed so that an arc is added as early as possible. It's claimed that "the longer a word has to wait to get assigned ...
0
votes
0answers
17 views

About Feature Engineering Tips When “discriminative algorithm care about no modeling the probability of the language”

I was going over my old NLP course slides and one of the pages is about using Structured Perceptron for tagging. It claims that because the algorithm is discriminative, it doesn't care about modeling ...
1
vote
0answers
40 views

Determining the semantic “complexity” of a grammar computationally from text

I'm working on a computational text analysis project which uses ngram data from journal articles, and I'm trying to find a way to measure some aspect of the semantic "complexity" of the grammar in one ...
6
votes
1answer
56 views

What does 'MSP' stand for in the context of Chinese parts of speech?

The Part-Of-Speech Tagging Guidelines for the PennChineseTreebank(3.0) uses several acronyms without defining them. I am a hobbyist student of Chinese linguistics as part of my study of Chinese. I ...
0
votes
1answer
52 views

Checking Definitions for Self-Consistency and Cycles

I am building a "self-contained" set of definitions, and would like to ensure that the definitions: Do not contain circular definitions (which might include other words within that cycle, not just a ...
0
votes
1answer
63 views

Is there software (eg. desktop or mobile app) out there that helps learners learn all the sounds of the world with the IPA?

I wished there was one where the app would synthesise a sound for some phoneme X, displaying the IPA symbol at the same time, then ask the user to repeat the sound, which the software checks for the ...
0
votes
0answers
24 views

Can levels of nesting in conjunctions be unambiguously systematically parsed?

This question on NLP asks for the how of parsing, and the given answer shows how the state-of-the-art isn't at that level. But whether this is a hard problem or not is not my question: what I ask is, ...
2
votes
2answers
81 views

Similar term as phonetics, but for written text

I try to find any term that can specify a descriptive field of study that is interested in language notation. It should contain parts of written text (general text form - not only handwritten): ...
2
votes
2answers
234 views

How to find most common expressions starting with “iron”?

I want to find a list of 2-word expressions starting with iron: i.e. ironing board, iron filings, iron bridge Can you suggest a vocabulary tool for that?
2
votes
1answer
180 views

Is Hebrew a language which can be transliterated programmatically according to a small set of clear rules?

English transliteration seems to require understanding the meaning of the expression you are transliterating. Anything that requires human-level intelligence to parse the sentence for transliteration/...
1
vote
0answers
43 views

Stance Detection with Dependencies Tree and POS Tagging

I'm working on a thing at the moment and I'm trying to do what's basically written on the title of this post. Disclaimer: I'm not trying to get my job done by others. Just share ideas and gathering ...
4
votes
1answer
100 views

How to extract grammar rules from a language (grammar induction?) using a neural network like a LTSM

I have a simple artificial language. It has about 200 words and it has a grammar. I am trying to figure out how to learn that grammar, which I think is called grammar induction, then print those rules....
2
votes
0answers
38 views

Word alignment for Switchboard Dialogue Acts Corpus

I am trying to connect the dialogue acts of the Switchboard Dialogue Acts Corpus with the word alignment timing information available here. I can see how it is possible to match up every utterance ...
-1
votes
4answers
216 views

Are natural languages turing complete? [closed]

Motivated by: Is there a linguistics equivalent to Turing completeness? Can be natural languages be considered turing complete? Surely on the day to day basis there is a lot of ambiguity that mainly ...
0
votes
0answers
24 views

Appropriate language models to use on dialogue/conversational language

I have used the Google LM 1B corpus in the past for testing written language, e.g. other periodicals. However, I'm now using text from an IM chat, which is conversational. I would like to measure ...
0
votes
0answers
14 views

Are there any publicly available NLG systems with controlled vocabularies?

I think it could be cool to practice a language (especially as a beginner) with NLG generated texts (OpenAI’s GPT-2 produces impressive texts) which have controlled vocabularies - for example, limited ...
0
votes
0answers
24 views

Abstractive Summarization, simple models

I should examine how different models for abstractive summarization generalize. The plan is to train them with different training data and observe how the summarizations produced are affected by this. ...
1
vote
1answer
272 views

Lexeme vs. Lemma

A lexeme to me has always been a fairly abstract entity and a lemma a concrete form that is often used to represent an lexeme. It is surprising to me, then, that the process in NLP is almost always ...
0
votes
1answer
42 views

Multiple elongations in English Dataset

I am studying different research works in Authorship analysis from English data set. I have some features which can be a great tool for authorship analysis. Some of the common features are: Total ...
0
votes
0answers
13 views

NLP/Computer linguistic : Difference between knowledge based approaches and superficially Text Summarization Methods and examples

irst of all, sorry for my bad English. What the Main difference between such two approaches ? And what makes a system or a Textsummarization-Approach Knowledge based? Is it based on the inner work of ...
0
votes
0answers
46 views

Complex/Compund sentence to simple Spacy

I want to use Spacy and Python and convert a sentence to simple one irrespective being a complex or a compound sentence.
0
votes
0answers
21 views

Automated Verb Correction for Subject Agreement Using Penn Treebank Tags

I'm working on a software method to correct the verb in an English sentence based on the subject count (singular or plural) and using a corpus of verbs tagged with their Penn Treebank Tags. (I have ...
0
votes
1answer
58 views

Indo-European Etymological Dictionaries Online database (by Brill, Leiden University)

The Indo-European Etymological Dictionaries Online database (by Brill) already includes eleven dictionaries https://linguistics.stackexchange.com/a/6356/22504 I've read about this "database" before. ...
6
votes
1answer
49 views

Corpus of English sentences written by non-native speakers?

I am working on a hobby project which tends to help the non-native speakers figure out if the sentences they write are good enough and sounds like written by English native speakers. Any relevant info ...
2
votes
1answer
85 views

How do I draw CCG derivations in LaTeX?

I have been trying to find an easy way to draw CCG derivations in Latex but nothing seems to work. I am working on a presentation, and I found this github repo but it for some reason when I try it it ...
0
votes
3answers
39 views

Which is the most recommended corpus for training a POS Tagger?

The tagger is for English and I will use the universal dependency tag set. I am looking for a corpus that best represents nowadays English.
0
votes
0answers
25 views

What English corpus for syntactic parsing should I work with?

I'm working on a syntactic parser (constituent structure based) and I need a corpus with just sentences, not phrases. What corpus should I use? Is there a corpus tagged with the Universal Dependency ...
0
votes
0answers
37 views

Annotating the vocabulary using Word2vec model

I am trying to annotate the vocabulary in the corpus. I have trained the word2vec model on the corpus I have grouped the words which are related based on the score as key as the first word as the key ...
1
vote
1answer
46 views

Comparing corpora

So first, a disclaimer: I'm less than beginner level in everything that has to do with programming. I'm analysing the occurrences of English code-switching/translanguaging in a particular Polish-...
-1
votes
1answer
60 views

Is there specific grammar used in Newspaper headlines?

I need to find some general rules used in Newspaper headlines. I will use computational linguistics (nltk python library) to develop classification algorithm to distinguish news and not news by ...
3
votes
3answers
508 views

Relationship between complexity of a sentence and the average distance between the tokens in which we relate

I am a PhD student in Statistics and I need more understandings in Linguistics for my PhD research. Say we are given two sentences of SAME LENGTH -- sentence A and B. Sentence A is simple (simple ...
3
votes
3answers
105 views

What is a good introduction to formal language theory for linguistics?

I know formal languages are widely used in linguistics, especially for computational linguistics. However, I do not understand where this connection started - Wikipedia says that formal language ...
2
votes
2answers
123 views

Context-Free grammars and Language

As someone trained in neither, how could you explain the analogies between context free grammars / languages and certain programming languages in computer science? Have I misunderstood whether there ...
2
votes
0answers
69 views

Addressing the problem of symmetry in metric space based representations of words in computational linguistics

In the field of computational linguistics it's very common to represent words / sentences/ etc as mathematical objects and then use said representations to elicit certain linguistic tasks. The most ...
0
votes
1answer
132 views

Find the 5 most-different-from-each other adjectives in the English language

I am trying to find a set of N common adjectives that are the least-used with each other in English. TLDR: Basically if you were creating a new language that was only going to have N adjectives and ...
1
vote
0answers
123 views

What semantic frameworks are there for computational linguistics?

Besides Frege's principle of compositionality are there any other philosophical frameworks of language to form distributional semantics in the English language? Edit - Although I'm still yet to ...
6
votes
1answer
74 views

How to make a Corpus? (selecting a good structure)

I'm making a Corpus. I have searched for good practices on how to build it. I've downloaded some Corpus to check their internal structure and the extension file, but I didn't find many. So, I am lost ...
-5
votes
3answers
130 views

What is the 'best' language, and by what metrics, why those metrics…? [closed]

This is sort of the old question that you'd see whispered about a lot in Western academia, and shouted out by linguists of the past, who had their own circumstances, own canons, own less-connected (?) ...
3
votes
0answers
51 views

State of the art in controlled english languages?

https://en.wikipedia.org/wiki/Controlled_natural_language lists some controlled languages, of which Attempto Controlled English seems to be the most recent. However, are there any Attempto extensions, ...
2
votes
0answers
51 views

Is there a theorem for the completeness of a language? [duplicate]

In computer science, there is a theorem that says any machine able to perform six basic primitives can compute any computable problem. Is there a similar theorem in linguistics that specifies certain ...
0
votes
0answers
60 views

How to classify Compound Strings?

My team and I have been working on a project that involves classifying different strings in a text, or more specifically, Wikipedia Infoboxes. For example, Barack Obama would be classified as a ...

1
2 3 4 5
12