Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
2
votes
0answers
54 views

How to find the characteristics of a bunch of word Clusters?

My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases. Unlike ...
1
vote
1answer
39 views

Is there a website, dataset, API or NLP library which can give me the English meaning, POS and conjugated forms of a word from any major language?

Is there a website or dataset which can give me the following info all at once: (1) English meaning of a word/lexeme (2) part of speech (3) all conjugated forms of the lexeme, whether verb, noun or ...
1
vote
1answer
39 views

Non-projective tree sentences

I'm trying to generate the non-projective tree of the sentence: "A hearing is scheduled on the issue today." But with the Stanford Core NLP tool (https://corenlp.run/), I obtain a projective ...
1
vote
2answers
50 views

Is it possible to test statistical significance of difference between two distance/similarity scores?

I have a corpus consisting of tweets by men and another corpus of female tweets. I was thinking of using a word embeddings approach (e.g., glove and fasttext) and examine the cosine similarity between ...
0
votes
0answers
9 views

Searching using a set of words/tags

I’m looking for some recommendations on ways to search a set of words to find the closest result. For example: When I search against news data api like google news: {Shell, oil, gas, energy, Dutch} ...
0
votes
1answer
126 views

Switchboard queries with NXT (the TEXT function)

The NXT query language includes the query function TEXT, which should return the textual content of the variable it applies to. In theory, Switchboard should support this. The file README.SWBD-QUERIES....
1
vote
0answers
36 views

How to find most frequent bigram letters in R [closed]

I want to find the most frequent bigram letters in a text in R. Example: text = "Hello my name is Ana" Output: "he", "ll", "om", "yn", "am", "ei" "sa" "na" Any help would be appreaicted.
0
votes
2answers
124 views

Transcription of this computer-generated pronunciation of 1991 in Danish

I came across this Google Translate pronunciation of 1991 (which it appears to be interpreting as the year rather than the cardinal or ordinal); click the thumbnail for the video on YouTube: I don’t ...
0
votes
1answer
63 views

Is there software (eg. desktop or mobile app) out there that helps learners learn all the sounds of the world with the IPA?

I wished there was one where the app would synthesise a sound for some phoneme X, displaying the IPA symbol at the same time, then ask the user to repeat the sound, which the software checks for the ...
2
votes
3answers
1k views

How can I do data augmentation for text classification?

I am working on a text classification project. Some properties of my data set: Total number of samples: 33200 Total number of classes: 1131 Class distribution is highly skewed (about 35% of the ...
6
votes
2answers
490 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
28
votes
3answers
6k views

Why don't you get back the original text when you use translation software to translate something into another language and then back into English?

I translated "How to use Web?" into some other language using machine translation, but after I translated the result back into English, it is not the same as the first text I put into the translator. ...
1
vote
1answer
61 views

What branch in computational linguistics should I study if I am interested in machine translation?

I am graduate student and I am doing a Master of Translation and interpretation Arabic English. I need to pursue study in machine translation but I do not know where exactly to start, NLP, ...
1
vote
0answers
27 views

What's origin of word “br” in Yemeni accent?

Hello everyone What's etymology of (ber بر )in Yemeni accent that mean light of moon ? I find nearest words in Egyptian dictionary and amhra refer to light but in fus7a classic Arabic nearst to it ...
1
vote
0answers
20 views

Why should we assign the head to a word as early as possible in shift-reduce dependency parsing?

This is about dependency parsing. The operation set of a shift-reduce parser was changed so that an arc is added as early as possible. It's claimed that "the longer a word has to wait to get assigned ...
0
votes
0answers
17 views

About Feature Engineering Tips When “discriminative algorithm care about no modeling the probability of the language”

I was going over my old NLP course slides and one of the pages is about using Structured Perceptron for tagging. It claims that because the algorithm is discriminative, it doesn't care about modeling ...
1
vote
0answers
40 views

Determining the semantic “complexity” of a grammar computationally from text

I'm working on a computational text analysis project which uses ngram data from journal articles, and I'm trying to find a way to measure some aspect of the semantic "complexity" of the grammar in one ...
6
votes
1answer
56 views

What does 'MSP' stand for in the context of Chinese parts of speech?

The Part-Of-Speech Tagging Guidelines for the PennChineseTreebank(3.0) uses several acronyms without defining them. I am a hobbyist student of Chinese linguistics as part of my study of Chinese. I ...
1
vote
1answer
589 views

Add-1 laplace smoothing for bigram implementation8

I am doing an exercise where I am determining the most likely corpus from a number of corpora when given a test sentence. I am trying to test an and-1 (laplace) smoothing model for this exercise. I ...
2
votes
1answer
85 views

How do I draw CCG derivations in LaTeX?

I have been trying to find an easy way to draw CCG derivations in Latex but nothing seems to work. I am working on a presentation, and I found this github repo but it for some reason when I try it it ...
7
votes
1answer
586 views

How can I calculate if the difference between two word frequencies in one corpus is significant?

I want to study orthographical variants, for example: Can firefighter and fire-fighter be considered orthographical variants (i.e. the difference in frequency in a corpus is not statistically ...
2
votes
2answers
144 views

Center of a set of words

Is there any available algorithm that can take a set of words and attempt to find a word that best represents the "center of mass" of all those words? This would be easy if we can define a distance ...
0
votes
3answers
39 views

Which is the most recommended corpus for training a POS Tagger?

The tagger is for English and I will use the universal dependency tag set. I am looking for a corpus that best represents nowadays English.
0
votes
1answer
52 views

Checking Definitions for Self-Consistency and Cycles

I am building a "self-contained" set of definitions, and would like to ensure that the definitions: Do not contain circular definitions (which might include other words within that cycle, not just a ...
0
votes
1answer
209 views

Jiang & Conrath when two words are the same

I would like to normalize the result of Jiang & Conrath similarity measure by dividing it by the maximum value(normally should be when both synsets are the same). I am using the implementation of ...
7
votes
1answer
314 views

Representing knowledge extracted from output of dependency parsing

I am working on a problem to represent knowledge extracted from a paragraph and rank it to produce abstractive summaries. I have implemented dependency parsing using Stanford NLP, which gives dot ...
2
votes
2answers
81 views

Similar term as phonetics, but for written text

I try to find any term that can specify a descriptive field of study that is interested in language notation. It should contain parts of written text (general text form - not only handwritten): ...
0
votes
0answers
24 views

Can levels of nesting in conjunctions be unambiguously systematically parsed?

This question on NLP asks for the how of parsing, and the given answer shows how the state-of-the-art isn't at that level. But whether this is a hard problem or not is not my question: what I ask is, ...
4
votes
1answer
100 views

How to extract grammar rules from a language (grammar induction?) using a neural network like a LTSM

I have a simple artificial language. It has about 200 words and it has a grammar. I am trying to figure out how to learn that grammar, which I think is called grammar induction, then print those rules....
4
votes
2answers
6k views

A comprehensive list of conceptual metaphors

Is there a comprehensive list of conceptual metaphors? (Either man-made, crowdsourced or based on data-mining / corpora analysis.) By a conceptual metaphor I mean a relation in the spirit of George ...
2
votes
2answers
234 views

How to find most common expressions starting with “iron”?

I want to find a list of 2-word expressions starting with iron: i.e. ironing board, iron filings, iron bridge Can you suggest a vocabulary tool for that?
2
votes
1answer
180 views

Is Hebrew a language which can be transliterated programmatically according to a small set of clear rules?

English transliteration seems to require understanding the meaning of the expression you are transliterating. Anything that requires human-level intelligence to parse the sentence for transliteration/...
1
vote
0answers
43 views

Stance Detection with Dependencies Tree and POS Tagging

I'm working on a thing at the moment and I'm trying to do what's basically written on the title of this post. Disclaimer: I'm not trying to get my job done by others. Just share ideas and gathering ...
2
votes
2answers
123 views

Context-Free grammars and Language

As someone trained in neither, how could you explain the analogies between context free grammars / languages and certain programming languages in computer science? Have I misunderstood whether there ...
17
votes
4answers
36k views

Automated French/Italian/German to IPA transcription

I'm looking for a website or software that will take text written in a source language and produce a transcription in IPA. The languages I am interested in are French, Italian and German, but if you ...
2
votes
0answers
38 views

Word alignment for Switchboard Dialogue Acts Corpus

I am trying to connect the dialogue acts of the Switchboard Dialogue Acts Corpus with the word alignment timing information available here. I can see how it is possible to match up every utterance ...
-1
votes
4answers
215 views

Are natural languages turing complete? [closed]

Motivated by: Is there a linguistics equivalent to Turing completeness? Can be natural languages be considered turing complete? Surely on the day to day basis there is a lot of ambiguity that mainly ...
0
votes
0answers
24 views

Appropriate language models to use on dialogue/conversational language

I have used the Google LM 1B corpus in the past for testing written language, e.g. other periodicals. However, I'm now using text from an IM chat, which is conversational. I would like to measure ...
12
votes
3answers
1k views

Is there practical application of X' theory in natural language processing?

I was taught X' theory in generative grammar lectures, only to find out that NLP uses mainly simpler grammars, such as HPSG or statistical models such as hidden Markov models. Is X' of any use for ...
0
votes
0answers
14 views

Are there any publicly available NLG systems with controlled vocabularies?

I think it could be cool to practice a language (especially as a beginner) with NLG generated texts (OpenAI’s GPT-2 produces impressive texts) which have controlled vocabularies - for example, limited ...
0
votes
0answers
24 views

Abstractive Summarization, simple models

I should examine how different models for abstractive summarization generalize. The plan is to train them with different training data and observe how the summarizations produced are affected by this. ...
1
vote
1answer
259 views

Lexeme vs. Lemma

A lexeme to me has always been a fairly abstract entity and a lemma a concrete form that is often used to represent an lexeme. It is surprising to me, then, that the process in NLP is almost always ...
14
votes
4answers
8k views

Convert audio recording of word to IPA representation

Are the any open source tools/software libraries to convert an audio clip to its IPA representation? If so, are they accurate? If not, why not? Here is a Gaelic word I wish to convert: Ogg format: ...
4
votes
3answers
1k views

Word frequency list for agglutinative languages like Swahili?

I'm an intermediate Swahili speaker looking to substantially increase the size of my vocabulary over the next couple weeks. However, I want to optimize my learning curve by focusing on the first 2000 ...
0
votes
1answer
42 views

Multiple elongations in English Dataset

I am studying different research works in Authorship analysis from English data set. I have some features which can be a great tool for authorship analysis. Some of the common features are: Total ...
0
votes
0answers
13 views

NLP/Computer linguistic : Difference between knowledge based approaches and superficially Text Summarization Methods and examples

irst of all, sorry for my bad English. What the Main difference between such two approaches ? And what makes a system or a Textsummarization-Approach Knowledge based? Is it based on the inner work of ...
0
votes
0answers
45 views

Complex/Compund sentence to simple Spacy

I want to use Spacy and Python and convert a sentence to simple one irrespective being a complex or a compound sentence.
0
votes
0answers
21 views

Automated Verb Correction for Subject Agreement Using Penn Treebank Tags

I'm working on a software method to correct the verb in an English sentence based on the subject count (singular or plural) and using a corpus of verbs tagged with their Penn Treebank Tags. (I have ...
0
votes
1answer
58 views

Indo-European Etymological Dictionaries Online database (by Brill, Leiden University)

The Indo-European Etymological Dictionaries Online database (by Brill) already includes eleven dictionaries https://linguistics.stackexchange.com/a/6356/22504 I've read about this "database" before. ...
6
votes
1answer
48 views

Corpus of English sentences written by non-native speakers?

I am working on a hobby project which tends to help the non-native speakers figure out if the sentences they write are good enough and sounds like written by English native speakers. Any relevant info ...

1
2 3 4 5
12