We changed our privacy policy. Read more.

Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
8
votes
2answers
2k views

Are there any statistics or web services for n-grams of frequent English words?

I found this for six common subjects. But it doesn't contain the complete statistics about all common English words.
8
votes
2answers
168 views

Can computational techniques solve historical problems that couldn't otherwise be solved?

Recently I've read that machine learning has been used to apply the Comparative Method (example with references here). Also, there are other mathematical approaches that have been applied to the ...
8
votes
2answers
366 views

Where to start if you want to do Chomsky style NLP?

I am a computer science grad who has been fascinated by Chomsky's theory of language. I have been following his work and the others in his field. But I also want to try something on my own. The ...
8
votes
1answer
609 views

Do Sign Languages have ambiguities?

I just noted that there exists a whole literature on Sign Language. I didn't even know there existed more than one... It's very interesting now. :) I then found computers can already interpret some ...
8
votes
2answers
619 views

What are the motivations for which direction syntactic trees are built in (top down or bottom up)?

When I learned x-bar theory, there seemed to be an implicit assumption that trees were built top-down, from IP or CP to the VP and its complement, etc. However, as I am learning more about Minimalism (...
8
votes
2answers
965 views

IDE for context free grammars for natural languages?

Is there any such thing as a Integrated Development Environment for context free grammars (or any variant on a formal, machine parsable grammar) that target natural languages? The ones for BNF ...
8
votes
1answer
479 views

What defines a unique writing style?

I'm an amateur writer that happens to be a professional programmer. I say this because I've recently jumped back into a personal research project in which the goal is to automate the de-anonymization ...
8
votes
1answer
2k views

What's the real need for an end-symbol in n-gram models?

There's a footnote in Jurafsky & Martin (2008, p.89) pointing out that, without an end-symbol, an n-gram model would not be "a true probability distribution". Even after seeking the paper they've ...
7
votes
5answers
962 views

Is there a way to prove one language is more efficient than another language for science?

English is widely regarded as the global language of science now. In China, we use simplified Chinese to write scientific textbooks, teach courses and do almost everything. Let's take the simplest ...
7
votes
1answer
763 views

Earley Parser: Ambiguity

I've got a pretty basic question concerning the Earley parser: In case of syntactic ambiguity ( S -> NP VP(V NP(NP PP)) vs. S -> NP VP(VP((V NP) PP) ), are both parses stored in one chart or in two? ...
7
votes
2answers
615 views

Finding the root of an Aramaic or Hebrew word

I'm trying to make a dictionary on the web where people can automatically look up words in a text they're reading online. While I have the words and their definitions, the problem is that many times ...
7
votes
1answer
773 views

How can I calculate if the difference between two word frequencies in one corpus is significant?

I want to study orthographical variants, for example: Can firefighter and fire-fighter be considered orthographical variants (i.e. the difference in frequency in a corpus is not statistically ...
7
votes
1answer
449 views

Dictionary of atypical syllabication

I am a literacy researcher looking to create an add on package in R that offers quantitative methods for discourse analysis. I am creating a function for taking a chunk of text and measuring the ...
7
votes
0answers
168 views

Combinatory Categorial Grammar (комбинаторная категориальная грамматика) developments and lexicon for Russian language?

I am trying to apply Cornell Semantic Parsing framwork https://github.com/cornell-lic/spf (implementation of Combinatory Categorial Grammars CCG) to Russian language. This framework takes natural ...
7
votes
1answer
396 views

Representing knowledge extracted from output of dependency parsing

I am working on a problem to represent knowledge extracted from a paragraph and rank it to produce abstractive summaries. I have implemented dependency parsing using Stanford NLP, which gives dot ...
6
votes
5answers
959 views

Can we conclude that morpheme is ALWAYS greater than syllable?

A morpheme is the most smallest meaningful unit of language. A syllable is the smallest piece of pronunciation that has a vowel in it. Definitions are taken from this link. I don't know why, but can ...
6
votes
2answers
209 views

Dataset/Database similar to WALS in Vowel/Phonology

I am wondering if there is any database similar to The World Atlas of Language Structures (WALS)(https://wals.info/). In the case that it is specifically more geared towards phonological aspects of ...
6
votes
4answers
1k views

What are multi-word concepts (technical terms) called and how are they found?

Go to this website: http://parts-of-speech.info/ Now go to this Wikipedia article: https://en.wikipedia.org/wiki/Evolutionary_psychology Grab the first paragraph and feed it into POS tagger to see the ...
6
votes
2answers
334 views

What determines how natural a word sounds in a language?

What features of a word make a word sound natural in a language. For instance in two made up words 'mobify' sounds more natural in English than 'jlkrtz'.
6
votes
2answers
369 views

Where could I find a corpus that is purely descriptive in nature and limited in scope?

I'm trying to build a cognitive model of how people learn a event representation from a sentence describing the event, based on St. John & McClelland's Sentence Gestalt Model. However, while ...
6
votes
2answers
224 views

Extracting Rare Words From A Corpus

This question might be too general, or opinion-based, but I was looking for advice on how to extract rare words from a very large corpus. The rare words wouldn't necessarily be consistent from ...
6
votes
3answers
1k views

Are there any linguistic toollkits for PowerShell or .NET?

In the past when I was an active Python coder I played a bit with NLTK and learned some basic linguistic terminology. But meanwhile I shifted to PowerShell and I have abandoned coding in Python. ...
6
votes
3answers
997 views

Measuring semantic complexity of a text

I do not have a linguistic background, but I am working on a research project that involves measuring the complexity of news. One of the metrics that I was interested in is the semantic complexity of ...
6
votes
3answers
2k views

Tool for building a corpus by crawling the web?

Often I want to make my own corpus of a new language I've become interested in. I'm very happy to make my own tools and have plenty of programming experience. I have made my own tool to gather plain ...
6
votes
3answers
168 views

Looking for bi-/tri-lingual dictionaries or corpora

I will be attempting to solve the problem of automatic language identification/detection (and later translation), and I'm in a need of free digital dictionaries or corpora. I'm looking for ...
6
votes
1answer
56 views

Corpus of English sentences written by non-native speakers?

I am working on a hobby project which tends to help the non-native speakers figure out if the sentences they write are good enough and sounds like written by English native speakers. Any relevant info ...
6
votes
1answer
68 views

What does 'MSP' stand for in the context of Chinese parts of speech?

The Part-Of-Speech Tagging Guidelines for the PennChineseTreebank(3.0) uses several acronyms without defining them. I am a hobbyist student of Chinese linguistics as part of my study of Chinese. I ...
6
votes
1answer
480 views

How can I know if a log-likelihood score is high enough?

I am trying to understand if some terms can be considered as distinctly American or British. So for example I was studying the term "aubergine" and the normalized frequency in the American corpus is ...
6
votes
1answer
4k views

Common English bigrams / trigrams - recognising that a jumble of letters contain only valid English words

I have a database of one million strings which I want to rank against one another so that I can tell which contain meaningful English words / sentences. These strings contain no spaces or punctuation....
6
votes
1answer
144 views

How to make a Corpus? (selecting a good structure)

I'm making a Corpus. I have searched for good practices on how to build it. I've downloaded some Corpus to check their internal structure and the extension file, but I didn't find many. So, I am lost ...
6
votes
1answer
117 views

Are there standard test data sets for English stemmers / lemmatisers?

There is a lot of easily located material online which describes stemmers or provides implementations. There's a bit of discussion of metrics for quantifying how effective they are, and I've even ...
6
votes
2answers
1k views

Do I have copyright issues when making a corpus from the web?

I realize that this is probably technically off-topic as it relates to copyright legalities of corpus construction. However, it is a practically very important issue for corpus linguistics and so I ...
6
votes
0answers
285 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
6
votes
1answer
369 views

Existing English word database with word forms?

Where can I find a database of English words that has the various forms for each word? Specifically, it would give the plural and singular form with its indefinite article for each noun, the various ...
5
votes
1answer
236 views

Statistical Methods in Etymology

Etymologists tend to categorize the probability of theories under formulaic labels. These range from "uncertain" over "tentative" or "not convincing" to "established", "accepted" or "nonsense". P ...
5
votes
4answers
210 views

Can training a Part-of-Speech tagger and parser at the same time improve parsing results?

I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
5
votes
3answers
208 views

Has anyone attempted to simulate the creation/development of a language?

I suspect this is a dream confined to sci-fi for at least a few decades, but, I'd like to know if anyone has ever tried to create a computer model for the creation of a language, or at least ...
5
votes
1answer
6k views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), Synset('fantastic.s....
5
votes
4answers
970 views

Which language has verb/noun compounding features?

Often languages have compounding phrases with the same Part Of Speech (POS) and it becomes a morphological analysis problem in Natural Language Processing (NLP). The most notorious being infinite ...
5
votes
1answer
322 views

Wordnet and Ontology software

Are there any software or tools for Ontology and WordNet development?
5
votes
1answer
117 views

What are the conventions for corpus usage?

Suppose I'm working with a language that doesn't have much data available; the largest corpus around is a translation of the Bible, which is free to read online, but is presumably still copyrighted by ...
5
votes
2answers
4k views

Detecting actions within text

I'm looking for a way to computationally find any actionable clauses within a body of text. Ideally there is a library I could use that I just give a body of text and it spits out the actions that it ...
5
votes
1answer
93 views

Is author profiling based on gender possible for English?

I was recently told by a friend who works in IT that certain neural networks can be trained to predict the age and gender of authors from anonymous texts written by them (cf. arXiv:1707.03764). The ...
5
votes
2answers
398 views

Can we simulate the pronunciation of sounds that we can't make?

There's certain non-filled places in the IPA chart because we physically can't pronounce them. For example, a velar trill or glottal trill. Using computers, is it possible that we could simulate how ...
5
votes
2answers
182 views

sentiment analytics

I've recently been tasked with programming a web crawler that searches through news articles for certain keywords--company names, for example--and then tries to determine if the article has a positive ...

1
2
3 4 5
13