Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
1
vote
0answers
266 views

How to use the AssertionMiniPipelineAnalysisEngine in cTAKES?

I am trying to use Apache cTAKES to detect negations in physician notes. I have loaded the provided analysis engine apache-ctakes-3.2.2-bin\apache-ctakes-3.2.2\desc\ctakes-assertion\desc\...
-2
votes
1answer
44 views

Reearch paper subject [closed]

Computer language and human language. is it a good subject to research paper related to linguistics? Thank you in advance
2
votes
0answers
1k views

How to extract Subject, Object, Verb through a parser

For my project, I need to extract Subject, Object and Verb from the sentence. I have read that, LFG F structure is what I need. I am using Stanford NLP package. I couldnt find out how to do that in ...
5
votes
1answer
82 views

What types of errors arise when converting consistency parse trees to dependency parse trees?

I wonder what types of errors arise when automatically converting consistency parse trees to dependency parse trees, and how frequent they are.
4
votes
2answers
234 views

dictionary with the smallest number of circularly defined words

Motivation: words in a dictionary are defined in terms of other words, but at some point it becomes circular: words defined by other words that have also been defined using some of the same words. ...
4
votes
3answers
334 views

Anguish Languish to English Language metric

Anguish Languish is a silly linguistics exercise to replace all words in a sentence with phonemically similar counterparts with no regards for semantics or meaning. The intent is that the original ...
4
votes
2answers
173 views

“Toy” Tools for Dependency Parsing?

I plan to work with dependency parsing, as an intermediate step in a text understanding problem. I'm also still trying to understand the terminology and methods. Any pointers (or providers) of tools (...
1
vote
1answer
236 views

What is the purpose of part of speech tagging?

Suppose I have a corpus of sentences, which I then use a part of speech tagger to annotate. What algorithms or techniques can I then input the tagged data into? Are the tagged words somehow useful ...
5
votes
1answer
387 views

Maltparser vs Freeling for Spanish dependency parser

I need to parse a Spanish corpus with syntactic dependencies. I have tried both Freeling and Maltparser, they both give similar results, but with some divergence. I need the highest accuracy possible, ...
5
votes
1answer
543 views

Shannon's entropy as a measure of vocabulary richness

The Entropy formula for lexical richness is The probability p-ith is calculated by dividing V-ith by N, where N is the total number of tokens in the text and V is the number of types. However, I can'...
1
vote
1answer
445 views

Incomplete sentence parsing and relation extraction

I'm building a tool which parses natural language input into nouns and relations. For example sentence Barack is the president of the United States and lives in Washington DC and went to Harvard ...
2
votes
2answers
89 views

How can I represent “I sometimes pet bunnies” using lambda functions?

Update: Removed ancillary wording. My question was how to represent sometimes in propositional logic in the sentence: I sometimes pet bunnies.
2
votes
2answers
62 views

Said tags in Sentence detection

I am trying to apply NLP to fiction but I don't know how split dialog into sentences. Specifically how to split said tags. ex. "Awake? How long have been asleep?" asked teenagers at the same time. ...
4
votes
4answers
346 views

Forced aligner in Spanish? (Similar to P2FA)

I am looking for a forced aligner in Spanish. Something similar to P2FA for American English. I want to force align simple sentences in Mexican Spanish for a project. Does anyone know one?
5
votes
1answer
422 views

Performance improvements of using the shift-reduce Stanford Parser

I'm running NLP on large texts, and part of the questions I'm trying to answer have to deal with syntax. I'm using Stanford NLP, including the Stanford Parser. I started out using the probabilistic ...
1
vote
0answers
264 views

Average number of independent clauses in a compound sentence

I'm working on a NLP project, where we analyze large text samples (think a novel), and produce some metrics that help us answer interesting questions about the text. One of these metrics is average ...
2
votes
0answers
154 views

Is there a relationship between rank(token) and max(rank(tokens in document))?

Given a language L, a target word w, a [Zipfian] distribution of word frequencies (Rank(w)) and a [gamma] distribution of sentence lengths, can we come up with a way to determine the approximate count ...
4
votes
2answers
274 views

Calculating writing system efficiency with respect to reading ambiguity?

I have been thinking of developing a software tool that would make it possible to calculate the efficiency of a particular writing system (attested rather than hypothetical) for a particular language (...
1
vote
1answer
140 views

Why does my P2FA skip every word?

I have a .wav file and a txt file that I am trying to use with the P2FA aligner. For some reason, it skips every word. I even tried running it with just two words: "the robotics". My text file is this:...
6
votes
3answers
904 views

Measuring semantic complexity of a text

I do not have a linguistic background, but I am working on a research project that involves measuring the complexity of news. One of the metrics that I was interested in is the semantic complexity of ...
2
votes
1answer
247 views

What do the labels mean in this latin pos tagging?

I'm using cltk, a Python library for processing of classical languages. I'm pos-tagging an example sentence, but I don't understand the output. tagger.tag_unigram('Gallia est omnis divisa in partes ...
3
votes
2answers
87 views

What are the most authoratative references on the notion of shallow parsing?

What are the most authoratative references on the notion of shallow parsing (also known as text chunking) in NLP? I am looking for definitions, examples, and discussion of strings of words that ...
2
votes
0answers
30 views

Term for words or phrases signifying change in numeric quantities?

Phrase like "take away", "more than" ,"times" imply certain mathematical change (subtract,add,divide etc.) in the quantity in current context. For eg. The number of girls "exceeds" the number of boys ...
4
votes
1answer
654 views

Question type corpus

I'm looking for a corpus that contains questions and question types. Like in this article, but they didn't attach any link to their corpus. http://polibits.gelbukh.com/2009_40/40_01.pdf
3
votes
1answer
1k views

Extract location from a string with a city, state, country in it?

How could I extract a location from a string like San Francisco 49ers and get San Francisco from it? The only way I can is by training a neural-network, but training with every city, state, country, ...
2
votes
0answers
225 views

Early Modern English spelling variations dictionary

I am building a web application that allows users to transcribe, word by word, Early Modern English manuscripts. I want to tell users when a word they transcribed may be a new spelling variant of ...
2
votes
1answer
108 views

What is the name of this text analysis method?

What is the name of a text analysis method where one builds a network of sentences that are connected when they contain words that occur on a predefined reference list of words? So, lets say I have ...
2
votes
1answer
116 views

How many gaps should a sentence have to be solvable but not too easy?

At the moment I am coding an automatic cloze generator on Text on the following way: Use a summarizer to find relevant sentences in a text based on frequency Use Pos Tagging on the remaining ...
1
vote
1answer
130 views

How to identify mentions in a text?

I am looking for rule-based methods or any other methods to identify all mentions in a text. I have found several libraries that give coreferences but no exact options for only mentions. What I want ...
6
votes
2answers
217 views

Extracting Rare Words From A Corpus

This question might be too general, or opinion-based, but I was looking for advice on how to extract rare words from a very large corpus. The rare words wouldn't necessarily be consistent from ...
0
votes
1answer
122 views

representing a sentence in integers ( hopefully retaining semantic value )

I've been trying to convert natural language strings into integers for use in a long short-term neural-network. I tried converting to binary, using a bag-of-words, and an associative-array with each ...
3
votes
0answers
231 views

Downloadable list of Romance-language cognates?

I'm looking for tables of cognates between French, Spanish and Italian (and potentially Latin, Portuguese, Catalan, etc.), so I can run some Python on them. If they could have extra information such ...
5
votes
1answer
4k views

Word Co-occurrence and collocation difference?

This Wikipedia page says, "In contrast to collocation, co-occurrence assumes interdependency of the two terms". But I'm not really sure what that means by interdependency of the two terms. Can someone ...
1
vote
1answer
346 views

What should I do of inter-annotator agreement is below 100%?

I am currently working on an NLP project where I had to mark an initial list of words, giving a score of either 1 or 2 to each word in the list. I got the list marked by 2 people and found that the ...
4
votes
0answers
103 views

What is the difference between AUG and CCG?

What is the difference between Applicative Universal Grammar and Combinatory Categorial Grammar? They both use type inference rules to define their grammars. Is it simply that CCG uses combinatory ...
3
votes
0answers
189 views

Inside-outside algorithm (PCFG learning) and binarization

I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
3
votes
2answers
146 views

How to identify corresponding sentences in source and translation texts?

I'm interested in creating files where a source text and translation are interleaved with each other, so that each sentence (or small group of sentences) is immediately followed by its translation. ...
1
vote
1answer
88 views

Semi-offset Annotated Data

I want to use the data provided by CoNLL 2012 shared task. They mentioned that the data is semi-offset annotated, I couldn't find any interpretation for the term "semi-offset annotation". Can anyone ...
3
votes
1answer
345 views

Different discounting methods with SRILM toolikt

I want to do some smoothing on a corpus and compare the results. for train language model without smoothing I used "-addsmooth 0" option now I should add two different smoothing and compare them, I ...
0
votes
0answers
466 views

Categorizing short sentences into a taxonomy

I feel like I might be in the wrong exchange, but I do not see a NLP exchange, so I figured this was the best bet. My current task is to take short sentences and try to categorize them based on some ...
5
votes
3answers
1k views

Text Summarization Tool

I'm looking for tools I can use to perform text summarization. Specifically something I could use to summarize personal communication (i.e. email). Preferably I'm looking for something open source ...
3
votes
3answers
2k views

Conversational English corpus for download

I have a project which requires a corpus of conversational English in plain text (although I can perform some processing as needed). Since I am a student, I need to find a corpus that is free and ...

1
6 7
8
9 10
13