Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
6
votes
4answers
1k views

What are multi-word concepts (technical terms) called and how are they found?

Go to this website: http://parts-of-speech.info/ Now go to this Wikipedia article: https://en.wikipedia.org/wiki/Evolutionary_psychology Grab the first paragraph and feed it into POS tagger to see the ...
0
votes
1answer
84 views

Pointing words in a sentence to their specific dictionary defininition

I would like to parse a piece of text (Spanish if possible, otherwise English) and point each word in the text to its correct entry in a dictionary. For example: I turned her down. would point to ...
1
vote
2answers
850 views

Linguistics concept about meaning of words according to a context

Several linguistics questions about the meaning in context of words: How is called in linguistics the fact some words have a meaning only with other words? How is it called when a word changes ...
1
vote
1answer
71 views

How to assess sentence complexity [closed]

I'm not really a linguist but I am analysing some medical free text so that I'll be able to extract various phrases using regular expressions. I have noticed that the sentences are usually very ...
3
votes
2answers
63 views

Should compounded words through agglutination be treated as unigrams or n-grams? [closed]

In a statistical language model, should one tokenize compounded words through agglutination as words by themselves (unigrams) or should they be tokenized into n-grams? Example: Staatspolizei (ISO ...
3
votes
1answer
49 views

Correcting the names in NLP

I have a dataset where lot of names are written like man1sh instead of manish, vikas as v1kas. How can one correct these names in NLP?
0
votes
1answer
104 views

How to extract rows with only meaningful text in a column

I have a large excel file like the following: Timestamp Text Work Id 5/4/16 17:52 rain a lot the packs maybe damage. Delivery XYZ 5/4/16 18:29 wh....
3
votes
0answers
100 views

n-gram language model smoothing [closed]

I use the corpora of webtext to train n-gram model in NLTK.And i use katz back-off smoothing to solve 0 count-problem.But one problem is:while the smoothing used in based-on characters language model,...
1
vote
1answer
54 views

Stanford NER tagger

I am trying to use Stanford NER tagger from the following link:NER tagger I output format I have chosen 'slashTags' and entered the following sentence: While in France, Christine Lagarde discussed ...
0
votes
0answers
17 views

What is posting act tagging in transformational learning?

We have presented a novel application of transformation-based learning to the problem of identifying postings in chat-room conversations. Posting act tagging aids in the formation of models of social ...
4
votes
1answer
180 views

Where can I find training data for dialects of Hindi?

I am working on a NLP project that aims at identifying different dialects of Hindi language. My über goal is to generate dialogs in once the program identifies which dialect is given. I tried ...
1
vote
0answers
32 views

How To incorporate TurboParser Instead of MaltParser for improved results like from online demo?

I have successfully installed Semafor on Linux Mint 18.1 and I can run it. But the results I get from my version differs drastically from the online demo. I realized that online demo uses TurboParser, ...
2
votes
0answers
92 views

Hidden Markov Models: Linking states to labels after EM training

The tl;dr version first: I have the following problem: I implemented Baum Welch for ergodic HMMs. I do it like this: I pass the model two number C1 and C2, it builds a fully connected state machine ...
3
votes
1answer
56 views

Is there a computer-readable Hiberno-English pronunciation dictionary?

For American English, there's the CMUDict, but is there one for Irish pronunciation? If there isn't, is there a way to translate American to Irish pronunciation?
-2
votes
2answers
927 views

Do any English verbs end in -s or -es that are singular?

I'm trying to automatically determine if a verb is singular/plural in a program, I cannot think or find on Google any verb that ends in -s or -es before conjugation. Are there any?
0
votes
0answers
90 views

Corpus for text classification with annotated support phrases

I am looking for corpora for text classification with annotated support phrases. Support phrases = phrases that explain why a text was given a label. For example, if the text is "The patient works ...
1
vote
1answer
108 views

NLP text classification approach for smart devices

As a project, I have been trying to understand the low-level heuristic approach from the perspective of a device attempting to behave smart, like Alexa and the likes Generally speaking, it starts ...
2
votes
1answer
125 views

File structures for named entity recognition datasets

I am looking for a list of file structures used by named entity recognition datasets. I am aware of the file structures mentioned below. What other file structures are there? CONLL 2003 Inline ...
2
votes
1answer
490 views

C&C/Boxer Source Code

I’ve been trying to find C&C tools and Boxer online and found this link in many places (http://svn.ask.it.usyd.edu.au/trac/candc) but the link does not work for me. Is there another place to find ...
3
votes
3answers
343 views

Compare 2 english text corpora

I have 2 English text corpora. One is people talking about topic "A" while other is people talking about topic "B". From a language point of view - the way people express themselves on topic "A" is ...
1
vote
1answer
71 views

Help understanding letter sets

I am trying to understand the working of an old computer speech synthesizer (SAM for the commodore64) which uses a series of rules to break English text into a string of phonemes. The rules make some ...
7
votes
1answer
315 views

Representing knowledge extracted from output of dependency parsing

I am working on a problem to represent knowledge extracted from a paragraph and rank it to produce abstractive summaries. I have implemented dependency parsing using Stanford NLP, which gives dot ...
0
votes
0answers
1k views

Split sentence into phrases and words

I need a direction, advice where to search information. I want to split sentences into separate words and phrases. For example this sentence "Tommy has a lot of job experience" has the phrase "a lot ...
1
vote
0answers
136 views

Synonym/hyponyms/hypernym detection data set

I am looking for data sets that I could use to train and benchmark a system that detects synonyms, hyponyms and hypernyms in a text. For example, in the sentence In statistics, logistic ...
1
vote
1answer
271 views

Gold standard corpus size?

I have a 25 MB corpus (2.300.000 words) to annotate with a rule based system. What is the ideal size of a gold standard corpus that I should create in order to evaluate the tool? Many thanks for your ...
2
votes
0answers
64 views

“Did” as a habitual / emphatic marker in Southern varieties of British English

I'm currently doing research on the salience of did as an emphatic marker in Southern varieties of British English as illustrated in (1). I'm comparing this with the salience of did as a habitual ...
2
votes
1answer
68 views

Automatically retrieving all the sub-concepts associated to a given concept

I wonder if you know how automatically obtain all the sub-concepts associated to a given concept. For example, given the concept car, I would like to automatically retrieve concepts such as: wheel, ...
0
votes
0answers
101 views

Library of regular expressions for lexical relations in a corpus

I would like to ask if there is a library of regular expressions for mining patterns reflecting lexical semantic relations from a corpus. These patterns should cover a wide variety of aspects synonymy ...
5
votes
3answers
546 views

How can I automatically build a domain specific corpus from scratch? [closed]

I would like to know if it is possible to build a domain specific corpus from scratch. By domain specific I mean a corpus which covers a single topic, e.g. European union, basketball, Hollywood, IT, ...
1
vote
0answers
31 views

Base case of the outside term of Inside-outside algorihm

I am studying the Inside-Outside algorithm, which is a branch of EM algorithm. (As resources, I am referring http://www.cs.columbia.edu/~mcollins/io.pdf and https://www.cs.jhu.edu/~jason/465/iobasics....
2
votes
1answer
894 views

Get “part of speech” for a Spanish word

I do a little linguistics as a hobby while working of my own software development projects. I am wondering if there is a database or online api where I can easily establish the possible "parts of ...
3
votes
3answers
136 views

Semantics Intermediate Language for processing concepts and/or semantics

I am a computational linguistics student, and I was thinking about defining a new framework, or a standard for translating or converting sentences into a conceptual or semantical intermediate language....
4
votes
2answers
139 views

Obtaining the stem of a word

I wonder if you know a computational method to obtain the stem of any English word. By stem I mean the part of the word which is never affected by plurals, temporal forms, and so on. For example, stem(...
7
votes
1answer
586 views

How can I calculate if the difference between two word frequencies in one corpus is significant?

I want to study orthographical variants, for example: Can firefighter and fire-fighter be considered orthographical variants (i.e. the difference in frequency in a corpus is not statistically ...
0
votes
0answers
14 views

find if a terms appears in specific pdf sections

i have scientific papers in pdf format and typically contain section. i wanted to know if an input term(s) appear in the introduction/ background or conclusion/ discussion section. how could this be ...
1
vote
1answer
40 views

What is a good way to handle contractions and possessive apostrophes when doing topic modeling?

I'm doing topic modeling with LDA. As input to LDA I'm using a tokenized corpus. I was wondering what's a good way to handle contractions and possessive apostrophes. Right now words like can't and ...
-2
votes
1answer
86 views

Formal Semantics - Set theory/Proofing (Not sure how to go around it)

I've got to do a proof to explain for any s, [[former president with long hair]]s = {x: there is an s’ before s such that x is a president with long hair in s’} when the structure is [former ...
2
votes
1answer
442 views

Is there any CNF grammar available for English which can be downloaded directly?

For implementing the CYK algorithm for parsing, we need to have a grammar in CNF (Chomsky Normal Form) defined for a language. Is there any such CNF grammar readily available which covers all (or most ...
2
votes
1answer
126 views

Universal/commonsense knowledge bases (OpenCog, OpenCyc) for representation of meaning in natural language processing (computational linguistics)

What is the status, endeavours and prospects for the use of universal/commonsense knowledge bases (KB) for the representation of the meaning of the natural languages in natural language processing / ...
2
votes
1answer
526 views

How to detect verb in a sentence where the verb is invisible in the sentence?

In case of some Indo-European languages it seems there is no visible verb in the sentence. This is specially visible in languages like Bangla, Hindi etc. For example the sentence Who is there? is ...
1
vote
1answer
593 views

Add-1 laplace smoothing for bigram implementation8

I am doing an exercise where I am determining the most likely corpus from a number of corpora when given a test sentence. I am trying to test an and-1 (laplace) smoothing model for this exercise. I ...
3
votes
0answers
150 views

Distribution of the set of meanings of a given word, in a corpus

I am looking to know about the distribution of word senses, of a particular word in a corpus. How often a word sense will occur out of all the occurrences of that word with any meaning. For example: ...
2
votes
1answer
304 views

Mapping Minipar dependencies to Stanford Parser dependencies

I am trying to use the algorithm in Qiu et al., 2011, "Opinion Word Expansion and Target Extraction through Double Propagation" for my research. However, in the paper, they use Minipar for dependency ...
1
vote
0answers
308 views

Simple bigram letter model

I am working through an exercise where, given a set of corpora, I will implement a simple model on a test corpus to determine the most likely corpus. Say the corpora with which I want to learn are ...
0
votes
1answer
60 views

Where can I find a list of German nouns with their articles?

I am working on some linguistic software. The whole functionality is already there, the only thing that is missing is a good vocabulary to test it with. Of course there is no way to create a decent ...
-1
votes
1answer
112 views

Extracting adjective phrase from a sentence

Could someone point me to some open source NLP or machine learning library that can be used (possibly with some additional processing) to extract an adjective phrase from a sentence? I.e, given the ...
-1
votes
2answers
301 views

Good 10 second explanation of computational linguistics [closed]

What is your best one or two sentence explanation of computational linguistics? I have been doing it for a few years, but find myself stammering for a quick, layperson explanation. As an example, I ...
5
votes
0answers
263 views

OCR program for IPA?

Is there a program that can convert a scan/image of IPA into any digital encoding? UTF-8 Unicode preferred, and low-cost preferred (open source would be especially nice).
1
vote
0answers
84 views

Support vector machines for stress prediction

I am fairly new to support vector machines and I was thinking about whether or not I could use them to tackle a specific research question in linguistics: My goal would be to find the probabilities ...
2
votes
2answers
517 views

What are the main differences between machine learning and classic approaches to natural language processing problems?

What types of NLP problems are best suited to machine learning and which are best solved by more classical approaches (e.g. syntactic and semantic analysis?)

1
3 4
5
6 7
12