Questions tagged [computational-linguistics]

A branch of science that uses computers and mathematical methods to construct and investigate linguistic theory. Its technological and algorithmic implementation is called NLP.

Filter by
Sorted by
Tagged with
1
vote
2answers
1k views

Two sentences with the same meaning

I am looking for a statistical or linguistic method that could give the degree of similarity between the meaning of two sentences. I have found in literature many distance measures (euclidean distance,...
1
vote
1answer
423 views

Where to study probability and natural language processing from? [duplicate]

I am a programmer and I am interested in Natural Language Processing. I studied it a bit in college, but it was years ago and anyway it wasn't enough for a good knowledge of the field. I'm ...
6
votes
0answers
278 views

Formal Language theory (context free grammars, pushdown automata)

Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
3
votes
1answer
669 views

Software to measure F-Score (formality) in English

Francis Heylighen and Jean-Marc Dewaele defined a measure of language formality called "F-Measure" in a paper published in 1999 titled "Formality of Language: definition, measurement and behavioral ...
2
votes
2answers
5k views

How to generate grammatically correct sentences?

I'd like to give something like this: # John # eat + past # apple and get back the grammatically correct sentence: John ate an apple. Which software can I use for such generation?
0
votes
0answers
135 views

Node level with Stanford dependency parser

I am trying to find a way to select the node(word) level using Stanford dependency parser. But, i haven't found any method that help to get the node level. I will be very grateful for your help
4
votes
2answers
164 views

Does translation software use syntactic trees?

I'm a multilingual, and since syntax structures vary between various languages, it seems intuitive to me that translation software use syntactic rules to translate between languages. But when I see ...
2
votes
0answers
376 views

I am looking for an Arabic ngram corpus

I am working in a project where i need to use an ngram model. So, i want to know if an Arabic ngram corpus exist. I have tried to find a corpus but all my researches failed. I know that for languages ...
2
votes
2answers
910 views

annotation tool to work with XML Schema

Is there an annotation tool which can create annotation tasks automatically using an XML schema? The desirable annotation markup may be specified with an XML schema file. I'd like to be able to ...
4
votes
1answer
4k views

Filling in incomplete sentences using NLP and Python

I am trying to leverage NLTK and Python to perform some sentence completion. The sentences I'm working with are incomplete and pretty much just read as garbage. An example sentence would be something ...
5
votes
1answer
6k views

Which part of speech are 's' and 'r' in Wordnet?

From taking the synset of the word 'fantastic', I got a list of senses below: [Synset('antic.s.01'), Synset('fantastic.s.02'), Synset('fantastic.s.03'), Synset('fantastic.s.04'), Synset('fantastic.s....
0
votes
2answers
160 views

Describing recursive structures with regular expresions as grammars

I found in a book about regular expression grammars something that said RE's can be used to describe sentences like this ‘the brown tea pot’ by using re like this np = det+"?"+"("+noun+"|"+adj+")*"+...
14
votes
4answers
5k views

Are there natural languages that do not obey Zipf's law?

Is there a natural language which is known not to follow Zipf's law? I'm interested to see if it's really universal. This is what Zipf's law states: Zipf's law states that given some corpus of ...
2
votes
1answer
265 views

Help understanding “degree of overall vocabulary divergence”

There was an article published with a diagram showing Lexical Difference: http://elms.wordpress.com/2008/03/04/lexical-distance-among-languages-of-europe/. It cites a Russian source "K. Tyshchenko (...
3
votes
2answers
417 views

What is the most efficient way to store n-grams in a database / data structure?

Let's assume we have Google's 1T n-grams. I want to be able to: Search for n-grams containing all of a set of words (such as finding all n-grams containing the words "dog" and "bone" in any position) ...
6
votes
3answers
2k views

Tool for building a corpus by crawling the web?

Often I want to make my own corpus of a new language I've become interested in. I'm very happy to make my own tools and have plenty of programming experience. I have made my own tool to gather plain ...
2
votes
1answer
1k views

Is perplexity in SRILM normalized for sentence length?

If I generate a language model with SRILM's ngram-count and then use ngram -unk -ppl text -lm model to get log probabilities and perplexity values, are the perplexities normalized for sentence length?
3
votes
1answer
2k views

Stanford parse tree - What does SBAR mean?

I am wondering what SBAR means and how do I correctly represent in a tree this sentence? Why there are 2 S? Original sentence is: After she ate the cake, Emma visited Tony in his room. Thank you! (...
5
votes
2answers
784 views

Is there a corpus of English adjective, adverb, etc metadata?

For example. In the sentence fragment "red leather stool", red is a color, leather is a covering of the stool, and stool is a chair. Is there any database, corpus or repository, that lists the ...
10
votes
6answers
445 views

Does the P versus NP conjecture in computer science have any direct relevance to linguistics?

From Wikipedia: The P versus NP problem is a major unsolved problem in computer science. Informally, it asks whether every problem whose solution can be quickly verified by a computer can also be ...
3
votes
0answers
203 views

Where can I find Japanese-English (manually) word-aligned corpora?

I'm looking for as many very reliable Japanese-English corpora as possible so I'd like to ask: Are there any other manually aligned corpora besides KFFT's and Utiyama's? What are the most accurate ...
2
votes
0answers
204 views

Writer/math student seeking an overview of linguistics. Help?

I am a math and statistics student/enthusiast as well as a fiction writer with cultivated interest in a few foreign languages. Linguistics has held appeal to me for many years, but I admit to having ...
3
votes
1answer
762 views

List of words in Hebrew

Where can I found a list of all the words in Hebrew including plurals, inflections, etc.? I have only found some lists that are based on wikipedia corpus or subtitles curpus, which include many errors ...
1
vote
1answer
131 views

Determining interests from Twitter text

I am not sure if this is the right place to post or if I should be posting CompSci so please feel free to redirect me to the most appropriate StackExchange. I would like to determine interests or ...
2
votes
0answers
134 views

Semi-automatic annotation tool like '@nnotate'

Is there an annotation tool for linguistic structure that compares to @nnotate? One of the major features of annotate is the annotation is semi-automatic, i.e., it uses a language model to make ...
5
votes
2answers
1k views

Expressing Context Free Grammar from academic article with Python's NLTK

Please forgive the potentially noob question, but I'm trying to get started with semantic text analysis, particularly in the legal space. I found a very good paper which describes a context free ...
0
votes
0answers
2k views

Extracting subjective phrases from sentences

I have a set of sentences from which I want to extract all the subjective phrases. For eg., from I am pleased to learn that the president has been reelected., I want to extract am pleased. What is ...
2
votes
2answers
264 views

Studying Linguistics for a Programmer

It isn't definitely a "linguistic" question, but I hope there're some people who solved the same problems like me. Since of my childhood I was very curious in languages and linguistics, but I hadn't ...
1
vote
0answers
54 views

Algorithm for determining the subject of a NL sentence / question [duplicate]

I'm trying to write code that takes in a natural language sentence and determines what that sentence is about. Not from a list of possible subjects, but just from the input text, the NL sentence. ...
1
vote
3answers
594 views

How would I parse the sentence, “I am not the alien here.”?

I am trying to construct a first-order logic representation of the following sentence. My general approach for constructing the representation is to parse the sentence into a phrase structure tree ...
18
votes
2answers
3k views

Is there a favoured data structure for storing ambiguous parse trees in Natural Language Processing?

I know a bit about parsing computer languages. Generally they try to resolve all ambiguities when parsing or abort the parse and throw an error. This means you either got nothing because there was an ...
4
votes
1answer
555 views

Identify author by a text's grammatical/syntactic structure

I'm interested in whether it is possible to classify texts by authorship using just syntactic/grammatical information. Let's take ten people and have them write three texts. About their favorite ...
5
votes
2answers
5k views

Are there any good open source English text to IPA/other phonetics alphabet transcription programs?

I'm writing a computer program which requires some of this functionality at one point, so I wanted to get into a (better-written) code and have a look, to get some inspiration. Are there any good ones ...
2
votes
1answer
699 views

Word Sense Disambiguation for common groups of words

Let's say the dictionary has two definitions for live: Live: I live by the sea. Live: The match was shown live on the sports channel. and also contains the following definition: Live ...
1
vote
1answer
678 views

Algorithm for converting an English sentence or phrase into a function call [closed]

Let's say I have a command line app that has the following functions: function createABox() { console.log("hey"); }; function deleteABox() { console.log("wutsup"); }; The command line app can take ...
2
votes
2answers
544 views

The Liar's Paradox : a linguistic perspective

The sentence "This sentence is false." is a paradox (called the "liar's paradox) as even though being well formed it is a contradiction. While logicians can call this a case of un-decidability what ...
1
vote
0answers
42 views

Automatic evaluation of written English - e.g. item descriptions

I'm looking for S/W that evaluates the quality of short English texts, e.g. in terms of grammar, syntax, maybe style or ethnicity. My interest is, for example, in descriptions of items offered for ...
3
votes
1answer
204 views

Dictionaries for machine translation

I am doing research on machine translation in prolog and I am wondering if there are any suitable dictionaries available in text/xml format for machine translation. With suitable for machine ...
6
votes
2answers
327 views

What determines how natural a word sounds in a language?

What features of a word make a word sound natural in a language. For instance in two made up words 'mobify' sounds more natural in English than 'jlkrtz'.
11
votes
2answers
402 views

If the Rosetta stone were to be translated today, would the process be the same as used the first time?

Are there any techniques available today that would make it considerably easier to anyone attempting to translate it today (as if they were trying todo it for the first time)? Otherwise would the ...
-1
votes
1answer
157 views

What factors should I consider when setting a Linguistic Corpus price?

What are the factors that must be considered when setting a linguistic corpus price? Is there any standard model or something else I should follow?
6
votes
1answer
116 views

Are there standard test data sets for English stemmers / lemmatisers?

There is a lot of easily located material online which describes stemmers or provides implementations. There's a bit of discussion of metrics for quantifying how effective they are, and I've even ...
3
votes
2answers
132 views

What is the definition of “oracle information”?

Can anybody provide me with a definition of "oracle information" as it's used in NLP and machine learning? I've come across the term in in sentiment analysis, wsd, mt, and in a number of other areas ...

1
9
10
11 12 13