Questions tagged [corpora]

A corpus (plural corpora) is a database of text or speech, possibly annotated with language-specific explanatory information. Used for testing statistical hypothesis and constructing quantitative models.

Filter by
Sorted by
Tagged with
4
votes
1answer
84 views

Corpus-making guide in Language Understanding Context

I want to make a standard annotated corpora on Language Understanding but I don't know where to start and what to do! Does anyone know any good reference in order to guide me through making a standard ...
3
votes
1answer
270 views

Dimensional reduction with synonomy and polysemy

I was wondering something for a computer science project I am doing. Documents usually have too many distinct words to process on a computer efficiently. One solution is to map all words to a single ...
9
votes
1answer
228 views

Is there an automatic way of identifying transitive verbs in Computational Linguistics?

Is there any straightforward way of identifying transitive verbs (or sentences containing transitive constructions) in an BrE English text? I've looked into semantic shallow parsers, such as Semafor, ...
2
votes
2answers
52 views

Query format for NP without subject in PPCEME

As I, not being very familiar with corpus linguistics, read the manual for searching through PPCEME I entered: node: NP* print_indices: true query: (NP-SBJ *PRO*) without getting a result. Could ...
4
votes
1answer
419 views

Is there a standard corpus against which to benchmark mechanical parsers?

I was wondering if there is a published standard corpus of English sentences which are confounding for mechanical parsers. I am looking over sentences given here, and I have the following (very short) ...
0
votes
2answers
302 views

1TB word (1-gram) corpus

Where can I find a 1TB or larger 1-gram corpus? I am comparing certain structures for term-frequency calculation, but without a significantly large dataset I won't be able to show the non-theoretical ...
6
votes
2answers
362 views

Where could I find a corpus that is purely descriptive in nature and limited in scope?

I'm trying to build a cognitive model of how people learn a event representation from a sentence describing the event, based on St. John & McClelland's Sentence Gestalt Model. However, while ...
4
votes
0answers
355 views

How to decrease CRF++ feature function set?

I have a problem with the CRF++ Package. CRF++ cannot handle large training parts-of-speech corpora (large tagset and large number of words). In fact, the number of feature functions automatically ...
12
votes
1answer
611 views

What are some resources that I can use to gather Twitter data for an NLP project?

I was going to use the Edinburgh Twitter Corpus that is referenced in this paper: The Edinburgh Twitter Corpus. But apparently Twitter has changed their Terms and the corpus is no longer available. ...

1 2 3 4
5