Questions tagged [corpora]
A corpus (plural corpora) is a database of text or speech, possibly annotated with language-specific explanatory information. Used for testing statistical hypothesis and constructing quantitative models.
210
questions
4
votes
1answer
422 views
Is there a standard corpus against which to benchmark mechanical parsers?
I was wondering if there is a published standard corpus of English sentences which are confounding for mechanical parsers. I am looking over sentences given here, and I have the following (very short) ...
0
votes
2answers
304 views
1TB word (1-gram) corpus
Where can I find a 1TB or larger 1-gram corpus?
I am comparing certain structures for term-frequency calculation, but without a significantly large dataset I won't be able to show the non-theoretical ...
18
votes
1answer
8k views
Does anyone know of text message corpora?
I am looking for a large corpus of text messages. By large, I am hoping to have at least 15,000 text messages in my sample. I am fine with combining several smaller corpora into a larger corpus as I ...
9
votes
3answers
2k views
How to work on annotating AND sentence-aligning parallel texts?
There are plenty of software programs facilitating interlinear transcription (e.g. Toolbox, Fieldworks Language Explorer). There's also a number of tools that allow you to work on aligning parallel ...
4
votes
0answers
355 views
How to decrease CRF++ feature function set?
I have a problem with the CRF++ Package. CRF++ cannot handle large training parts-of-speech corpora (large tagset and large number of words).
In fact, the number of feature functions automatically ...
12
votes
1answer
613 views
What are some resources that I can use to gather Twitter data for an NLP project?
I was going to use the Edinburgh Twitter Corpus that is referenced in this paper: The Edinburgh Twitter Corpus. But apparently Twitter has changed their Terms and the corpus is no longer available. ...
29
votes
5answers
1k views
Lists of linguistic resources
In the interest of cultivating a professional, academic community, I posted this question on Meta. One comment was to open a community-wiki question inviting others to contribute to a list of academic ...
7
votes
3answers
957 views
Are there dictionaries like Collins COBUILD for other languages than English? [closed]
Let me explain what I'm after:
monolingual
all examples are taken from a large corpus of contemporary text (the COBUILD series is now using Bank of English)
the senses for each entry are sorted by ...
20
votes
4answers
2k views
Corpus of baby-talk or motherese
Baby-talk or motherese is the language that parents tend to use when addressing preverbal or just-starting-to-speak children. What are the fundamental features or rules that define this subset of a ...
6
votes
2answers
364 views
Where could I find a corpus that is purely descriptive in nature and limited in scope?
I'm trying to build a cognitive model of how people learn a event representation from a sentence describing the event, based on St. John & McClelland's Sentence Gestalt Model.
However, while ...
