Questions tagged [corpora]
A corpus (plural corpora) is a database of text or speech, possibly annotated with language-specific explanatory information. Used for testing statistical hypothesis and constructing quantitative models.
11
questions
7
votes
1answer
186 views
How are dictionaries produced
What are the steps invoked in producing a dictionary?
I am primarily interested in understanding the role software plays in the production process.
Obviously a corpus for the language is first ...
18
votes
1answer
8k views
Does anyone know of text message corpora?
I am looking for a large corpus of text messages. By large, I am hoping to have at least 15,000 text messages in my sample. I am fine with combining several smaller corpora into a larger corpus as I ...
11
votes
3answers
3k views
Where to find frequency list of English words from newspapers, books and magazines?
I'd like to download a frequency list of English words that are most common in newspapers, books and magazines. It should contain at least 50.000 words.
Is it possible to download such a list from ...
29
votes
5answers
1k views
Lists of linguistic resources
In the interest of cultivating a professional, academic community, I posted this question on Meta. One comment was to open a community-wiki question inviting others to contribute to a list of academic ...
25
votes
2answers
45k views
English text corpus for download
I need a free English language corpus with at least 15 million words. The corpus should contain one or more plain text files. There should be no tagging, just raw text. The corpus should be free. I ...
4
votes
2answers
170 views
When analyzing a set of corpora, are there any standard practices with regard to the classification of gerunds?
In the article, "How Many Words Do You Need to Know in Spanish (or any other foreign language)? And WHICH Words Should You Be Learning?" I came upon the following:
“Assume that a language learner ...
9
votes
3answers
1k views
Tools to annotate (categorise) sentences from a sentence corpus
I have a corpus consisting of sentences that are to be categorised in order to train a text categorisation algorithm.
I am looking for a (preferably web-based) tool that:
Allows me to input a list ...
8
votes
7answers
3k views
Biggest freely available English corpus?
Any help on finding the biggest freely available English corpus that can be used on research?
So far I have found OANC with 15 M words.
4
votes
1answer
422 views
Is there a standard corpus against which to benchmark mechanical parsers?
I was wondering if there is a published standard corpus of English sentences which are confounding for mechanical parsers. I am looking over sentences given here, and I have the following (very short) ...
4
votes
3answers
205 views
American English Corpus with spoken language exchange
I'm looking for an American English Corpus with spoken language exchange. There are many terms used. E.g. eTandem, tandem, etc.
TIA
4
votes
1answer
2k views
Is there a computational method to syllabify English words?
There are straightforward ways to convert English words to phonemes via a dictionary that contains such information. However, is there a way to automatically convert English text into syllables? I.e., ...
