Questions tagged [datasets]

For questions asking for datasets for a specific linguistic purpose and for questions on details of public or frequently used linguistic datasets.

Filter by
Sorted by
Tagged with
0 votes
1 answer
39 views

PHOIBLE as a graph database?

Is there a phonological inventory database along the lines of PHOIBLE, but represented as a graph database in the vein of e.g. Prolog or Datalog? From the kinds of questions that get referred to ...
1 vote
1 answer
119 views

Is there a list of dead languages specifying the causes?

I am looking for a list, database, or encyclopedia of dead languages (better if it includes endangered ones) which specifies the causes wherby each of these languages died, or if the cause is unknown. ...
  • 141
1 vote
1 answer
59 views

Is there a compendium for sound laws?

Sound laws such as the Canaanite shift, which is the proposed law that Proto-NW-Semitic *ā -> Proto-Canaanite ō, and the celebrated Grimm's Law. Is there a database that lists all transformations ...
4 votes
0 answers
41 views

Dataset for distribution of different systems for 'yes' and 'no' cross-linguistically?

The Wikipedia article for 'Yes and no' lists various distinct, common, systems for expressing the affirmative and the negative, ranging from no explicit terms (instead relying on echo responses) to ...
0 votes
1 answer
87 views

Data analysis of æ (tense) and æ: (lax) (Lexical Phonology)

I am struggling with performing a phonological analysis (within the framework of Lexical Phonology) on the following data. In an unspecified English dialect, the distribution of the vowels æ (tense) ...
  • 1
2 votes
2 answers
580 views

Dataset of English verb forms (conjugation)

What are some exhaustive/accurate datasets of English verb forms? From this closed SO question, I see: GCIDE_XML, which contains plurals, alt spellings and conjugations, and is in XML format. Need ...
1 vote
2 answers
134 views

Is there a database or standard (ISO etc.) which maps Unicode or ISO-15924 scripts with the ISO-639/Glottolog etc. languages that use them

Is there a database or standard (ISO etc.) which maps Unicode or ISO-15924 scripts with the ISO-639/Glottolog etc. languages that use them, so that I can make queries like the following on it: For an ...
-1 votes
1 answer
56 views

What etext sources do we have for the Gothic Language?

It is very hard to search for "Gothic" in Google, because it finds modern gothic stuff which is not what I'm looking for. I found the word "𐌰𐌻𐌰𐍂𐌴𐌹𐌺𐍃" (but I can't find a definition haha), and ...
  • 3,473
1 vote
1 answer
123 views

How to decode the Cuneiform ORACC data?

I just found this, the "OGSL Signlist" for Cuneiform. Remove the frame to get here. I click on a sign like A.EDIN and see this: Values:eribₓ; eru₄; erua; erum₄; ummuₓ; ummudₓ. for |A.EDIN| as ...
  • 3,473
0 votes
1 answer
51 views

What are the recommended sources for research about conceptual metaphor?

I would like to find what have been done in research about conceptual metaphor. I've looked into some database, e.g. ERIC, Sciencedirect, WileyOnlineLibrary, JSTOR, Cambridgecore, Taylor&Francis, ...
6 votes
1 answer
126 views

What are the conventions for corpus usage?

Suppose I'm working with a language that doesn't have much data available; the largest corpus around is a translation of the Bible, which is free to read online, but is presumably still copyrighted by ...
  • 53.9k
5 votes
0 answers
158 views

What happened to the number of english speakers in february 2018?

I recently noticed that English was in front of Mandarin in the Wikipedia list of languages by total number of speakers, so I wondered when it became first. I didn't find any convenient statistics on ...
2 votes
1 answer
41 views

One-to-one speech conversation dataset (Recorded over microphone)

I need a publically available one-to-one speech conversation dataset recorded over the microphone, e.g., interview scenario or enquiry or call centre call answering.
1 vote
3 answers
206 views

Sources on statistics of phonological properties of languages

I am looking for basic linguistic properties of Indo-European languages that provide a purely statistical description of the phoneme-aspect of the language. I am looking for any of the following data: ...
2 votes
1 answer
80 views

Where do I find datasets for linguistic phylogenetics?

Where can I find machine readable datasets for use in phylogenetic estimation? I am looking for anything---lexical cognate data, phonological data, morphosyntactic data---in any language family.
  • 121
0 votes
1 answer
110 views

Where would I go to find a hierarchical list of occupations in English?

I'd like to get an electronic list of occupations/professions/jobs in English, like "doctor," "cowboy," "assistant to the regional manager," etc. I can't quite find this in the WordNet hierarchy (...
  • 181
2 votes
1 answer
149 views

Looking for large word list file/db (>1k) with IPA transcriptions

I'm building a mobile app to practice/teach IPA. The idea is you look at a word and then input the correct IPA. I've used some dictionary APIs, but they either: Don't include the IPA If it includes ...
  • 21
1 vote
0 answers
34 views

Online data giving numbers and frequencies of nouns in some well-known novels?

Are there any freely available online data giving the numbers and frequencies of nouns used in some well-known novels, whether or not the novels are in the public domain? I mean data such as Dan ...
's user avatar
4 votes
1 answer
157 views

Where can I find the HISTORICAL data on the total no of speakers of a language?

E.g. in total, how many people around the world spoke Spanish and French respectively in the 18th century? Well, I know the data on most languages are scanty. So no, I'm focusing on major world ...
  • 145
3 votes
0 answers
33 views

Database of formalized english sentences?

(Not sure if this is the right site to ask) Is there an online (preferably free) database of English sentences and the corresponding first-order representations?
  • 131
0 votes
1 answer
713 views

How to get the similarity between languages?

Is there a good dataset or library or some trick for getting the similarity between languages, or n most similar languages? Similarity here means lexical and structural similarity for the purposes of ...
1 vote
0 answers
18 views

data sources and/or softwares to get morphological derivation of words

What data sources and/or softwares can generate a list of morphological derivatives for a given English word?
  • 111
1 vote
0 answers
147 views

Synonym/hyponyms/hypernym detection data set

I am looking for data sets that I could use to train and benchmark a system that detects synonyms, hyponyms and hypernyms in a text. For example, in the sentence In statistics, logistic ...
2 votes
1 answer
318 views

building a corpus from COCA KWIC

I'd like to look at an adjective + clause (adverbial, to-infinitival, -ing) combination in COCA and I'm happy with the KWIC results I got so far. For my further analysis, it would be useful to have ...
  • 21
3 votes
1 answer
159 views

Open Dataset Latin Verb Forms

Is there an open data set (freely available, permissive license) of latin grammar available ? I am thinking about verbs and translations alongside verb forms in various tenses and cases etc. The ...
  • 131
1 vote
2 answers
273 views

Spoken Language Dataset of L2 Acquisition

Is there a publicly available dataset of spoken language for L2 acquisition? I would prefer children learning an L2, but any age range is fine. It would be great, but not necessary, to have speaking ...
  • 576
0 votes
0 answers
71 views

I am looking for Danish/Dutch/English/Finnish/French/German/Italian/Norwegian/Spanish/Swedish/Turkish sms corpora

for my dissertation I am looking for sms corpora. I am mainly interested in automatic sms notifications that are sent to users when they buy things online or pay using credit cards (confirmation ...
2 votes
2 answers
2k views

Where to find lists of examples of linguistic phenomena

I'm looking for resources, either print or online, which compile lists of examples of linguistic phenomena, be they phonological, morphological, syntactic, or semantic. (My main purpose for these ...
0 votes
0 answers
79 views

What is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset? The 6-class tagset I am ...
2 votes
0 answers
200 views

What are the fillers in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus?

In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, which label(s) correspond to the Filler class? I have read a couple of article (e.g. (1)) saying there exist a widely applied classmap that ...
0 votes
1 answer
516 views

Pre-trained English language models

I am looking for pre-trained, downloadable English language models. Where can I find some good ones?
1 vote
1 answer
150 views

Data sets for sequential short text classification

I am looking for data sets that I could use to perform sequential short text classification (multilabel is OK). By short text I mean ~100 words max. By sequential I mean that the texts should follow ...
2 votes
1 answer
667 views

Co-occurrence count data sets

I am looking for downloadable word co-occurrence matrices that were computed on large corpora. word2vec and GloVe have on their website downloadable word vectors, I am looking for something similar ...
1 vote
0 answers
118 views

Structured database of the ACL Anthology data set?

Is there any structured database of the ACL Anthology (former website; new website)? By structured database I mean some SQL dump (NoSQL is fine too) that would contain all papers' meta information (...
3 votes
1 answer
149 views

Benchmark data sets for negation detection systems

I am looking for data sets that I could use to train and benchmark negation detection systems.