Questions tagged [datasets]
For questions asking for datasets for a specific linguistic purpose and for questions on details of public or frequently used linguistic datasets.
38
questions
3
votes
1
answer
76
views
Can the Hunspell dictionary format capture things beyond prefixes and suffixes?
I know this is mostly a technical / data question, but it is majorly about linguistics too and I don't think this is really up the alley of a lot of software engineers, so I am asking here.
So the ...
- 4,306
0
votes
2
answers
71
views
What is the meaning of these verbal roots in The Concise Dictionary of Akkadian?
I am referring to this PDF or this HTML version of the "verbal roots" in The Concise Dictionary of Akkadian.
The HTML site says of them pretty much the same thing:
This index of Akkadian ...
- 4,306
0
votes
0
answers
76
views
Which datasets can I use to train a medical speech recognition system?
So far I found:
ezDI Medical Dictation Dataset (16h)
https://www.kaggle.com/datasets/paultimothymooney/medical-speech-transcription-and-intent (8h)
Which other datasets can I use to train a medical ...
- 1,588
1
vote
1
answer
65
views
PHOIBLE as a graph database?
Is there a phonological inventory database along the lines of PHOIBLE, but represented as a graph database in the vein of e.g. Prolog or Datalog?
From the kinds of questions that get referred to ...
- 143
1
vote
1
answer
129
views
Is there a list of dead languages specifying the causes?
I am looking for a list, database, or encyclopedia of dead languages (better if it includes endangered ones) which specifies the causes wherby each of these languages died, or if the cause is unknown.
...
- 141
1
vote
1
answer
107
views
Is there a compendium for sound laws?
Sound laws such as the Canaanite shift, which is the proposed law that Proto-NW-Semitic *ā -> Proto-Canaanite ō, and the celebrated Grimm's Law.
Is there a database that lists all transformations ...
- 253
4
votes
0
answers
46
views
Dataset for distribution of different systems for 'yes' and 'no' cross-linguistically?
The Wikipedia article for 'Yes and no' lists various distinct, common, systems for expressing the affirmative and the negative, ranging from no explicit terms (instead relying on echo responses) to ...
- 203
0
votes
1
answer
97
views
Data analysis of æ (tense) and æ: (lax) (Lexical Phonology)
I am struggling with performing a phonological analysis (within the framework of Lexical Phonology) on the following data.
In an unspecified English dialect, the distribution of the vowels æ (tense) ...
- 1
2
votes
2
answers
832
views
Dataset of English verb forms (conjugation)
What are some exhaustive/accurate datasets of English verb forms? From this closed SO question, I see:
GCIDE_XML, which contains plurals, alt spellings and conjugations, and is in XML format.
Need ...
- 1,588
1
vote
2
answers
153
views
Is there a database or standard (ISO etc.) which maps Unicode or ISO-15924 scripts with the ISO-639/Glottolog etc. languages that use them
Is there a database or standard (ISO etc.) which maps Unicode or ISO-15924 scripts with the ISO-639/Glottolog etc. languages that use them, so that I can make queries like the following on it:
For an ...
- 337
-1
votes
1
answer
69
views
What etext sources do we have for the Gothic Language?
It is very hard to search for "Gothic" in Google, because it finds modern gothic stuff which is not what I'm looking for. I found the word "𐌰𐌻𐌰𐍂𐌴𐌹𐌺𐍃" (but I can't find a definition haha), and ...
- 4,306
1
vote
1
answer
159
views
How to decode the Cuneiform ORACC data?
I just found this, the "OGSL Signlist" for Cuneiform. Remove the frame to get here. I click on a sign like A.EDIN and see this:
Values:eribₓ; eru₄; erua; erum₄; ummuₓ; ummudₓ.
for |A.EDIN| as ...
- 4,306
0
votes
1
answer
52
views
What are the recommended sources for research about conceptual metaphor?
I would like to find what have been done in research about conceptual metaphor. I've looked into some database, e.g. ERIC, Sciencedirect, WileyOnlineLibrary, JSTOR, Cambridgecore, Taylor&Francis, ...
6
votes
1
answer
131
views
What are the conventions for corpus usage?
Suppose I'm working with a language that doesn't have much data available; the largest corpus around is a translation of the Bible, which is free to read online, but is presumably still copyrighted by ...
- 63.9k
5
votes
0
answers
160
views
What happened to the number of english speakers in february 2018?
I recently noticed that English was in front of Mandarin in the Wikipedia list of languages by total number of speakers, so I wondered when it became first. I didn't find any convenient statistics on ...
- 59
2
votes
1
answer
41
views
One-to-one speech conversation dataset (Recorded over microphone)
I need a publically available one-to-one speech conversation dataset recorded over the microphone, e.g., interview scenario or enquiry or call centre call answering.
1
vote
3
answers
226
views
Sources on statistics of phonological properties of languages
I am looking for basic linguistic properties of Indo-European languages that provide a purely statistical description of the phoneme-aspect of the language. I am looking for any of the following data:
...
- 111
2
votes
1
answer
85
views
Where do I find datasets for linguistic phylogenetics?
Where can I find machine readable datasets for use in phylogenetic estimation? I am looking for anything---lexical cognate data, phonological data, morphosyntactic data---in any language family.
- 121
0
votes
1
answer
123
views
Where would I go to find a hierarchical list of occupations in English?
I'd like to get an electronic list of occupations/professions/jobs in English, like "doctor," "cowboy," "assistant to the regional manager," etc.
I can't quite find this in the WordNet hierarchy (...
- 181
2
votes
1
answer
179
views
Looking for large word list file/db (>1k) with IPA transcriptions
I'm building a mobile app to practice/teach IPA. The idea is you look at a word and then input the correct IPA.
I've used some dictionary APIs, but they either:
Don't include the IPA
If it includes ...
- 21
1
vote
0
answers
35
views
Online data giving numbers and frequencies of nouns in some well-known novels?
Are there any freely available online data giving the numbers and frequencies of nouns used in some well-known novels, whether or not the novels are in the public domain? I mean data such as
Dan ...
user20601
4
votes
1
answer
212
views
Where can I find the HISTORICAL data on the total no of speakers of a language?
E.g. in total, how many people around the world spoke Spanish and French respectively in the 18th century?
Well, I know the data on most languages are scanty. So no, I'm focusing on major world ...
- 145
3
votes
0
answers
35
views
Database of formalized english sentences?
(Not sure if this is the right site to ask)
Is there an online (preferably free) database of English sentences and the corresponding first-order representations?
- 131
0
votes
1
answer
795
views
How to get the similarity between languages?
Is there a good dataset or library or some trick for getting the similarity between languages, or n most similar languages?
Similarity here means lexical and structural similarity for the purposes of ...
- 7,531
1
vote
0
answers
18
views
data sources and/or softwares to get morphological derivation of words
What data sources and/or softwares can generate a list of morphological derivatives for a given English word?
- 111
1
vote
0
answers
154
views
Synonym/hyponyms/hypernym detection data set
I am looking for data sets that I could use to train and benchmark a system that detects synonyms, hyponyms and hypernyms in a text.
For example, in the sentence
In statistics, logistic ...
- 1,588
2
votes
1
answer
404
views
building a corpus from COCA KWIC
I'd like to look at an adjective + clause (adverbial, to-infinitival, -ing) combination in COCA and I'm happy with the KWIC results I got so far.
For my further analysis, it would be useful to have ...
- 21
3
votes
1
answer
193
views
Open Dataset Latin Verb Forms
Is there an open data set (freely available, permissive license) of latin grammar available ? I am thinking about verbs and translations alongside verb forms in various tenses and cases etc.
The ...
- 131
1
vote
2
answers
281
views
Spoken Language Dataset of L2 Acquisition
Is there a publicly available dataset of spoken language for L2 acquisition? I would prefer children learning an L2, but any age range is fine. It would be great, but not necessary, to have speaking ...
- 576
0
votes
0
answers
73
views
I am looking for Danish/Dutch/English/Finnish/French/German/Italian/Norwegian/Spanish/Swedish/Turkish sms corpora
for my dissertation I am looking for sms corpora. I am mainly interested in automatic sms notifications that are sent to users when they buy things online or pay using credit cards (confirmation ...
2
votes
2
answers
2k
views
Where to find lists of examples of linguistic phenomena
I'm looking for resources, either print or online, which compile lists of examples of linguistic phenomena, be they phonological, morphological, syntactic, or semantic. (My main purpose for these ...
- 428
0
votes
0
answers
81
views
What is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?
In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, what is the interlabeler agreement in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, when using the 6-class tagset?
The 6-class tagset I am ...
- 1,588
2
votes
0
answers
204
views
What are the fillers in the ICSI Meeting Recorder Dialog Act (MRDA) Corpus?
In the ICSI Meeting Recorder Dialog Act (MRDA) Corpus, which label(s) correspond to the Filler class?
I have read a couple of article (e.g. (1)) saying there exist a widely applied classmap that ...
- 1,588
0
votes
1
answer
516
views
Pre-trained English language models
I am looking for pre-trained, downloadable English language models. Where can I find some good ones?
- 1,588
1
vote
1
answer
159
views
Data sets for sequential short text classification
I am looking for data sets that I could use to perform sequential short text classification (multilabel is OK). By short text I mean ~100 words max. By sequential I mean that the texts should follow ...
- 1,588
2
votes
1
answer
719
views
Co-occurrence count data sets
I am looking for downloadable word co-occurrence matrices that were computed on large corpora. word2vec and GloVe have on their website downloadable word vectors, I am looking for something similar ...
- 1,588
1
vote
0
answers
130
views
Structured database of the ACL Anthology data set?
Is there any structured database of the ACL Anthology (former website; new website)? By structured database I mean some SQL dump (NoSQL is fine too) that would contain all papers' meta information (...
- 1,588
3
votes
1
answer
152
views
Benchmark data sets for negation detection systems
I am looking for data sets that I could use to train and benchmark negation detection systems.
- 1,588