All Questions
174 questions with no upvoted or accepted answers
7
votes
0
answers
191
views
Combinatory Categorial Grammar (комбинаторная категориальная грамматика) developments and lexicon for Russian language?
I am trying to apply Cornell Semantic Parsing framwork https://github.com/cornell-lic/spf (implementation of Combinatory Categorial Grammars CCG) to Russian language. This framework takes natural ...
- 499
6
votes
0
answers
333
views
Formal Language theory (context free grammars, pushdown automata)
Does anyone know any good introductions to Formal Language theory and Formal Grammar, that covers the mathematical basis of Syntax and things like context free grammars and pushdown automata? In ...
- 229
5
votes
0
answers
64
views
Which method measures the degree of disagreement in online comments?
I am researching Fake News as a topic at my university. Right now, I am searching for some literature in which a method for measuring the degree of disagreement in an online comment setting (Facebook, ...
- 51
5
votes
0
answers
65
views
Combinatory Categorial Grammar for inflected languages?
Can combinatory categorial grammars be used for inflected languages like Slavic and Baltic languages? I am aware only of this thesis https://pwmarcz.pl/pm-thesis-final.pdf
As far as I have ...
- 499
5
votes
0
answers
216
views
Genitive forms (German)
Do you know any rule how I can decide (formally), wheter a German sentence contains a Genitivus subjectivus or a Genitivus objectivus?
Example: "der Besuch des Botschafters". Here, the ambassador ...
- 51
5
votes
0
answers
484
views
OCR program for IPA?
Is there a program that can convert a scan/image of IPA into any digital encoding? UTF-8 Unicode preferred, and low-cost preferred (open source would be especially nice).
- 203
4
votes
0
answers
160
views
Subject control or object control?
In the recent paper “Universal Dependencies” by de Larneffe, Manning, Nivre and Zeman, published in Computational Linguistics in 2021, page 277 the following example is given:
and it is said that ...
- 141
4
votes
0
answers
60
views
PoS tagger - technical corpus
I try to find corpus with technical language to train my model, but I cannot find it.
Do you know if there are any tagged PoS corpus in English related with technical language?
- 41
4
votes
0
answers
60
views
How should "at some time" be tagged in Universal Dependencies framework?
I want to tag a sentence
Jones was unemployed at some time before he graduated.
with UD tags. I'm not sure how to tag at some time.
Stanford parser suggests the reading:
case (time-6, at-4)
det (...
- 41
4
votes
0
answers
97
views
Using (e.g.) Stanford NLP for retrieving specific “indirect” objects
I am a computer scientist using Stanford NLP for extracting a Semantic Graph from plain text.
Through this tool I am already getting the universal dependencies but now I want to get all the possible ...
- 141
4
votes
0
answers
247
views
The expressive power of languages : Information content in a sentence : How do we measure it
What is your name
Isme shoma chi e
Two sentences - same content.
My question is about the way to measure information content in a language. How do we do this? Because quite evidently count of the ...
- 580
4
votes
0
answers
112
views
What is the difference between AUG and CCG?
What is the difference between Applicative Universal Grammar and Combinatory Categorial Grammar? They both use type inference rules to define their grammars. Is it simply that CCG uses combinatory ...
- 51
4
votes
0
answers
96
views
Kuryłowicz on cases and prepositions
I've read Kuryłowicz's classic paper "Le problème du classement des cas" and I'm not sure how to interpret what he says about the difference between case affixes and prepositions. Does he in effect ...
user8145
4
votes
0
answers
215
views
Where can I find Japanese-English (manually) word-aligned corpora?
I'm looking for as many very reliable Japanese-English corpora as possible so I'd like to ask:
Are there any other manually aligned corpora besides KFFT's and
Utiyama's?
What are the most accurate ...
- 41
4
votes
0
answers
360
views
How to decrease CRF++ feature function set?
I have a problem with the CRF++ Package. CRF++ cannot handle large training parts-of-speech corpora (large tagset and large number of words).
In fact, the number of feature functions automatically ...
- 141
3
votes
0
answers
35
views
List of counter examples + statistics of Greenberg's universal
I could not find a list of counter examples/ statistics of Greenberg's linguistic universals.
There are numbers that I could find relevant information on WALS. There are some I could not find anything....
- 374
3
votes
0
answers
48
views
Computer analysis of ESL learners' mistakes
This is a very broad question; I'm trying to get a sense of the current state of this subfield of NLP and what relevant resources may already exist, so even tangential answers will be welcome.
To what ...
- 11k
3
votes
0
answers
61
views
How to incorporate sentence end marker in POS tagging with viterbi algorithm?
I am self-reading the NLP book by Dan Jurafsky. In the book, the following equation is given for incorporating the sentence end marker in the Viterbi algorithm for POS tagging.
I am confused why the ...
- 131
3
votes
0
answers
143
views
How can I calculate the morphological similarity between sentences?
For my bachelor thesis i am probing various text similarity metrics for how much they incorporate different aspects of sentences.
To get those aspects I use datasets that are annotated for semantic ...
- 31
3
votes
0
answers
61
views
State of the art in controlled english languages?
https://en.wikipedia.org/wiki/Controlled_natural_language lists some controlled languages, of which Attempto Controlled English seems to be the most recent. However, are there any Attempto extensions, ...
- 131
3
votes
0
answers
75
views
Computational linguist's estimate of minimum hours of speech needed to train a neural net to recognize speech
From a computational linguist's point of view, is there a lower limit on the number of hours of speech needed to train a neural net to translate speech to text? An estimate from CMU is 3000-5000 hours ...
- 131
3
votes
0
answers
82
views
Does StanfordNLP have a problem with adverbs?
I suspect not, and I'm being dumb, but ...
Usain ran quickest.
is parsed (https://corenlp.run) as
NNP VBZ JJS.
Why JJS (Adjective, superlative) and not RBS (Adverb, superlative)?
Using extended ...
- 133
3
votes
0
answers
44
views
Grammar induction from grammaticality rules
Let's have formalisation of grammaticality judgments in some deduction system. Is it possible to learn/induce grammar from rules that govern grammaticality judgments? Is there theory, that connects ...
- 499
3
votes
0
answers
36
views
What is the term for a specific type of collocation analysis
I am trying to write a text processing script in R. I am interested in finding a word (from a list of words I have selected) only if it is in the same sentence as another word.
Eventually I would ...
- 169
3
votes
0
answers
213
views
Are there any computational linguists who still use prolog?
My understanding is that in the 90's and early 2000's, expert systems and logical rules dominated the field of natural language processing/computational linguistics, but that for the last 10 years, ...
- 345
3
votes
0
answers
56
views
Specification of Dependency Grammar
My understanding is that, while natural languages aren't completely context-free, you can get a good approximation of a specification of English in Backus-Naur form, in that if you look at a given ...
- 345
3
votes
0
answers
96
views
Is there a phrasal verb corpus somewhere online?
I'm working on a project where I have syntactic frames in the form of something like "N.agent V PP.stimulus", where each PP consists of a P and a N.
I have a set list of verbs, and a list of PPs for ...
- 31
3
votes
0
answers
60
views
Connections between combinatory categorial grammars and abstract categorial grammars?
Are there connections/translation or common tools usage/adaptation between combinatory (concrete) categorial grammars (incl. Lambek calculus) and abstract categorial grammars? Can tools for one of ...
- 499
3
votes
0
answers
110
views
How to get morphological information from Stanford POS tagger?
I'm using the Stanford POS tagger to process German text and I'm interested in assessing the number (singular/plural) of the nouns in the sentence, so that I can classify them accordingly. This is ...
- 86
3
votes
0
answers
181
views
Distribution of the set of meanings of a given word, in a corpus
I am looking to know about the distribution of word senses, of a particular word in a corpus. How often a word sense will occur out of all the occurrences of that word with any meaning.
For example: ...
3
votes
0
answers
27
views
Publication venues focusing on reproducing results
Is there any publication venue for natural language processing focusing on reproducing results from other papers?
- 1,698
3
votes
0
answers
38
views
NER model training question
I have a question on NER?
Suppose I have set of documents and do manual tagging for all the names in that document. Now based on those tagged words I train my model (using CRF), i.e. add the tagged ...
3
votes
0
answers
69
views
Are there any publicly available spell checking corpora?
I need some corpora that contain sentences with misspelled word(s) in order to evaluate the performance of my own spell checking approach. So, the corpora should define the right word alongside the ...
- 139
3
votes
0
answers
194
views
Is there a relationship between rank(token) and max(rank(tokens in document))?
Given a language L, a target word w, a [Zipfian] distribution of word frequencies (Rank(w)) and a [gamma] distribution of sentence lengths, can we come up with a way to determine the approximate count ...
- 31
3
votes
0
answers
301
views
Downloadable list of Romance-language cognates?
I'm looking for tables of cognates between French, Spanish and Italian (and potentially Latin, Portuguese, Catalan, etc.), so I can run some Python on them.
If they could have extra information such ...
- 163
3
votes
0
answers
215
views
Inside-outside algorithm (PCFG learning) and binarization
I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
- 31
3
votes
0
answers
156
views
What are the foundational papers in computational phonology?
I'm working on a paper on the history of computational phonology.
As I understand it, Chomsky & Halle's SPE acted as a catalyst for research in the field, namely by laying the foundations for two-...
- 320
3
votes
0
answers
498
views
Stanford NLP parsers and idioms that have common semantic meaning
I have parsed the following sentence in the Stanford CoreNLP demo page and the Stanford parser demo page. Although both result in a parse that can imply purpose semantics (hinging on the advcl and the ...
- 299
3
votes
0
answers
72
views
Any NLP performance timeline?
I am looking for any plots, etc. that show performance metrics on various NLP tasks as a function of year.
E.g. the following figure shows the evolution of performance of face recognition systems:
- 1,698
3
votes
0
answers
226
views
Writer/math student seeking an overview of linguistics. Help?
I am a math and statistics student/enthusiast as well as a fiction writer with cultivated interest in a few foreign languages. Linguistics has held appeal to me for many years, but I admit to having ...
- 31
3
votes
0
answers
353
views
Calculating margin of error for precision and recall
I commonly calculate the precision and recall for information pulled from text but I'm not sure how to calculate the margin of error for those precision and recall values.
So for example, if I have a ...
- 156
2
votes
0
answers
44
views
Dependency grammar based dictionary
A presupposition of constructing the dependency semantic structure of a sentence is the knowledge of semantic features of all sentence's semantemes (actants, semantemes' nature as predicate or name ...
- 171
2
votes
1
answer
204
views
Are there dictionaries which use Venn diagrams or set theory to clarify similarities between words?
Do there exist dictionaries containing
lists of many different specific, not general, definitions of a word x
lists of many detailed definitions or examples of a word y
Venn diagrams showing which ...
- 133
2
votes
0
answers
32
views
What are the practical differences between type-logical/categorial and context-free based approaches to semantic parsing?
I am currently reading Bob Carpenter's Type-Logical Semantics, which goes over the Type-Logical approach to natural language semantics. I understand that categorial grammar is technically different ...
- 161
2
votes
0
answers
108
views
Turing-completeness of Minimalism and HPSG
I read several times that HPSG and Minimalism are Turing-complete. Could someone explain (or tell me some references) why this is the case? And does this constitute a major problem since natural ...
- 131
2
votes
0
answers
85
views
How to determine structure of answer for a wh- question
Consider a wh-question (in english language) such as "Who closed the door?". Personally, I can determine that an answer will look like "NP closed the door.", where NP would be a ...
- 21
2
votes
0
answers
72
views
*Compact* Context-Free Grammar for English
I have seen that similar questions have been asked here, but the common answer is to look at Generalized Phrase Structure Grammar. Then, on the internet I just find slides from computational ...
- 44
2
votes
0
answers
1k
views
What exactly is the Structure-Dependency Principle
Could someone explain what structure-dependency is in layman terms, and why it's so important?
Resources I've found on the internet weren't of much help so I'm asking on here.
Thanks!
- 121
2
votes
0
answers
82
views
How to find the characteristics of a bunch of word Clusters?
My Motivations I'm trying to learn German and realized there's a confounding fact with the structure of German: every noun has a gender which seems unrelated to the noun itself in many cases.
Unlike ...
- 121
2
votes
0
answers
87
views
Word alignment for Switchboard Dialogue Acts Corpus
I am trying to connect the dialogue acts of the Switchboard Dialogue Acts Corpus with the word alignment timing information available here.
I can see how it is possible to match up every utterance ...
- 576