Questions tagged [parsing]
The process of syntactic analysis, usually used in the context of computational linguistics.
1
vote
0answers
19 views
English ditransitive verb phares in CKY algorithm
I was pondering about English ditransitive verb phrases. Say we have the following: Sofia the candle. I can assume the phrase structure VP -> V NP NP, which is not a binary production.
Any clue, how ...
0
votes
0answers
22 views
parsing British National Corpus into words
I need to calculate inverse document frequency from BNC. Does anybody has any code or know how to parse this dataset to extract texts? After extracting texts do I need to stem(get the base form of ...
3
votes
3answers
81 views
How far ahead we look when parsing and understanding text
Part of trying to understand how we mentally parse and understand text requires understanding how far ahead we look, which is what this question is about.
I'm wondering how we understand how to ...
2
votes
3answers
150 views
How can you know that a word in a sentence is a verb?
I am wondering what it takes to parse a sentence with incomplete knowledge. That is, take a sentence like this:
If I use timeout I have to call again my function at the end of the execution of the ...
2
votes
1answer
323 views
Python list to Parse tree
In Python, I have an input of list like following:
[('S', ['NP', 'VP']),
('A', ['V', 'NP']),
('VP', ['V', 'NP']),
('NP', ['DET', 'NP']),
('N', "'mouse'"),
('NP', "'mouse'"),
('DET', "'the'"),
('V', "'...
4
votes
1answer
84 views
Dependency parsing that preserves structural ambiguities?
Does a (publicly available) dependency parser exist, that either preserves structural ambiguities in its output or that allows me to generate all possible parse trees for a given input?
I am ...
2
votes
0answers
52 views
What features are good for dependency parsing?
I am trying to implement a graph based dependency parser. Since I come from a computer engineering perspective, I have trouble finding the features.
Assuming that we have a (head,dependent) relation ...
5
votes
1answer
231 views
What software is used to make these X-bar trees?
I'm looking for software for illustrating tree diagrams am wondering whether anyone knows which was used to create the one in the post linked below.
I have tried messaging the author, but had no ...
0
votes
1answer
57 views
What do these morphemes' abbreviated glosses mean?
I am taking a course on linguistics and got introduced to a lot of abbreviations. Other than the obvious V for verb, I am having a lot of trouble finding out what the others mean.
The book Speech and ...
2
votes
0answers
34 views
Connections between combinatory categorial grammars and abstract categorial grammars?
Are there connections/translation or common tools usage/adaptation between combinatory (concrete) categorial grammars (incl. Lambek calculus) and abstract categorial grammars? Can tools for one of ...
3
votes
1answer
37 views
Reference work needed for Phrase Markers in English
I need a thorough online site or downloadable text that goes into detail about English phrase markers as in this example from Beth Levin's Verb Alternations book "This alternation involves verbs found ...
1
vote
2answers
69 views
Semantic parsing vs Propositional Representation
Propositional representation is explained on Wikipedia.
How is semantic parsing different from propositional representation? Or is propositional representation the next step after you do semantic ...
6
votes
3answers
290 views
German Dependency Parsing - question about dependencies between “sich ____ lassen”
I'm working on project regarding german dependency parsing, and came across something Im a bit unsure about.
Using a parser, when given an input (wether it be in a sentence or just the verbs) which ...
3
votes
1answer
323 views
How to interpret the dependency parse tree of an English Slot Grammar?
I am reading the paper titled Deep parsing in Watson (DOI: 10.1147/JRD.2012.2185409) and need help understanding this figure:
This is the paragraph that describes the tree in the figure above:
An ...
0
votes
3answers
78 views
Parsing and a possible compound verb
To describe the ordinariness of a certain 25-year-old man, someone said:
He's the kind of guy that you could walk into a bar in any part of the country and see.
"A guy that you can see" makes ...
3
votes
0answers
30 views
Any good, up-to-date advanced textbooks/handbooks in statistical parsing?
I was wondering if there are any good, up-to-date advanced textbooks in parsing, after having finished the preliminary treatments in Jurafsky & Martin and Manning & Schütze. Either ...
8
votes
1answer
149 views
Representing knowledge extracted from output of dependency parsing
I am working on a problem to represent knowledge extracted from a paragraph and rank it to produce abstractive summaries. I have implemented dependency parsing using Stanford NLP, which gives dot ...
1
vote
0answers
65 views
Getting POS probabilities from TreeTagger in python?
Is there a way to get the underlying probabilities or pass a minimum probability threshold to treetaggerwrapper (the TreeTagger python wrapper module)?
The goal is to know when the POS tagging for a ...
0
votes
1answer
136 views
Find head noun, “he himself”
I have run into a problem when I am trying to find the head noun for a NP in this sentence. I haven't been able to find any rules explaining why one of them would be head, or if they even belong in ...
3
votes
1answer
231 views
Which one is head noun?
I am using a parser and I have run into a problem where I am unsure if the syntax tree that it is showing me is correct. The Noun Phrase is:
one of the lizards
My parser is telling me that "one" ...
3
votes
1answer
396 views
How to detect verb in a sentence where the verb is invisible in the sentence?
In case of some Indo-European languages it seems there is no visible verb in the sentence. This is specially visible in languages like Bangla, Hindi etc.
For example the sentence
Who is there?
is ...
2
votes
1answer
229 views
Mapping Minipar dependencies to Stanford Parser dependencies
I am trying to use the algorithm in Qiu et al., 2011, "Opinion Word Expansion and Target Extraction through Double Propagation" for my research. However, in the paper, they use Minipar for dependency ...
3
votes
0answers
42 views
How should “at some time” be tagged in Universal Dependencies framework?
I want to tag a sentence
Jones was unemployed at some time before he graduated.
with UD tags. I'm not sure how to tag at some time.
Stanford parser suggests the reading:
case (time-6, at-4)
...
1
vote
1answer
85 views
Automated wh movement for turning an answer into the form of a question
I am not a linguist but I want to know if there are any parsing tools in existence that can help me do the following kind of thing:
Given a sentence like the one below I would like to generate many ...
2
votes
0answers
794 views
Split a sentence using nltk and python
I am working on a task which involves information extraction, for which I require splitting a complex sentence into a bunch of simple sentences. For instance,
In optics a ray is an idealized model ...
1
vote
1answer
46 views
What is the name for the phenomenon of verb phrase being an argument of a predicate
In the sentence
He makes you want to leave early today to get more space for himself
instead of having NP as argument to the predicate "makes", we get an entire verb phrase "want to leave early ...
2
votes
0answers
29 views
Estimating the size of training data for grammer extraction
I have a dependency treebank including 100 sentences, which I divide into a training set and a test set. I extract some rules ((DS,PS) pairs) to convert the treebank to phrase structures. When I ...
1
vote
0answers
189 views
How to build a neural network dependency parser with a dynamic oracle?
I'm curruntly trying to improve the results of my dependency parser (arc-standard) when I found this article: that uses a dynamic oracle. https://www.aclweb.org/anthology/Q/Q13/Q13-1033.pdf The ...
2
votes
1answer
154 views
Convert a non projective dependency tree to a projective one
I'm trying to build a dependency parser and I want it to construct only projective trees.
Do you know any tool that converts Non-projective trees (CONLL-U format) to projective ones?
1
vote
0answers
37 views
What tokenization scheme was used for the conll-X arabic corpus?
I wanted to know what tokenization scheme was used to tokenize the conll-X arabic corpus which was used for the 2006 shared task on dependency parsing ?
5
votes
4answers
172 views
Can training a Part-of-Speech tagger and parser at the same time improve parsing results?
I was wondering if training both a POS tagger and a parser (be it constituency or dependency) at the same time improve the results of parsing in a deep architecture since deep learning can take ...
2
votes
2answers
210 views
How to derive training data for maltparser classifier from conll file
Could anyone explain how does the maltparser convert the dependency trees from a CONLL file to a series of transitions in order to train its classifier ?
1
vote
2answers
172 views
Unable to understand meaning of tag NONE *-1 in Penn Treebank example
I am completely naive and new to NLP. I am following a course on NLP on coursera. As I was studying about parse tree, I came across following sentence to parse:
Because the CD had an effective yield ...
0
votes
0answers
1k views
Automatically turn a question into a statement?
What's a practical way to programmatically convert questions into statements with placeholders?
For example:
in: 'Who is the president of the Argentina?'
out: ['The president of Argentina is ____.', ...
2
votes
1answer
94 views
What are the upsides of using dependency parsing over constituency parsing?
I am looking for an exhaustive list of upsides of using dependency parsing over constituency parsing (if possible, with references for each upside).
5
votes
1answer
67 views
What types of errors arise when converting consistency parse trees to dependency parse trees?
I wonder what types of errors arise when automatically converting consistency parse trees to dependency parse trees, and how frequent they are.
3
votes
5answers
108 views
Treebanks that contain both constituency and dependency parse trees
I am looking for treebanks that contain both constituency and dependency parse trees. Both should have been manually annotated (i.e. the dependency parse trees shouldn't have been obtained from the ...
4
votes
1answer
752 views
What part of speech is 'two o'clock' in this sentence? [closed]
I thought adverbs didn't modify nouns but then what's going on in these sentences:
It is nearly two o'clock
We were there for nearly an hour
The town is nearly forty miles from here
5
votes
1answer
339 views
Maltparser vs Freeling for Spanish dependency parser
I need to parse a Spanish corpus with syntactic dependencies. I have tried both Freeling and Maltparser, they both give similar results, but with some divergence. I need the highest accuracy possible, ...
2
votes
2answers
57 views
Said tags in Sentence detection
I am trying to apply NLP to fiction but I don't know how split dialog into sentences. Specifically how to split said tags.
ex.
"Awake? How long have been asleep?" asked teenagers at the same time.
...
5
votes
1answer
367 views
Performance improvements of using the shift-reduce Stanford Parser
I'm running NLP on large texts, and part of the questions I'm trying to answer have to deal with syntax. I'm using Stanford NLP, including the Stanford Parser. I started out using the probabilistic ...
1
vote
0answers
186 views
Average number of independent clauses in a compound sentence
I'm working on a NLP project, where we analyze large text samples (think a novel), and produce some metrics that help us answer interesting questions about the text. One of these metrics is average ...
3
votes
2answers
83 views
What are the most authoratative references on the notion of shallow parsing?
What are the most authoratative references on the notion of shallow parsing (also known as text chunking) in NLP? I am looking for definitions, examples, and discussion of strings of words that ...
3
votes
0answers
171 views
Inside-outside algorithm (PCFG learning) and binarization
I am implementing the Inside-outside algorithm to estimate the parameters of a PCFG based on the train corpus. One observation (on existing implementations) is that, the grammar is converted into ...
1
vote
0answers
110 views
Methods to dissect or parse long, difficult sentences
TL;DR: Only English and French can I manage and so ask for. Instead of repeating 'long, difficult' hereafter, denote it mazy. Mazy sentences still stifle my reading comprehension; so I was gladdened ...
2
votes
1answer
607 views
What it the best algorithm for dependency parsing?
There are quite a few statistical parsers but I'm interested in rule-based dependency parsing. I have a lexicon, i.e., a list of words with lemmas, POS, and morphological features. What is the best ...
1
vote
0answers
315 views
How do PCFG parsers actually work?
I'm new to NLP. I have a few doubts about PCFG parser (NLTK). My understanding is that PCFG parser will return most probable parse tree. So if I'm parsing one sentence with PCFG parser, I'll be ...
1
vote
1answer
701 views
Steps to build a dependency parser [closed]
I'm a beginner in NLP.
What are the main steps to build a dependency parser?
thanks.
7
votes
1answer
547 views
Earley Parser: Ambiguity
I've got a pretty basic question concerning the Earley parser: In case of syntactic ambiguity ( S -> NP VP(V NP(NP PP)) vs. S -> NP VP(VP((V NP) PP) ), are both parses stored in one chart or in two?
...
5
votes
1answer
98 views
How should grammatical errors be treated in parsing and tokenisation?
I'm writing a tokenizer/parser thing to parse & diagram a bunch of sentences gathered from ordinary language use. Most of it parses just fine by following rules, but from time to time there are ...
