Questions tagged [statistical-mt]

The theory and practice of MT that uses probabilistic models and statistical decision procedures to generate optimal translations. Usually included is the task of multilingual text alignment.

Filter by
Sorted by
Tagged with
-2 votes
1 answer

Is large language model “perplexity” on an input the total of its perplexity for the smallest parts? [closed]

“Perplexity” is how likely a large language model scores an output it gives as being the output it should have given. If the model does not produce responses for itself to choose from that it ...
Nima's user avatar
  • 17
0 votes
3 answers

Is there a topic in linguistics that uses differential calculus or AP stats level statistics?

I'm doing a math project that requires the research of an application of differential calculus or statistics, and as someone who is very interested in linguistics, I was wondering if there is any area ...
Linguist123's user avatar
0 votes
0 answers

Is there any theory for mathematically judging the quality of a parallel corpus before running it through a machine translation pipeline?

The performance of a machine translation system is highly impacted by the parallel corpus it is trained on. Therefore, as we all know, a good quality normalized and (ideally) noise-free corpus is ...
Musfiqur Rahman's user avatar
0 votes
0 answers

What do distributed frequency and raw frequency mean?

What do distributed-frequency, distributed-frequency cum-age, raw-frequency, and raw-frequency-cum-range mean? They are mentioned on link: "Second, young age group under 15 rely more on core ...
Mr Anonymous's user avatar
1 vote
0 answers

Direction of alignment function in statistical machine translation

I'm trying to learn IBM Models and statistical machine translation. I have read various resources and realized that in same articles, alignment function is designed in direction from target language ...
AfterCoder's user avatar
1 vote
0 answers

Simple bigram letter model

I am working through an exercise where, given a set of corpora, I will implement a simple model on a test corpus to determine the most likely corpus. Say the corpora with which I want to learn are ...
Héctor's user avatar
  • 19
1 vote
2 answers

What are some good books/MOOCs in field of computational semantic analysis?

I have recently started learning Natural Language Processing and while reading research papers I came across terms like "Latent Dirichlet Allocation", "Latent Semantic Analysis", "Gaussian ...
Riken Shah's user avatar
2 votes
1 answer

How lexical ambiguity addressed in phrase-based SMT

I am wondering how the lexical ambiguity is addressed in phrase-based statistical machine translation?
Nasser's user avatar
  • 123
0 votes
0 answers

Phrase suggestion model using a gold standard corpus

There are already spell checking models available which help us to find the suggested correct spellings based on a corpus of trained correct spellings. Can the granularity be increased to "word" from ...
lingo101's user avatar
  • 240
2 votes
1 answer

What statistical methods are appropriate to comparing e.g. VOT across different groups?

As part of forensic linguistics practice, I must assess the relative age of multiple individuals based only voice. One crucial variable is VOT, which is known to decrease with age. So, let's say ...
Teusz's user avatar
  • 2,701
3 votes
4 answers

"Episode 78" machine mistranslation etymology

This post on Rocket News 24 described a Google Translate bug, in which さよなら大好きな人 was translated into "Episode 78". This bug is still live as of the time of writing, and you can replicate it ...
March Ho's user avatar
  • 405
2 votes
1 answer

Can the entropy per word be caculated precisely?And relation among information theory, semantics, and pragmatics

What we have gotten about the expected per word entropy of random yet grammatical text is just some upper bound of the the expected per word entropy, because we have not found the exact way to compute ...
XL _At_Here_There's user avatar
2 votes
0 answers

Generalisations which a bi-gram probabilistic model might infer from a dataset

I have the following exam question for a machine translation course: From my understanding, I assume the answer is looking for incorrect English grammar which get discovered by bi-grams. So the ...
TomSelleck's user avatar
4 votes
1 answer

Automated methods to align text

I have an assignment for my machine translation class which involves using the different language versions of websites as parallel corpora. The problem is the text isn't properly aligned. For example:...
TomSelleck's user avatar
13 votes
3 answers

How do purely statistical machine translators deal with different word orders?

Even relatively closely related languages can differ greatly in word order. Take English and German for instance. English is pretty boringly subject-verb-object whereas in German the finite verb must ...
hippietrail's user avatar
  • 14.6k
8 votes
4 answers

Machine translation - Rule-Based and Statistics-Based approaches

My question is about the current situation in machine translation. I am aware about two main approaches to machine translation. One which is based in a strong way on linguistic theory and another ...
Gil Kalai's user avatar
  • 317