I recently had a text translated into Icelandic. When I machine translate that human translation back to English, it came out as quite awkward English. However, when I machine translate the machine translation back to English, it came out sounding perfect.

Is that just because it has high fidelity going both ways, even though it is wrong? Or should I suspect the human translator's version is wrong and he does not actually speak Icelandic well?

The original English text:

I felt it was a reasonable assumption that the developers would know about this method.

The human translation into Icelandic:

Mér fannst eðlilegt að ganga út frá því að leikjahöfundarnir þekktu til aðferðarinnar.

The machine translation into Icelandic:

Ég fann að það var sanngjarnt forsendu að verktaki myndi vita um þessa aðferð.

*I used Google Translate for the machine translation.

  • Sorry, got to ask if I understand you correctly: You try to backtranslate your original sentence English1 from Icelandic to English (in order to double check translation quality): Input 1 = Machine translated version of English 1 Input 2 = Human translated version of Human 1 Output 1 = English 1 Output 2 = Something "quite awkwardly" Correct?
    – Largo
    Mar 9 '16 at 8:37
  • Round-trip translation has been used to some level of success by various online translation tools. While one of the answerers did show a valid point, babelfish did use round-trip fairly well. Mar 10 '16 at 20:58

A so-called round-trip translation is not a reliable signal that the translation worked well, for a few reasons.

Noisy parallel corpora are bi-directional.

Machine translation systems train on parallel corpora, which are often noisy. For example, suppose the following noise occurs in the training data:

en: "This is a rare sentence."  is: "Rænðöm rænðöm gíbberish."

Note that there is no sense of directionality here; the English-Icelandic system learns:

en: "This is a rare sentence." -> is: "Rænðöm rænðöm gíbberish."

while the Iceland-English system learns:

is: "Rænðöm rænðöm gíbberish." -> en: "This is a rare sentence." 

In this simplified example, the output of the round-trip translation - trans('is', 'en', trans('en', 'is', x)) - will likely be x. The two mistakes cancel each other out. This happens more often than it would if translation mistakes were simply random.

Even good translation is lossy.
A translation, and even a language itself, is lossy. Distinctions of meaning, gender, tu/vous, tense and aspect are not represented equivalently or at all in all languages. Ambiguities are also not necessarily represented.

Let us consider an example, with English as the intermediate language to make it clear:

es: "La profesora Le está esperando."

We can legitimately translate this into English as:

en: "The teacher is waiting for you."

[Note: We lose the gender of the teacher, whether it is a schoolteacher or university professor, and the formality of you, and any choices about word order.]
Now we translate back into Spanish:

es: "Te espera el maestro."

That round-trip translation very different than the original, although the translation in both steps was correct. This dynamic applies to both human and machine translations.

Machine translation is not perfect.
The lack of readability of the machine translation of Icelandic text written by a human is possibly a signal that the human did not use that machine translation system but did, in fact, translate by hand in some way. In fact, good idiomatic translations are more difficult for machine or human translators.

The last dynamic applies to evaluating a human translation by machine translating it into some language you know.

  • 2
    To expand on your mention of idiomatic translations, one reason a machine translation of a hand-translated text might be awkward is that during the human translation they would translate in ways that makes use of the ways people actually speak Icelandic, and wouldn't just be trying to create a literal translation, so when the machine then does a more literal translation back the Icelandic idioms are likely to sound awkward or wrong in English
    – Kevin
    Jan 9 '18 at 21:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.