There are plenty of software programs facilitating interlinear transcription (e.g. Toolbox, Fieldworks Language Explorer). There's also a number of tools that allow you to work on aligning parallel texts (mostly bitexts, but also some allowing multiple parallel texts) but it seems the options for small projects are much more limited and less user-friendly than is the case with tools for interlinear transcription. (Below I've included a short list of corpus/alignment tools that seem to be the most used / well-known). However, so far I have not found a program that allows an integrated approach, i.e. working on morphological analysis of a text that is already sentence-aligned. I'll first explain my use-case.

I am working on a collection of parallel texts in multiple languages, which are part of a religious document. Some of these languages are better documented than the one I'm focussing on, so while working on the morphological analysis of my target language, I would like to compare the equivalents of two of the other languages. Being able to do this simultaneously would also allow to fine-tune sentence-alignments. Having a fully annotated and sentence-aligned version is also a final goal.

From what I've seen so far, however, sentence alignment / corpus tools take already annotated texts as input; you then carry out paragraph, sentence (and may also word) alignments. When this work is done you can start investigating your texts: concordances, looking at collocations, etc. In my case, however, I want to use the aligned texts precisely to create the annotated version of my target language text.

Ideally there would be a single program to support both tasks, although I don't expect this to be the case (I've read in several places that there's a lack of good tools to support individual linguists in corpus work). Still, parallel text alignment is often used, especially in large projects (likely with technical support?!), so there must be ways of dealing with this sort of problem. I would like to hear about workflows/setups/formats that would make this possible. I'm thinking along one of these lines:

  1. A single program that supports both alignment and adding morphological annotation (one can always hope, right?)
  2. A workflow which allows adding layers of annotation to an already sentence-aligned parallel text. I suspect this to be possible, but: which combination of tools would make this possible? What formats can be used for import/export and how do you make sure the analysis layers match with the aligned sentences?
  3. As a last resort I could make a sentence alignment using any alignment tool and then use two programs simultaneously (check the translation equivalents in the alignment while working on the interlinear version in one of the usual tools - Toolbox etc.). But before I take this route, though, I'd want to know that none of the other options are feasible.

How have you dealt with such a task? (or how would you?) (I'd also welcome references to articles dealing with this from a practical angle. For example, this article presents a very accessible look on how one can work on preparing a digital version of an old manuscript (but it's concerned with a TEI-encoded manuscript edition, not with alignment).

P.S. It seems there's not yet a truly standard / recommended format for parallel texts. The most recent general corpus standard is XCES; TEI appears not not to be the most useful for this at this time. I'll use anything that is supported by the tool I choose ;)

Some common alignment/corpus tools:

  • Uplug
  • Gate
  • ParaConc - This seems to be a user-friendly and often-used (at least, cited in articles) tool
  • InterText - This one looks interesting, very recent (and apparently not yet well-known)

A single program that supports both alignment and adding morphological annotation is impossible in the next 10 years. Having a fully annotated and sentence-aligned version is everybody's goal. I'm working on a Sanskrit-Russian corpus and so I build upon http://kjc-fs-cluster.kjc.uni-heidelberg.de/dcs/index.php?contents=texte and add Russian parallel texts. TEI-encoded manuscript edition is XML. I have just TXT, no markup, only corresponding shloka (=line) numbers. "I added lines for the corresponding text in other languages, and manually pasted these in." - that does not make much sense. InterText can handle that. What languages are you working with?

| improve this answer | |
  • Welcome to the site! Great answer! (+1) – robert Oct 12 '13 at 15:38
  • Thanks for your notes. Yes, InterText could handle the sentence alignment, but I needed to work on the morphemic analysis, i.e. using something like Toolbox or Fieldworks. Perhaps I could have imported a sentence-aligned version into Toolbox/Fieldworks, but: there is no standard workflow for this since these programs don't work with aligned data. So importing also would have meant using custom Toolbox lines/notes. Since I already had my data in Toolbox, doing this manually was more efficient since I could check things at the same time. – arjan Aug 4 '14 at 9:38

I'll add my own (provisional) answer, that is: there is no tool or obvious workflow available supporting both interlinearization and sentence alignment. Sentence-aligned analyzed corpora appear to be created only from already analyzed inputs.

I ended up using Toolbox, because it allows adding custom lines next to the text to be interlinearized. (Language Explorer is better in many ways, but it's impossible to add such custom lines). I added lines for the corresponding text in other languages, and manually pasted these in. This at least allows working on the analysis/interlinearization with the translation in sight.

I am still open to better suggestions, of course.

| improve this answer | |

Nova text aligner can do many things...it is worth trying

| improve this answer | |
  • 2
    Please consider expanding your answer by adding details on how the software solves the original question. "Can do many things" looks like an advertisement, not an answer. Also, by SE rules, you have to disclose your affiliation with that software, if it's the case. – bytebuster Apr 30 '13 at 9:19

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.