I have an assignment for my machine translation class which involves using the different language versions of websites as parallel corpora. The problem is the text isn't properly aligned.
According to textmechanic.co, the English version has 481 sentences / 807 lines and the German version has 533 sentences / 909 lines.
Does anybody know of any way to automate / verify the text aligning process? We have a tried writing our own Java program to match as many sentences as possible and throw away ones which don't match. However, we encountered errors at punctuation such as full stops for Mr. / Mrs., etc.
Does anybody have any experience dealing with this sort of situation?