I want to train a german embedding and need to split text into sentences. That is not easy since "z. B." and "Dr." are not endings of a sentence. Does anybody know a tool to do that for german texts? Thanks.
Just searching for
tokenizer german I came up with Stefanie Dipper's tokenizer for German. It comes with a somewhat non-commercial license (read it before download).
I found this here to be the best solution for my problem: https://github.com/tsproisl/SoMaJo
I compared it to spaCy and NLTK but SoMaJo was better quality in sentence splitting the german texts.