Class SimpleSentenceTokenizer

java.lang.Object
org.languagetool.tokenizers.SRXSentenceTokenizer
org.languagetool.tokenizers.SimpleSentenceTokenizer
All Implemented Interfaces:
SentenceTokenizer, Tokenizer

public class SimpleSentenceTokenizer extends SRXSentenceTokenizer
A very simple sentence tokenizer that splits on [.!?…] followed by whitespace or an uppercase letter. You probably want to use an adapted SRXSentenceTokenizer instead.
Since:
2.6
  • Constructor Details

    • SimpleSentenceTokenizer

      public SimpleSentenceTokenizer()