Package org.languagetool.tokenizers
Class SimpleSentenceTokenizer
java.lang.Object
org.languagetool.tokenizers.SRXSentenceTokenizer
org.languagetool.tokenizers.SimpleSentenceTokenizer
- All Implemented Interfaces:
SentenceTokenizer
,Tokenizer
A very simple sentence tokenizer that splits on
[.!?…]
followed by whitespace
or an uppercase letter. You probably want to use an adapted SRXSentenceTokenizer
instead.- Since:
- 2.6
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescription(package private) static class
-
Constructor Summary
Constructors -
Method Summary
Methods inherited from class org.languagetool.tokenizers.SRXSentenceTokenizer
setSingleLineBreaksMarksParagraph, singleLineBreaksMarksPara, tokenize
-
Constructor Details
-
SimpleSentenceTokenizer
public SimpleSentenceTokenizer()
-