Package org.languagetool.tokenizers
Interface SentenceTokenizer
- All Superinterfaces:
Tokenizer
- All Known Implementing Classes:
SimpleSentenceTokenizer
,SRXSentenceTokenizer
Tokenizes text into sentences.
-
Method Summary
Modifier and TypeMethodDescriptionvoid
setSingleLineBreaksMarksParagraph
(boolean lineBreakParagraphs) boolean
Tokenize the given string to sentences.
-
Method Details
-
tokenize
Tokenize the given string to sentences. -
setSingleLineBreaksMarksParagraph
void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs) - Parameters:
lineBreakParagraphs
- iftrue
, single line breaks are assumed to end a paragraph, withfalse
, only two ore more consecutive line breaks end a paragraph
-
singleLineBreaksMarksPara
boolean singleLineBreaksMarksPara()
-