menu
multi_language_search_engine package
documentation
interfaces/search_engine.dart
TextTokenizer
tokenize abstract method
tokenize abstract method
dark_mode
light_mode
tokenize
abstract method
List
<
String
>
tokenize
(
String
text
)
Tokenizes text into individual words/tokens
Implementation
List<String> tokenize(String text);
multi_language_search_engine package
documentation
interfaces/search_engine
TextTokenizer
tokenize abstract method
TextTokenizer class