services/text_preprocessor library
Service for cleaning and preparing text for vectorization
Classes
- TextPreprocessor
- Class for preprocessing text before vectorization
Enums
- TextProcessingMode
- Text processing mode
Functions
-
cleanText(
String raw, {TextProcessingMode mode = TextProcessingMode.textual}) → String - Cleans raw text and returns prepared version for embedding