Task Tokenize(object Value, TokenizationProcess Process)
Tokenizes an object.
Grade Supports(Type Type)
How well the tokenizer can tokenize objects of type Type .
CaseInsensitiveStringTokenizer()
Tokenizes case insensitive strings.
Task Tokenize(object Value, TokenizationProcess Process)
Tokenizes an object.
Contains information about a tokenization process.
Interface for full-text-search tokenizers