Interface INormalizer
Applies transformations to the input string before pre-tokenization.
Namespace: Unity.InferenceEngine.Tokenization.Normalizers
Assembly: Unity.InferenceEngine.Tokenization.dll
Syntax
public interface INormalizerMethods
Normalize(SubString)
Applies transformations to the input string before pre-tokenization.
Declaration
SubString Normalize(SubString input)Parameters
| Type | Name | Description |
|---|---|---|
| SubString | input | The string to transform. |
Returns
| Type | Description |
|---|---|
| SubString | The resulting string. |