Class SequenceNormalizer

Applies multiple INormalizer.

Inheritance
object
SequenceNormalizer
Implements
Inherited Members
Namespace: Unity.InferenceEngine.Tokenization.Normalizers
Assembly: Unity.InferenceEngine.Tokenization.dll
Syntax
public class SequenceNormalizer : INormalizer

Constructors

SequenceNormalizer(params INormalizer[])

Initializes a new instance of the SequenceNormalizer type.

Declaration
public SequenceNormalizer(params INormalizer[] normalizers)
Parameters
Type Name Description
INormalizer[] normalizers

The INormalizer instances to apply in sequence.
Exceptions
Type Condition
ArgumentNullException

Thrown when any of the normalizers is null.

Methods

Normalize(SubString)

Applies transformations to the input string before pre-tokenization.

Declaration
public SubString Normalize(SubString input)
Parameters
Type Name Description
SubString input

The string to transform.
Returns
Type Description
SubString

The resulting string.

Implements