Class StripDecoder
Strip Decoder removes certain char from the substring of the token in the list.
Implements
Inherited Members
Namespace: Unity.InferenceEngine.Tokenization.Decoders
Assembly: Unity.InferenceEngine.Tokenization.dll
Syntax
public class StripDecoder : IDecoderConstructors
StripDecoder(char, int, int)
Initializes a new instance of the StripDecoder type.
Declaration
public StripDecoder(char content, int start, int stop)Parameters
| Type | Name | Description |
|---|---|---|
| char | content | The character to remove. |
| int | start | Lowerbound of the portion of the input to keep. |
| int | stop | Upperbound of the portion of the input to keep. |
Methods
Decode(IReadOnlyList<string>, Output<string>)
Applies modifications to the input detokenized strings.
Declaration
public void Decode(IReadOnlyList<string> tokens, Output<string> output)Parameters
| Type | Name | Description |
|---|---|---|
| IReadOnlyList<string> | tokens | The string values to modify. |
| Output<string> | output | The recipient of modified strings. |