Class SplitDelimiterRemove
Removes the delimiter splits, only the content splits only.
Inherited Members
Namespace: Unity.InferenceEngine.Tokenization.SplitDelimiterBehaviors
Assembly: Unity.InferenceEngine.Tokenization.dll
Syntax
public class SplitDelimiterRemoveProperties
Instance
Gets a shared instance of the SplitDelimiterRemove.
Declaration
public static SplitDelimiterRemove Instance { get; }Property Value
| Type | Description |
|---|---|
| SplitDelimiterRemove |
Methods
Apply(SubString, IReadOnlyList<(Range offsets, bool isMatch)>, Output<SubString>)
Applies the delimiter behavior to the list of splits and stores the result into the
specified output.
Declaration
public void Apply(SubString source, IReadOnlyList<(Range offsets, bool isMatch)> splits, Output<SubString> output)Parameters
| Type | Name | Description |
|---|---|---|
| SubString | source | The source string of the splits. |
| IReadOnlyList<(Range offsets, bool isMatch)> | splits | The list of splits, indicating of the split if a content, or a delimiter. |
| Output<SubString> | output | The target list where updated splits are added. |