Class TokenizeResult2
Represents the result of themed tokenization (binary/encoded tokens)
Inherited Members
Namespace: Unity.AppUI.TextMateLib
Assembly: Unity.AppUI.TextMateLib.dll
Syntax
public class TokenizeResult2
Properties
StateStack
Gets the state stack at the end of the line
Declaration
public IntPtr StateStack { get; }
Property Value
| Type | Description |
|---|---|
| IntPtr |
StoppedEarly
Gets a value indicating whether tokenization stopped early
Declaration
public bool StoppedEarly { get; }
Property Value
| Type | Description |
|---|---|
| bool |
TokenCount
Gets the number of tokens
Declaration
public int TokenCount { get; }
Property Value
| Type | Description |
|---|---|
| int |
Tokens
Gets the encoded tokens (start index + packed metadata pairs)
Declaration
public IReadOnlyList<EncodedToken> Tokens { get; }
Property Value
| Type | Description |
|---|---|
| IReadOnlyList<EncodedToken> |