docs.unity3d.com
Search Results for

    Show / Hide Table of Contents

    Class TokenizeResult2

    Represents the result of themed tokenization (binary/encoded tokens)

    Inheritance
    object
    TokenizeResult2
    Inherited Members
    object.Equals(object)
    object.Equals(object, object)
    object.GetHashCode()
    object.GetType()
    object.MemberwiseClone()
    object.ReferenceEquals(object, object)
    object.ToString()
    Namespace: Unity.AppUI.TextMateLib
    Assembly: Unity.AppUI.TextMateLib.dll
    Syntax
    public class TokenizeResult2

    Properties

    StateStack

    Gets the state stack at the end of the line

    Declaration
    public IntPtr StateStack { get; }
    Property Value
    Type Description
    IntPtr

    StoppedEarly

    Gets a value indicating whether tokenization stopped early

    Declaration
    public bool StoppedEarly { get; }
    Property Value
    Type Description
    bool

    TokenCount

    Gets the number of tokens

    Declaration
    public int TokenCount { get; }
    Property Value
    Type Description
    int

    Tokens

    Gets the encoded tokens (start index + packed metadata pairs)

    Declaration
    public IReadOnlyList<EncodedToken> Tokens { get; }
    Property Value
    Type Description
    IReadOnlyList<EncodedToken>
    In This Article
    Back to top
    Copyright © 2026 Unity Technologies — Trademarks and terms of use
    • Legal
    • Privacy Policy
    • Cookie Policy
    • Do Not Sell or Share My Personal Information
    • Your Privacy Choices (Cookie Settings)