docs.unity3d.com
Search Results for

    Show / Hide Table of Contents

    Sentis overview

    Sentis is a neural network inference library for Unity. The package is in a "pre-release" state in an open beta program available to all Unity users via the package manager. The features and documentation may change before it is verified for release near the end of 2024. If you would like to release a commercial project with Sentis before it is released, please reach out to bill.cullen@unity3d.com.

    For additional information, updates from our team, and collaboration opportunities with other beta users, visit the Unity Discussions Sentis topic. If you have an interesting project that you would like to collaborate on with Unity, complete and submit this form and we'll be excited to speak with you.

    You can use Sentis to import trained neural network models into Unity, and then run them in real-time locally on any runtime platform that Unity supports. Models can be deployed on either the GPU or the CPU.

    To use Sentis, it helps if you have some experience in using machine learning models, for example in a framework like TensorFlow or PyTorch.

    Section Description
    Get started Install Sentis, find and use sample projects, and understand the Sentis workflow.
    Create a model Create a runtime model by importing an ONNX model file or using the Sentis model API.
    Run a model Create input data for a model, create an engine to run the model, and get output.
    Use Tensors Get, set and modify input and output data.
    Profile a model Use Unity tools to profile the speed and performance of a model.

    Supported platforms

    Sentis supports all the platforms Unity supports.

    The runtime of a model varies based on factors such as its complexity, the platform it runs on, and the type of engine you use. Refer to Models and Create an engine for more information.

    Supported model types

    Sentis supports most models in Open Neural Network Exchange (ONNX) format with an opset version between 7 and 15. Refer to Supported models and Supported ONNX operators for more information.

    Places to find pre-trained models

    There are various sources to find pre-trained models, which may either be available in the ONNX format or in a format that you can convert. Examples include:

    • Hugging Face
    • Kaggle Models (Formerly TensorFlow Hub)
    • PyTorch Hub
    • Model Zoo
    • XetData
    • Meta Research (Formerly Facebook Research)

    If you want to train your own models, refer to the following links:

    • Google Colab
    • Kaggle

    Additional resources

    • Sample scripts
    • Unity Discussions group for the Sentis beta
    • Understand the Sentis workflow
    • Understand models in Sentis
    • Tensor fundamentals in Sentis
    In This Article
    Back to top
    Copyright © 2024 Unity Technologies — Trademarks and terms of use
    • Legal
    • Privacy Policy
    • Cookie Policy
    • Do Not Sell or Share My Personal Information
    • Your Privacy Choices (Cookie Settings)