Manage memory

As a Sentis user, you're responsible for calling Dispose on any worker, inputs, and sometimes outputs. Specifically, you must call Dispose on outputs obtained via TakeOutputOwnership or if you take ownership by calling ReadbackAndClone.

Note

Calling Dispose is necessary to free up graphics processing unit (GPU) resources.

For example:

public void OnDestroy()
{
    worker?.Dispose();

    // Assuming model with multiple inputs that were passed as a Dictionary
    foreach (var key in inputs.Keys)
    {
        inputs[key].Dispose();
    }

    inputs.Clear();
}

When you get a handle to a tensor using the worker.PeekOutput call, the memory allocator remains responsible for that memory. You don't need to Dispose of it. For more information on PeekOutput, refer to Get output from a model.

Additional resources