Upgrade from Sentis 1.0 to Sentis 1.1
To upgrade from Sentis 1.0 to Sentis 1.1, do the following:
- Use
MakeReadableon GPU output tensor before indexing (seeUse tensor indexing methodssample). - Remove
prepareCacheForAccessparameter when callingPeekOutputand instead useMakeReadableon the returned tensor before reading it. - Use AsyncReadbackRequest for async readbacks from GPU (see
Read output asynchronouslysample). - Replace
: Layerwith: CustomLayerfor custom layers and implementInferOutputDataTypesmethod (seeAdd a custom layersample). - Replace instances of
IOpswithOps. - Replace
uploadCachewithclearOnInitwhen using .Pin method. - Replace uses of
CopyOutputwithFinishExecutionAndDownloadOutput.
Upgrade from Barracuda 3.0 to Sentis 1.0
To upgrade from Barracuda 3.0 to Sentis 1.0, do the following:
- Replace references to
BarracudawithSentis. - Update tensor operations in your project.
- Use
TensorFloatorTensorIntfor input and output tensors. - Update methods that convert between tensors and textures.
- Convert the model asset type.
- Convert back end types.
- Update getting output from intermediate layers.
- Replace
asFloatsandasInts.
Replace references to Barracuda with Sentis
All namespaces now use Sentis instead of Barracuda. To upgrade your project, change all references to Barracuda. For example, change using Unity.Barracuda to using Unity.Sentis.
Update tensor operations in your project
The way tensors work has changed. Sentis no longer converts tensors to different layouts automatically, so you might need to update your code to make sure input and output tensors are the layout you expect. Refer to Tensor fundamentals for more information.
Use TensorFloat or TensorInt to create tensors
Sentis supports tensors that contain floats or ints.
If you use the new Tensor() constructor in your code, you must replace it with either new TensorFloat() or new TensorInt().
You can no longer pass dimension sizes to the constructor directly. Instead, you can use the TensorShape constructor to create a tensor shape, then pass the TensorShape to the TensorFloat or TensorInt constructor.
The following example creates a 1D tensor of length 4:
TensorFloat inputTensor = new TensorFloat(new TensorShape(4), new[] { 2.0f, 1.0f, 3.0f, 0.0f });
Refer to Create input for a model for more information.
Update methods that convert between tensors and textures
You can no longer pass a texture as a parameter to a Tensor constructor directly. Use the TextureConverter.ToTensor API instead. Refer to Convert a tensor to a texture for more information.
For example:
TensorFloat inputTensor = TextureConvert.ToTensor(inputTexture);
Refer to Use output data for more information.
Convert the model asset type
The NNModel object is now called ModelAsset. Update your code with the new name.
For example, when you create a runtime model:
using UnityEngine;
using Unity.Sentis;
public class CreateRuntimeModel : MonoBehaviour
{
ModelAsset modelAsset;
void Start()
{
Model runtimeModel = ModelLoader.Load(modelAsset);
}
}
Refer to Import a model for more information.
Convert back end types
Update your code to reflect the following changes to back end type names:
- Use
BackendType.GPUComputeinstead ofWorkerFactory.Type.Compute,WorkerFactory.Type.ComputeReforWorkerFactory.Type.ComputeRefPrecompiled. - Use
BackendType.CPUinstead ofWorkerFactory.Type.CSharpBurst,WorkerFactory.Type.CSharpReforWorkerFactory.Type.CSharp.
For example, use the following to create a worker that runs on the GPU with Sentis compute shaders:
IWorker worker = WorkerFactory.CreateWorker(BackendType.GPUCompute, runtimeModel);
Update getting output from intermediate layers
To get output from layers other than the output layers from the model, you now need to use AddOutput before you create the worker and use PeekOutput.
For example:
// Add the layer to the model outputs in the runtime model
runtimeModel.AddOutput("ConvolutionLayer");
// Create a worker
worker = WorkerFactory.CreateWorker(BackendType.GPUCompute, runtimeModel);
// Run the model with the input data
worker.Execute(inputTensor);
// Get the output from the model
TensorFloat outputTensor = worker.PeekOutput() as TensorFloat;
// Get the output from the ConvolutionLayer layer
TensorFloat convolutionLayerOutputTensor = worker.PeekOutput("ConvolutionLayer") as TensorFloat;
You should only use this for debugging. Refer to Profile a model for more information.
Replace asFloats and asInts
The Tensor classes no longer contain the asFloats and asInts methods. Use ToReadOnlyArray instead.