Namespace UnityEngine.Perception.GroundTruth

Classes

CameraLabeler

Abstract class for defining custom annotation and metric generation to be run by PerceptionCamera. Instances of CameraLabeler on labelers will be invoked each frame the camera is set to capture data (see ShouldCaptureThisFrame).

ConsumerEndpointDrawerAttribute

Attribute for consumers endpoints

DatasetCapture

Global manager for frame scheduling and output capture for simulations. Data capture follows the schema defined in TODO: Expose schema publicly

HUDPanel

Heads up display panel used to publish a key value pair on the screen. Items added to this need to have their values updated every frame, or else, they will be determined to be stale and removed from the view and re-used for a new entry.

JointLabel

Label to designate a custom joint/keypoint. These are needed to add body parts to a humanoid model that are not contained in its Animator Avatar

These label's can also be applied to the keypoints found in the Avatar to override the self occlusion tolerance values defined in the KeypointTemplate file. The KeypointTemplate defines the typical tolerances for a model, but certain models may need to have specific overrides on a keypoint for the self occlusion to work properly.

KeypointDefinition

A definition of a keypoint (joint).

KeypointTemplate

Template used to define the keypoints of a humanoid asset.

OverlayPanel

Some labeler's result in a full screen image per frame. The overlay panel controls which of these labeler's image is currently shown.

PerceptionCamera

Captures ground truth from the associated Camera.

RenderUtilities

A utility for common RGB sensor and channel rendering operations.

SceneHierarchyInformation

Data structure used to store the labeling hierarchy

SkeletonDefinition

A skeletal connection between two joints.

Structs

AnnotationHandle

A handle to an annotation. Can be used to report metrics on the annotation.

AsyncFuture<T>

A handle back to a result that will be calculated in the future. This class is used to report an asynchronous solution.

RenderedObjectInfo

Describes an instance of an object in an instance segmentation frame. Generated by RenderedObjectInfoGenerator.

SensorHandle

A handle to a sensor managed by the DatasetCapture. It can be used to check whether the sensor is expected to capture this frame and report captures, annotations, and metrics regarding the sensor.

Interfaces

IConsumerEndpoint

Base class for a consumer endpoint. A consumer endpoint acts on the data produced by the perception simulation.

IDatasetHandle

Interface that represents a dataset handler

IGroundTruthGenerator

Interface for setting up Renderers for ground truth generation via LabelManager.

IOverlayPanelProvider

Interface that should be defined by a class that wants to be able to provide a image to the overlay panel.

Enums

BoundingBoxOrigin

The origin to use for bounding box calculation

ImageEncodingFormat

Image encoding format identifiers.

LosslessImageEncodingFormat

Lossless image file formats supported by Perception