RealityKit apps on visionOS
RealityKit content on visionOS can be in one of two modes, which we refer to as "shared" and "exclusive" mode.
| Modes | Description |
|---|---|
| Shared | In "shared" mode, your application coexists with any other applications that are active in the shared real-world space. Each application has one or more bounded volumes (see below), but no unbounded volumes. The position and orientation of these volumes (both relative and absolute) is opaque to the app. Input in this mode is limited to a “3D touch” mechanism, via the SpatialPointerDevice (see Input). In addition, ARKit information such as hand position, planes, or world mesh is unavailable in this mode. |
| Exclusive | In "exclusive" mode, a single application controls the entire view, via an unbounded volume (see below) in addition to previously created bounded volumes. In this mode, an app knows the relative positioning of its volumes, can access all AR features of the device, and use hand/joint position information to drive input and interactions directly. The app still does not have the ability to move or size bounded volumes, and thus must rely on the user to ensure bounded volumes don't overlap with meaningful content within the unbounded volume. |
Volumes
Volumes are a new concept for mixed reality platforms. An application can create one or more volumes for displaying content in the mixed reality space. Each volume is an oriented box that contains 3D content. In visionOS, volumes can be moved and scaled in real-world space independently by the user, but not programmatically by the developer. In Unity you can interact with Volumes using a Unity component called a VolumeCamera.
| Modes | Description |
|---|---|
| Bounded Volumes | Bounded volumes have a finite, box-shaped extent. Bounded volumes can be moved and transformed in world space by the user, but not programmatically by the developer. Currently, Unity content within a bounded volume will expand to fill the actual size of the volume. Input in bounded volumes is limited to “3D Touch” as provided by the SpatialPointerDevice. See Input. |
| Unbounded Volumes | When running in exclusive mode, content presents a single unbounded volume, without any clipping edges. The application owns the entire mixed reality view, with no other applications visible. Additional bounded volumes from the same application can co-exist with this unbounded volume. Within the unbounded volume, an application can request access to full hand tracking data. |
Progressive Immersion
RealityKit-based apps can utilize the Digital Crown to control immersion level. Two things are required to use this capability:
- The ImmersionStyle must be set to Progressive.
- One VolumeCamera in the scene must be set to Unbounded Mode.
Content will then appear within a radial portal with a black background. This portal will replace pass-through within a portion fo the field of view. The Digital Crown on the Vision Pro can control the size of this radial portal, and can increase the size of the portal until the portal fully covers pass-through.
At maximum portal size, the app will behave as if it had been set to Full immersion style, and any properties that apply to Full immersion style will apply here.
Additionally, the VolumeCamera will dispatch an event called ImmersionChanged when the user interacts with the crown dial to change the immersion amount. You must set the ImmersionStyle of the volume camera configuration to Progressive. See VolumeCamera Events for more details.
Note
Apple visionOS 2.0 added support for the ImmersionChanged event. This event is not available in earlier visionOS versions. Refer to onImmersionChange for additional information.
visionOS Settings
The visionOS project settings menu has a few properties pertaining to the RealityKit with PolySpatial app mode.