While visionOS is based on the existing MacOS and iPadOS platforms, the unique nature of spacial computing requires lower latency than one would need for a mobile or desktop OS. The new headset will an immersive mixed-reality 3D interface that,"frees apps from the boundaries of a display,".
The virtual screens Vision Pro displays can appear as gigantic as 100-foot wide wraparound billboards or they can fit into the space of your living room. The system responds to the room's natural light and shadow to provide the user with a better sense of scale and distance.
Users won't need cumbersome controllers or motion-sensing wands to use the Vision Pro, as the headset utilizes nearly dozen cameras and sensors peppered around the device to monitor their gaze and hand motions turning their eyes, voices and fingers into virtual pointers and clickers. You'll be able to browse through menus by looking at them, selecting items by tapping their fingers and inputting text with the spoken word.