New Spatial/Immersive cameras and new contents. New features and new possibilities in VisionOS 2

UPDATE: VisionOS is now compatible with WebXR and it’s enabled by default.

Apple introduced new features on the WWDC24 for Vision Pro, among some impressive privacy-friendly AI features

Vision Pro has been on the market for less than a half year, but in that time the number of native Apps increased from 600 to 2000. Immersive 3D content is becoming even more impressive, and it promises an engaging future for our homes when the technology can arrive to the mass-market.

Added to the existing Spatial Photos (which you can also take with an iPhone 15 Pro / Max), now, you can convert existing regular images to Spatial with Apple depth awareness AI (already working locally on any iPhone, allowing to instantly separate a subject from the background on a photo). Similar to ImmersityAI (formerly known as Leiapix) and 3DFan, but differently to our ProMa Master tablet, you’ll need to push a button on each image to do so.

Moreover, you will be able to share the viewing experience with another friend with Vision Pro thanks to SharePlay, all while viewing their natural representation of the other person as a Hologram: their Spatial Persona.

These Personas improved on a regular basis almost every month since the launch. There’s more accurate skin tones and vibrant clothing colors. Hand movements are more fluid and natural. This view of your loved ones is becoming the most impressive and human feature of this piece of high-end technology.

In visionOS 2, Quick Look lets you anchor objects to a surface and move them — so now you can do things like preview how a piece of furniture looks in your room. You can even change the color or materials right before your eyes.

About Spatial Videos, now Final Cut Pro can edit this format (there’s no mention regarding if it will support real-time stereoscopic viewing during the production on any device). You can see other video editors that support Stereoscopic 3D Production and real-time stereoscopic 3D visualization here.

New cameras

There’s announcement of new Stereoscopic/Spatial cameras:

The popular Canon EOS R7 will get a 3D Lens allowing to capture Spatial Video even in low light conditions. Exactly what you can do with your current mirrorless DSLR camera if you get our 3D Lens.

In an even more professional line, there’s Blackmagic Design cameras for Apple Immersive Video. Featuring 8K 180 3D recording. Of course, DaVinci Resolve Studio can edit Spatial Videos among other Stereoscopic 3D formats.

Other announcements were new Immersive Videos available to watch, including extreme sports from Red Bull and a short called Submerged, from Oscar winner director Edward Berger.

Developers

For developers, there are some API additions:

• Volumetric APIs: Create apps with richer spatial experiences that take full advantage of depth and space and can run side by side with other apps in the Shared Space. Volumes can now have a fixed or dynamic scale, so when the 3D object moves away from the user it either appears constant in size or gets smaller as it moves away. And ornaments can now be affixed to volumes.
• TabletopKit: This new framework allows for easy development of collaborative experiences centered around a table by handling the manipulation of cards and pieces, establishing placement and layout, and defining game boards.
• World recognition: Capabilities for fidelity of scene understanding have been greatly extended. Planes can now be detected in all orientations and allow anchoring objects on surfaces in your surroundings. Room Anchors consider the user’s surroundings on a per-room basis. And the new Object Tracking API for visionOS lets you attach content to individual objects around the user.

Apple Vision Pro will be available in more countries: China, Japan, Singapore, Australia, Canada, France, Germany, and United Kingdom this summer, in as much as a month.