Is Google’s Android XR ready for Spatial Computing? A critical review of Samsung’s ‘first’ competitor to the Apple Vision Pro

Google imagines Android XR headsets as offering an infinite desktop for productivity, but we found a better approach of this concept in Pico 4 Ultra, which we consider the best competition for Vision Pro, though is not available worldwide.

For the moment, the demonstrated Android XR system looks rather rough. Furthermore, they didn’t show almost any 3D features besides image 2d to 3D conversion (which some media described as “layered”), and showing 3D models. But on the developer’s portal, they even say: “Some 3D content, such as 3D models, will only be visible when the app is in Full Space.”. So mostly no 3D while seeing your surroundings. That’s far from the mind-blowing elements in VisionOS interacting with objects in your room, accordingly to its shapes and volume properties.

We guess that map indications and other features shown were in 2d only. We even doubt the 180 and 360-degree videos in the presentation would show in 3D in the headset. As they inexplicably started deprecating 3D from YouTube since our petition to include 3D movies on their rent/buy movies service. Which now, more than ever, 3D movies would also be a mandatory addition to YouTube if they want more people to put a headset on their head to use Android XR. But their previous actions were to slowly impeding the possibility of enjoying already existing 3D content.

We have to remember it was too challenging to convince people to wear glasses for 3D content, so the question is: Will people wear an even bigger device to see the same 2d content than with their smartphone?

Google is embracing the catch-all term extended reality (XR) to encompass virtual reality (VR), mixed reality (MR), and augmented reality (AR). With Android XR, the platform is designed to support a wide range of device types, including headsets offering video or optical see-through capabilities, screen-less “AI glasses,” and AR glasses equipped with displays.

As it moves forward with Android XR, Google leverages its proven track record in building successful platforms. This expertise extends beyond merely developing operating systems; it includes supporting OEM partners, nurturing a thriving developer ecosystem, and effectively managing an app store.

However, Google has done all this before to a lesser extent with Glass, and to a greater degree with Daydream VR and the VR180 format. The phone-based approach to VR (Cardboard) and later standalone headset was abandoned by Google around 2019. It remains to be seen how others adopt Android XR, but Google already has major partners in Samsung and Qualcomm: 

For Qualcomm partners like Lynx, Sony and XREAL, we are opening a path for the development of a wide array of Android XR devices to meet the diverse needs of people and businesses. And, we are continuing to collaborate with Magic Leap on XR technology and future products with AR and AI.

Google thinks this time will be different, and believes that the vision it had with Glass/Daydream was correct, but that the technology wasn’t ready. We still see the unwanted concerns of the old Google Glass, like notifications obstructing your front vision when walking on the street. 

Then they also want to impose its Gemini AI assistant. Like Google Assistant, they will see and hear what you do, arising even higher privacy concerns. It will be a new conversational interface to control the OS and apps. In fact, Google says Android XR is the first OS built from the ground up with Gemini. We fear that deep integration and cloud-based access would make it very difficult to allow a use that respects privacy rights, like VisionOS and Apple Intelligence do.

Google will “soon begin real-world testing of prototype glasses running Android XR with a small group of users.”

This will help us create helpful products and ensure we’re building in a way that respects privacy for you and those around you.

This last sentence gives us hope for a better Google ecosystem, but as always, things are demonstrated by facts and actions. And until this moment, every change has been in the opposite direction. We have to note that these headsets will incorporate Chrome, Photos, Maps, and other Google Apps are hardwired to the system, and their current Privacy terms are becoming increasingly abusive. We’ll see in the future if this new ecosystem is respectful and an adequate alternative to Apple Vision Pro.

Google and Samsung are starting with the headset, which both consider a good starting point. Samsung has a developer kit called Project Moohan (or “infinity” in Korean) that is lightweight, has an external battery, and powered by the Snapdragon XR2+ Gen 2. A few partners already have this dev kit and more are being distributed to partners starting this week.

However, glasses remain the ultimate goal, and Android XR-powered frames are on the horizon. These will provide features such as directions, translations (arguably the most practical function), and message summaries, all without the need to reach for your phone—though they will still pair like any other wearable device. We have to note that most of the AI features of the presentation are still not available, in fact, most features are reserved for future glasses (no headset), not for the Samsung headset. It seems Google wanted to trick users that they have now a better device than what they actually have.

Other features, such as object recognition, currently have limited real-world utility, except for individuals with vision impairments. However, for those users, headsets are far from an ideal solution. They will have to wait for this technology to be integrated into a true glasses-like design, optimized to function efficiently without a battery-draining display.

Google has released the Android XR SDK Developer Preview, which is “built on the existing foundations of Android app development.” The Jetpack XR SDK includes:

• Jetpack Compose for XR – enables you to declaratively create spatial UI layouts and spatialize your existing 2d UI built with Compose or Views
• Material Design for XR – includes components and layouts that automatically adapt for XR
• Jetpack SceneCore – provides the foundation for building custom 3D experiences. Some 3D content, such as 3D models, will only be visible when the app is in Full Space.
• ARCore for Jetpack XR – brings powerful perception capabilities for your app to understand the real world

There’s also an Android XR Emulator (as part of the latest Android Studio Meerkat preview). Unity will be supporting Android XR, while Chrome on Android XR supports WebXR. There’s also support for OpenXR 1.1. 

With Google’s recent policy of deprecating already existing 3D features and its obsession with imposing their AI assistant, it appears that they are hindering themselves. Limiting it to do the same that you can do with your smartphone, and losing the right track for Spatial Computing.