visionOS 2 offers small, but promising, steps forward
I’m just back from Cupertino, and there’s an awful lot to think about. But before all that, I thought I’d cover what absolutely everyone is talking about: visionOS 2.
More seriously, I installed the visionOS 2 developer beta this morning—this is the entire reason I have a Vision Pro!—and I’ve got a few quick thoughts before plowing on to developer sessions, thoughts about Apple Intelligence, and the rest.
Spatial photos. The most impressive single feature I’ve seen in visionOS 2 so far is the ability to create spatial photos from out of your old, mundane 2D photos. Load pretty much any photo in the Photos app and tap the Spatial icon in the top left corner of the image, and a fun sound effect plays as an animation sweeps across your photo, representing the system’s machine learning-driven software scanning your photo and building an artificial depth map to provide the illusion of depth.
You know, very few movies are shot in stereo anymore. It’s more expensive and cumbersome to shoot, and conversion to 3-D after the fact is good enough. Upon viewing Apple’s spatial-converted photos in visionOS 2, I had similar thoughts: I don’t see why we would ever need to shoot stereo images if machine learning is this good at faking it.
Seriously, whether it was a photo taken last week or 50 years ago, Apple’s algorithm does a staggeringly good job at building a depth map. You don’t need embedded LiDAR or other depth information—the algorithm does it, and it does in incredibly well. Pictures of my kids taken when they were little are suddenly given more depth (literally and figuratively). Pictures of me as a kid, even. A complex shot with a tower made of LEGO bricks in the foreground was scanned and mapped perfectly.
It takes about 15 seconds to spatialize a photo, so it’s unlikely that Apple will ever ask the Vision Pro to churn in the background through every single photo in your library, but I’ve yet to see a photo that failed to become more interesting after being converted.
New gestures. Apple has added some new gestures to visionOS, which key off of you holding out your palm and looking at it. When you do that, a floating icon appears next to your hand indicating that you can tap your finger and thumb together to open the Home View. (There’s also a new Close button at the top of the Home View so you can close it again.) It’s a nice idea because as much as I’ve internalized reaching up and tapping the Digital Crown to bring up the Home View, the act of doing so is also jarring given that all other Vision Pro interactions are gestures happening in the air in front of me.
I’m actually more excited about the second gesture that keys off the first. After you look at your stretched palm (have you ever really looked at your hand?) you can flip your hand over to reveal a floating bubble that displays the time, battery percentage, and volume. Given how frustrating it was to quickly check the time in visionOS, this is a great new feature that I anticipate using a lot.
If you bring your fingers together while looking at the bubble, you can slide right or left to adjust the device volume quickly. And if you tap while looking at the bubble, Control Center opens. This, to me, is a much better way to access Control Center—though it’s certainly less discoverable than the little firefly that frequently hovers at the top of your vision.
Customize Home View. You can now move apps around in the Home View, and it works pretty much how you’d think: while looking at an app, bring your finger and thumb together to enter Jiggle Mode and then pinch the app to drag it around, even across pages. It worked exactly as I expected it to, and I’m happy to finally be able to put some of my favorite apps on page one.
Breakthrough keyboards. Typing on a keyboard in an Environment was previously very weird, because while your hands were visible, your keyboard itself was not. Apple has upgraded this in visionOS 2 so that it recognizes either the Apple Magic Keyboard or the keyboard on a MacBook, and that’s great.
But at least in the first developer beta, I found that it was a bit finicky—it needed the keyboard to be positioned just-so for it to appear, and even then it sometimes felt like the environment was eating away at the edges of the keyboard. I’m not even a hunt-and-peck typist, but being able to actually orient on the keyboard by seeing it is still valuable.
Also, I’m disappointed that Apple has limited this feature to its own keyboards. I realize it would be harder to generate a model that recognizes more generic keyboards, but most keyboards really do have some pretty obvious characteristics in common, don’t they? Alternately, maybe Apple should consider a feature like the one Meta offers, which lets you work in an environment but with a specific cut-out—like a tabletop—set to pass through.
Life’s a beach. Famously, visionOS shipped with two Environments marked as “Coming Soon”—one featuring a blurry beach image and another with fog-shrouded trees. The trees remain a mystery—Twin Peaks environment?—but the beach has arrived in the form of Bora Bora. As someone who loves beaches, it is spectacular. You can hear the sound of the waves, the palm trees gently blow in the breeze, and you can even see the color of the beach change as a thin cloud passes over the sun. I think I am going to be spending a lot of time in Bora Bora (the visionOS 2 environment, alas).
I didn’t get a chance to test out some other features due later this year, including support for a much larger display in Mac Virtual Display mode and multi-view support in the Apple TV app. In a Spatial Persona call with my podcast co-host Myke Hurley, the updated personas looked good (most notably hand gestures) but Myke’s mustache still prevented his persona’s mouth from moving. There’s more work to be done there.
Still, it’s exciting to get some major new features out of visionOS 2, despite the fact that visionOS 1.0 only shipped a few months ago.
If you appreciate articles like this one, support us by becoming a Six Colors subscriber. Subscribers get access to an exclusive podcast, members-only stories, and a special community.