Apple Vision Pro: Everything you need to know

Apple has announced the long-rumored headset, which will be called Vision Pro. That suggests that one day in the not-so-distant future we will see a cheaper Vision headset, rumored to arrive in 2025.

Apple isn’t calling Vision Pro a VR headset. Rather it’s referring to the headset as its “first spatial computer” with a big emphasis on how a user will be able to stay present in the physical world while wearing it. Apple CEO Tim Cook spoke about how the Vision Pro ushers in “the beginning of a new era for computing.” Here’s everything we know about the Vision Pro headset so far.

Want to know what it’s like to wear a Vision Pro? Macworld’s Roman Loyola has and he describes the experience here: I entered Apple’s thrilling Vision Pro world and didn’t want to leave! We also discuss his experiences with the Vision Pro below.

Update January 2: Several reports indicate that Apple will launch the Vision Pro in January or early February.

Apple Vision Pro: Release date

Apple has said that the Vision Pro headset will be available “early next year” so a spring 2024 release date looks likely. The headset will initially only be available in the U.S., with other countries having to wait until “later next year”. There will likely be a dedicated event to officially launch the headset, much like the Apple Watch event in 2015.

In past years we’ve seen Apple hold an event in the spring on the following dates:

  • 2023: No event
  • 2022: Tuesday, March 8
  • 2021: Tuesday, April 20
  • 2020: No event due
  • 2019: Monday, March 25
  • 2018: Tuesday, March 27
  • 2017: No event

In November 2023, Mark Gurman of Bloomberg reported that Apple had initially hoped to launch the Vision Pro in January but is now targeting a March release date. Later reports indicate that Apple has returned to an earlier timeline and is planning to launch Vision Pro in late January or early February.

What about the rest of the world? Apple hasn’t said anything about when the Vision Pro will launch outside the U.S., beyond a vague “later next year”, but in July 2023 Gurman suggested that the U.K. and Canada could see the new headset launch before the end of 2024, and in Asia and other parts of Europe “soon after”.

Apple Vision Pro: Price

Apple has confirmed that the Vision Pro will start at $3,499, Apple hasn’t confirmed the price outside the U.S. yet, but based on Apple’s usual pricing structure that’s probably around £3,499 in the U.K.. There will be an additional cost associated with any prescription lenses that are required, but we don’t yet know what that will be. We also don’t know whether there will be additional options or accessories other than an external battery pack.

Apple

Will there be a cheaper version of Vision Pro?

We took the fact that the Vision Pro has the word Pro in its name as a big hint that a less Pro version will be coming down the line. That’s not exactly evidence, but Bloomberg’s Mark Gurman believes that a cheaper headset will arrive in 2025.

In a June 2023 newsletter, he wrote that a “cheaper” version of the Vision Pro is in development. It will likely have “lower quality screens, either an iPhone-grade chip or an older Mac chip, and fewer cameras.” He also reported in October that Apple’s Vision pro is already working on the sequel to the headset, which will be cheaper than the original model.

Gurman suggests the cheaper headset will be called either Apple Vision or Apple Vision One.

Apple Vision Pro: Design

Apple has picked the materials that the Apple Vision Pro is made from to make it as “wearable” as possible. A custom aluminum alloy frame curves around the user’s face and a modular design means it can be “perfectly” tailored to fit each user.

The Light Seal is made of a soft textile that comes in a variety of sizes and shapes to suit the user’s face for a precise fit. There are flexible straps that can be adjusted to fit the head and ensure that the Audio Pods are positioned near the ears. The cushioned Head Band is available in multiple sizes and can be changed for another size or style.

Apple Vision Pro: Prescription eyewear

Those who need glasses will be able to purchase custom optical inserts to correct their vision. These ZEISS Optical Inserts are sold separately and magnetically attach to the headset’s lenses. The additional lenses are not included in the price of the headset, so there is an additional cost associated with them.

When Macworld’s Roman Loyola tried out the Vision Pro at Apple Park an optometrist measured his prescription and Apple fitted the headset with the appropriate lenses. He then removed his glasses when he put the headset on. He said he was able to see, but thought that maybe the prescription wasn’t exact because he noticed fuzziness with text.

Apple confirmed to Loyola that when you order Vision Pro you will have to submit a prescription from your optometrist. It’s unclear as to how that will work when buying at an Apple Store. Possibly a customer will have to submit a prescription at the retail store.

Apple Vision Pro: Compatibility

Apple hasn’t said anything about compatibility in terms of whether you will need a particular generation of iPhone to use the Vision Pro, but it seems likely that it won’t be supported by every handset.

In fact, analyst Ming-Chi Kuo has suggested that the iPhone 15 will feature an upgraded Ultra Wideband (UWB) chip for this purpose–which may mean no other iPhone will support the Vision Pro.

Apple Vision Pro: Specs and features

The Vision Pro will, according to Apple, “deliver phenomenal compute performance.” It is powered by both an M2 processor and a new R1 chip used to process input from 12 cameras, five sensors, and six microphones, it also eliminates lag to avoid latency. Apple says it can update images at eight times faster than the blink of an eye. The headset “runs virtually silent”, according to Apple.

There are two ultra-high-resolution displays that combine to produce 23 million pixels and create a 4K display for each that could generate a display that appears to be 100 feet wide. Video can be rendered at 4K resolution and text appears sharp from any angle.

There are two individually amplified drivers inside each audio pod that can deliver Personalized Spatial Audio based on the user’s own head and ear geometry. As a result, the sound feels like it is coming from the space around you. Vision Pro also matches the sound to the room using audio raytracing. There’s also an advanced sensor array.

Inside the lenses, a high-performance eye-tracking system uses cameras and a ring of LEDs to project invisible light patterns on the user’s eyes. As a result, the Apple headset is able to tell what way the user is looking and use high-performance eye tracking to control the interface. There are no external accessories other than controllers for playing games.

The Vision Pro also recognizes the user’s iris via a new method to unlock the device and authenticate passwords and purchases called Optic ID. Like the iPhone and Mac, all data is stored on a dedicated Secure Enclave processor.

There’s also a nifty feature called EyeSight that projects the correct perspective of your eyes to the people looking at you. EyeSight also includes a visual indicator that makes it clear to others when a user is capturing a spatial photo or video.

Apple Vision Pro: Battery life

Apple says the Vision Pro’s external battery pack provides up to two hours of use. It can also be used while plugged in.

Apple

Apple Vision Pro: Software and apps

With a Vision Pro headset users will be able to watch a movie, listen to music, browse photos, look at 3D objects, and even collaborate on a presentation.

The Vision Pro headset will run visionOS, an operating system that Apple has designed from the ground up for visual computing. On June 21, Apple announced that the visionOS software development kit is now available to members of the Apple Developer Program. Next month, the company will open developer labs at its Cupertino, California headquarters, as well as in London, Munich, Shanghai, Singapore, and Tokyo. At the lab, developers can get hands-on experience with Apple Vision Pro hardware and support from Apple engineers. 

There will be an App Store via which users will be able to download familiar iPhone and iPad apps as well as new apps designed for Vision Pro. Apple says that there will be lots of apps available at launch, including Microsoft Office Apps, third-party video conferencing apps, and Adobe Lightroom. Apple also previewed a SkyGuide app that can “transfer” you to space.

Apple says that Vision Pro “makes new types of games possible”. Apparently, users will be able to play over 100 Apple Arcade games on a screen as large as they want with support for popular game controllers.

There will also be a number of well-known Apple apps available at launch, such as Safari, Messages, and FaceTime. Here are some of the apps you can expect to see:

Video Conferencing

FaceTime will be available for the Vision Pro and will be able to take advantage of the room around you so that you can see everyone you are talking to in life-size tiles. The participant’s voice will also come from the direction of their tile thanks to Spatial Audio.

Apple has created a novel solution to the fact that you have a mask on and don’t have a camera in front of you. It can show call participants a ‘Persona’–a digital representation of the user created using Apple’s most advanced machine-learning techniques. The Persona is based on your appearance and can even reflect face and hand movements in real-time.

Apple

TV and movies

Entertainment was a major part of the WWDC presentation, with Apple showing off an immersive experience when watching movies and TV shows. With the new Cinema Environment, you’ll be able to watch shows and movies “at the frame rate and aspect ratio the filmmaker intended with immersive Spatial Audio” and watch movies on what feels like a 100-feet screen. Vision Pro will also support 3D movies including Avatar: Way of the Water.

The latest update to the AirPods Pro with a USB-C case added support for lossless audio when used with an Apple Vision Pro headset.

Photos and videos

You’ll be able to take spatial photos and spatial videos in 3D with Vision Pro, and then “relive those cherished moments like never before with immersive Spatial Audio.” And of course, you’ll be able to view your plain 2D photos and videos as well, for example, Panorama photos shot on an iPhone will expand and wrap around the user.

In iOS 17.2, there’s a new option in the Camera settings to record spatial vision for Vision Pro.

Disney+

Disney CEO Bob Iger joined Apple on stage to demonstrate his excitement about the new technology. In a video demo, he showed movies, TV shows, and sports on Vision Pro that bring entertainment to new levels, including special movie presentations, court-side views, and interactive experiences. Iger said Disney content will be available on day one.

Apple Vision Pro experience: What is is like to use Vision Pro

Macworld’s Roman Loyola was able to spend an hour wearing a Vision Pro, an experience he described as “emotional, immersive, and completely captivating.”

The device he tried on was an early beta, so it’s possible—likely even—that the hardware or software could change before next year

During the keynote presentation that introduced Vision Pro Apple said that the Vision Pro input system is controlled by a person’s eyes, hands, and voice. But the real control happens with your eyes: Vision Pro is able to detect exactly where you are looking. As a result, users can browse through apps by simply looking at them, tapping their fingers to select, flicking their wrist to scroll, or using voice to dictate. You can just look at a text input and begin dictating, for example.

Loyola confirmed that you don’t have to hold out your arms to gesture to control the interface, you navigate by looking at what you want to see, and then use hand gestures to perform actions. Loyola said he didn’t have too hard a time adjusting from a using fingers to tap icons to using his eyes and that “Eye tracking was accurate and didn’t feel like it put a strain on my eyes,” he reported. It took about 20 minutes for controlling the interface this way to feel natural, Loyola said.

When you first put on Vision Pro you see your surroundings. You can freely move apps to fill the space around you and they can expand into your space. Apple says you can control how immersed you are in Vision Pro with a twist of the Digital Crown.

Loyola described being put right in the middle of the recorded memory that “triggered memories and emotions of my own from similar moments.” He said that the immersive video gave him “thrills,” explaining: “My body reacted to situations and my mind responded to the sights and sounds.” In one demo, Loyola “got to pet a freakin’ dinosaur. Not a beast that looks like a 3D model set against an illustrated background, but a realistic-looking dinosaur that sniffed my hand and let me pet it.” It all sounds pretty impressive.

According to Loyola, you do see the headset while wearing it, though it doesn’t interfere with the sense of immersion.

While there are other headsets that can offer an immersive experience, Loyola notes that “the difference with the Apple Vision Pro is the two displays set in front of each eye. The resolution and color they display are fantastic and make things look realistic.” While Loyola did experience some pixelation and playback stutter (of the people in the room with him not of the videos) he was impressed.

If you are concerned that the Vision Pro might not fit you, fear not. Loyola, who feels that his head is large, said that “when I first put the Apple Vision Pro on, I had to tighten–not loosen–the straps to get a proper fit”. He added: “The headset had a Velcro strap that goes across the top of your head–this strap is not shown in Apple’s product photos or videos. I think that after the measurements were taken of my head, Apple determined that I would benefit from this top strap”. There is also a Light Seal that fits across the forehead where the eyebrows are, Apple said that this seal is available in multitudes of shapes and sizes to ensure the perfect fit.

After wearing the Vision Pro for an hour Loyola said that he didn’t have any fatigue in his neck or any tenderness where the headset and straps hugged his head. There were some reports of testers suffering from soreness around the top of their head, but it’s very possible they were also dealing with sunburn since Apple’s keynote had been delivered outside in bright sunlight.

Apple described one design goal of Vision Pro as being to be “Never isolated from the people around you”. It achieves this in various ways, one is by displaying your eyes when there is someone near you. This is called EyeSight and it is designed to send a clear signal to people that you can’t see them when that is the case. Similarly, if someone is near by they will appear in your view. This way it should still be easy to interact with the world around you while wearing the headset.

A user can bring Mac wirelessly into Apple Vision Pro just by looking at it. The contents of the Mac screen are then brought on to the 4K display you see through the Vision Pro. Loyola wasn’t able to test this feature.

An advanced Spatial Audio system is core to the Apple Vision Pro experience, creating the feeling that sounds are coming from the environment around the user and matching the sound to the space, according to Apple. The Vision Pro will also work seamlessly with familiar Bluetooth accessories, according to Apple.

Apple Vision Pro: Terminology

  • VR = Virtual Reality (completely replaces your view)
  • AR = Augmented Reality (overlays real world with graphics and information)
  • MR = Mixed Reality (combining AR and VR)
  • XR = Extended Reality (combining AR, VR and MR)
An early Apple Patent

Apple

Apple Vision Pro: Problems and prohibitions

If you have any of the following conditions you may not be able to use an Apple headset.

Those are all standard limitations for VR headsets, but nonetheless it illustrates the fact that this headset won’t be for everyone.

Source : Macworld