Apple Racing to Build Software & Services for Upcoming Mixed Reality Headset – Road to VR

Apple appears to be getting ready to unveil its first mixed reality headset at its Worldwide Developers Conference (WWDC) in June. Now a report from Bloomberg maintains the Cupertino tech giant is also prepping a dizzying number of first-party apps, including gaming, fitness, video and collaboration tools.

Bloomberg’s Mark Gurman is a lightning rod for all things Apple, and in his new info dump it appears we now have a pretty sizable list of first-party content coming to the still very much under-wraps mixed reality headset.

Here’s all of the major apps and features mentioned in the report:

  • iPad apps adapted for mixed reality: Calendars, Contacts, Files, Home control, Mail, Maps, Messaging, Notes, Photos, Reminders, Music, News, Stocks, and Weather apps.
  • FaceTime: conferencing service will generate 3D versions of users in virtual meeting rooms.
  • Freeform collaboration app: will let users work on virtual whiteboards together while in mixed reality.
  • Work apps: Pages word processing, Numbers spreadsheet and Keynote slide deck apps, as well as iMovie and GarageBand for video and music production.
  • Apple TV: both immersive sports content and traditional video content – the latter presented in virtual environments, such as a desert or the sky.
  • Apple Books: will allow users to read in virtual reality.
  • Fitness+: will let users exercise while watching an instructor in VR.
  • Multitasking & Siri: will be able to run multiple apps at the same time, floating within the mixed reality space. Siri voice control is also present.
  • Camera app: can take pictures from the headset.

Provided all of the above is accurate, Apple may be releasing the industry’s most feature-rich headset out of the gate, as it appears to be hauling in a ton of its mature and battle-tested ecosystem of apps.

It’s also said that gaming will be a major focus—a reversal from previous reports. This could mean we’ll see a wider push for Apple to court third-party developers soon after release, which is said to release a few months after is June unveiling, priced at somewhere around $3,000.

SEE ALSO
2022 Was a Plateau Year for VR, Here’s What to Expect in 2023

As for hardware, as many suggested in the past, Gurman reconfirms the existence of a dial crown similar to the one seen on Apple Watch, which will let the wearer seamlessly switch between virtual and augmented reality views.

Here’s a compilation list of alleged Apple MR headset features scavenged from previous reports—all of which you should take with a heaping handful of salt. We’ve broken them down into specs and design rumors:

Rumored Apple MR Specs

  • Resolution: Dual Micro OLED displays at 4K resolution (per eye)
  • FOV: 120-degrees, similar to Valve Index
  • Chipset: Two 5nm chips. Includes a main SoC (CPU, GPU, and memory) and a dedicated image signal processor (ISP). Chips communicate via a custom streaming codec to combat latency.
  • Battery: Waist-mounted battery, connected via MagSafe-like power cable to the headset’s headband. Two-hour max battery life, although hotswappable for longer sessions.
  • PassthroughISP chip contains custom high-bandwidth memory made by SK Hynix, providing low latency color passthrough
  • Audio: H2 chip, providing ultra-low latency connection with the second-generation AirPods Pro and future AirPods models. No 3.5mm and possible no support for non-AirPod BT headphones.
  • ControllerApple is said to favor hand-tracking and voice recognition to control the headset, but it has tested a “wand” and a “finger thimble” as alternative control input methods.
  • Prescription Lenses: Magnetically attachable custom prescription lenses for glasses-wearers.
  • IPD Adjustment: Automatic, motorized adjustment to match the wearer’s interpupillary distance.
  • Eye Tracking: At least one camera per-eye for things like avatar presence and foveated rendering
  • Face & Body Tracking: More than a dozen cameras and sensors capture both facial expressions and body movements, including the user’s legs.
  • Room Tracking:  Both short- and long-range LiDAR scanners to map surfaces and distances in three dimensions.
  • App Compatibility: Said to have the ability to run existing iOS apps in 2D.
  • Price: $3,000 – $4,000

Design Rumors

  • Outer Shell: Aluminum, glass, and carbon fiber to reduce its size and weight. Cameras are largely concealed for aesthetic reasons.
  • Presence DisplaysOutward-facing display can show user’s facial expressions and also presumably eye movements. Said to be an always-on display similar in latency and power draw of Apple Watch or iPhone 14 Pro.
  • Dedicated Passthrough Switch: Digital Crown-like dial on its right side to switch between VR and AR.
  • Headstrap: Various available, including consumer-focused headstrap similar in material to Apple Watch sport bands with built-in speakers. Unspecified, but different headstrap targeted at developers.

– – — – –

As you’d imagine, Apple has confirmed absolutely nothing, so we’ll be tuning in for the June 5th keynote to see whether we’ll finally get a big “one more thing” moment we’ve been waiting for.

,