Sunday, September 29, 2024

Apple’s Vision problem

Apple's mixed-reality push needs a redo.
by Mark Gurman

Meta's latest AR glasses and cheaper mixed-reality headset add pressure on Apple to make its Vision push work. Also: Apple ramps up work on a new smart home lineup, and there's fresh hope that the blood-oxygen feature will return to its watch.

Last week in Power On: Apple's new iPhone 16 reflects a slowing pace of innovation.

The Starters

An attendee wearing an Apple Vision Pro at the iPhone 16 launch event. Photographer: David Paul Morris/Bloomberg

The iPhone and Apple Watch both required some fine-tuning before they became the hit products we know today. 

With the iPhone, Apple cut the price while adding support for third-party applications and speedier 3G connections. The Apple Watch, meanwhile, didn't really catch on until the company focused on fitness tracking, health-sensing features and notifications.

That said, neither product had to be totally overhauled before becoming a big seller — they were on the right track, and just needed some tweaks. Even today, the iPhone and Apple Watch are fairly close to the original vision.

Apple is facing a very different challenge with its Vision Pro headset. It wants to turn the product into a line of devices — with different features and price points. But it's not starting from a rock-solid foundation. If Apple ultimately becomes successful in headsets, the products will probably look and feel nothing like the Vision Pro of today. 

Don't get me wrong: The Vision Pro is an amazing piece of technology, especially when it comes to watching video. You can turn any room into a virtual movie theater, and the fully immersive clips that Apple has published — including sports highlights and landscapes — are a sight to behold. The hardware also is a marvel, with its sleek aluminum-and-glass design, high-end cameras, advanced chips and dazzling displays.

But the headset is really more of a technology showcase than a genuine consumer product. There's little reason for someone to buy a Vision Pro instead of a computer, and the drawbacks are too big to ignore. It can't be worn for long periods of time; there's little third-party software or video content; and the device lacks compelling other features.

Whether you refer to this technology as mixed reality (a melding of augmented and virtual reality) or use Apple's preferred term of spatial computing, the concept hasn't caught on with consumers.

And then there's the price. The Vision Pro is $3,500 before tax, storage upgrades and accessories, putting it out of reach for most people. Apple could try to reignite sales by cutting the Vision Pro price by $500 or even $1,000, but that still might not be enough for shoppers to give it another look. Given how expensive the device is to build, Apple would probably just wipe out its profit margins for little market-share gain.

Meta Quest 3S. Photographer: David Paul Morris/Bloomberg

This past week, Meta Platforms Inc. unveiled a flurry of new technologies in this space — and underscored the idea that Apple seems to be on the wrong track.

At Meta's Connect conference, the company introduced the latest version of its Ray-Ban smart glasses. Unlike the Vision Pro, these aren't an engineering marvel and don't attempt to be a true augmented reality device. But they've caught on with consumers thanks to a combination of slick design, useful features and effective marketing — areas where Apple typically excels. Quite frankly, Meta's Ray-Ban smart glasses should have been an Apple product and would have fit in perfectly with its wearable lineup.

In the realm of mixed reality, Meta landed another blow: Its new Quest 3S headset starts at just $299. At that price point, Meta has a better hope of turning mixed reality into a mainstream category than Apple does. You're going to see a lot of Quest 3S units get sold as gifts or bought by casual consumers who want a more immersive experience for movies or games. 

The Apple Vision Pro is now more than 10 times the price of the entry-level Quest offering, and it's certainly not 10 times better. If gaming and video watching are the main applications for these types of headsets, you really don't need the Vision Pro's sophistication.

But Meta's masterstroke was the demonstration of its Orion AR glasses prototype. This device isn't yet ready for consumers, but it still might be the closest thing we've seen to a pair of practical AR spectacles. Orion offers a field of view with an impressive 70-degree range (not too far off from the Vision Pro) and relies on an elegant form of eye and hand control. The idea is to ultimately replace your smartphone with something you can comfortably wear on your face all day. 

The Orion glasses are just a prototype, and I don't expect them to turn into a consumer product for three to five years. It's perhaps unfair to compare it with whatever Apple has in development. After all, the iPhone maker never previews products years in advance (though some of the further-out features of Apple Intelligence might count). But Meta proved that it is well on its way to executing on this compelling vision. Based on all available evidence, the company is further along with AR glasses than Apple is in its labs.

Meta CEO Mark Zuckerberg wearing the Orion prototype. Photographer: David Paul Morris/Bloomberg

Apple seems aware that it needs to rethink its approach to headsets, but there isn't consensus on how to do that, I'm told. As of now, the company's Vision Products Group is evaluating a few different options, including: 

  • The status quo route: This would involve keeping the Vision Pro more or less the same but focusing on a less expensive version. Apple could bring down the cost with cheaper materials, lesser internal technologies and lower-quality displays. The company would also follow up with a second-generation version of the original, higher-end Vision Pro that has a new chip and Apple Intelligence. 
  • The smart display route: In this scenario, Apple would remove the on-board computer and external battery from the Vision Pro and shift many of the internal functions over to the iPhone. This would make the iPhone more valuable, reduce the weight and heat of the headset, and — most importantly — eliminate several hundred dollars worth of components to bring down the price.
  • The smart glasses route: This would mean developing a product that's closer to Meta's hit collaboration with Ray-Ban — smart glasses without AR. Apple could use its expertise in chips and audio, as well as its growing collection of AI tools, to make a compelling device. This would essentially be a me-too product, but also something akin to an AirPods on steroids — and Apple fans would probably eat it up.
  • The AI and AirPods route: Apple is working on a new version of the AirPods Pro that uses external cameras and artificial intelligence to understand the outside world and provide information to the user. This would essentially be the smart glasses path — but without actual glasses.
  • The holy grail route: The ultimate goal is standalone augmented reality spectacles that come with high-performing lenses, a battery system, on-board computer, cameras, eye tracking and other components built-in— all while still being the size and weight of normal glasses. This has long been Chief Executive Officer Tim Cook's dream, but Apple previously paused development of such a product because it was just too big a challenge.

Apple could ultimately release some or all of these products, but it's going to need to accelerate its work — and fast. If not, Apple will risk losing out on a product category that could transform the way people use technology.

Apple has struggled to move beyond its core strengths in recent years. It lacks a coherent smart home strategy, its car project was a failure, and the company arrived late — with unimpressive results — to the AI party.

With all the money Apple generates from the iPhone, it can afford a few flops. But its long-term health depends on mastering the next major phase of innovation before its competitors do.

The Bench

Watch Mark Gurman discuss Apple's smart home strategy on Bloomberg Television.

Apple's next operating system could be homeOS and run on two new smart display products. Apple is taking another crack at the smart home market — an area where it's had mixed results so far. As I've discussed before, the most significant product in development is a tabletop device code-named J595 that combines a robotic limb with a large, iPad-like display. It's also working on one dubbed J490, a low-end smart display for using FaceTime and controlling home appliances.

The latter product is slated to be launched as early as next year. And it could ultimately be the lower-end companion to the robotic device, which may cost $1,000 or more. The Apple Intelligence tools will be at the heart of both products, helping the company bring AI into the home. Its current home lineup — the Apple TV, HomePod and HomePod mini — doesn't have the hardware needed to run AI models on the devices themselves. 

Beyond adding Apple Intelligence, these new products will run a new operating system called homeOS. This move follows Apple's playbook: Each of its major hardware categories has its own operating system — a variation of macOS or iOS. Apple TV already has software called tvOS, and this will be the basis for homeOS. I expect both of the operating systems to ultimately get combined and run on every Apple home device.

Both of the new products are considered collaborations between Apple's artificial intelligence and home device hardware engineering groups. The low-end smart display is designed to run apps like Calendar, Notes and Home, and will include an interface optimized for controlling home appliances and quickly seeing information. When developing prototypes, Apple imagined the device magnetically attaching to walls or sitting atop a desk.

An Apple Watch 9 displaying the blood-oxygen level detection settings. Photographer: Chris Delmas/AFP

Masimo's CEO resigns, raising speculation that blood oxygen could return to the Apple Watch. The biggest reason blood-oxygen sensing is still missing from the Apple Watch may be Joe Kiani, the longtime CEO of Masimo Corp., which sued Apple over patents and convinced the US to ban the feature. After a board shake-up in recent days, Kiani has resigned from the health technology company. That could open the door for lawyers from Apple and Masimo to work out a deal to bring blood-oxygen sensing back to new Apple Watches. 

Kiani had been a vocal critic of Apple for years, accusing the iPhone maker of stealing his ideas and poaching his talent. Though he may have valid complaints, his public comments about the company have made it all the less likely for Apple to engage with Masimo. As I've written before, this is a case where the Apple customer is ultimately the loser. The blood-oxygen feature on the Apple Watch is critical for many people, and its continued omission is unfortunate. 

I do believe Apple should have come to an agreement months ago to get the feature back on people's wrists. I understand that a billion-dollar agreement with Kiani might have set a bad precedent. But if Apple truly put the customer first, it's something the company should have figured out a way to resolve. Now, with Kiani out of the picture, the situation changes. I don't believe Apple will want to reach a licensing agreement, but I could imagine a deal — financial or not — that lets the two sides drop all litigation. 

Aside from a one-time payment, Apple could agree to work with Masimo on integrating that company's popular hospital equipment with the Health app. In any case, dropping the litigation would save both sides a lot of time and money, and Masimo's board will likely be busy overhauling the business now that Kiani is gone.

Apple veteran Christopher Stringer, now at the speaker company Syng, will be advising the startup Opal.

Former Apple designer signs on to advise OpenAI-backed webcam maker. Opal, a maker of upscale webcams that caught on during the pandemic, is counting on someone new to help it expand into different areas: Christopher Stringer, the former industrial designer at Apple. Stringer left the iPhone maker in 2017 to start Syng, the maker of the high-end Cell Alpha speaker systems.

In an interview, the executive and Opal co-founder Veeraj Chugh said that Stringer will help the company figure out what its next product should be. He has an impressive track record. At Apple, Stringer contributed to essentially every major product category and was particularly key to the iPhone's development. He'll serve as an adviser at Opal while keeping his day job running Syng.

Opal sells a $300 pro webcam, as well as a $150 model that attaches to laptops. But Chugh says Opal is now an engineering and design company that is looking to move beyond cameras. OpenAI has invested $60 million in the business, and Chugh aims to infuse AI into Opal's products.

"The spirit of Opal is something that I was really drawn to," Stringer said.

Post Game Q&A

(Answers to the below are shown in the subscriber-only version of this newsletter.)

Q: Can blood-oxygen sensing be added back to the newest Apple Watches if the Apple-Masimo legal fight is resolved?
Q: Is it true that iPhone specifications are locked in 12 to 18 months in advance, meaning that Apple Intelligence was meant to be released with the phones but the company missed the deadline?
Q: What's the best way to buy and pay for an iPhone?

To get the full Power On experience, subscribe to Bloomberg.com.

Want to send in questions?
Email me, ask on the Power On Discord, or you can always send me a tweet or DM @markgurman.

News tips?
I'm on Signal at markgurman.01; Telegram at GurmanMark; or ProtonMail at markgurman@protonmail.com.

More from Bloomberg

Get Tech Daily and more Bloomberg Tech weeklies in your inbox:

  • Cyber Bulletin for coverage of the shadow world of hackers and cyber-espionage
  • Game On for a playthrough of the video game business
  • Screentime for a front-row seat to the collision of Hollywood and Silicon Valley
  • Soundbite for reporting on podcasting, the music industry and audio trends
  • Q&AI for answers to all your questions about AI

Stay updated by saving our new email address

Our email address is changing, which means you'll be receiving this newsletter from noreply@news.bloomberg.com. Here's how to update your contacts to ensure you continue receiving it:

  • Gmail: Open an email from Bloomberg, click the three dots in the top right corner, select "Mark as important."
  • Outlook: Right-click on Bloomberg's email address and select "Add to Outlook Contacts."
  • Apple Mail: Open the email, click on Bloomberg's email address, and select "Add to Contacts" or "Add to VIPs."
  • Yahoo Mail: Open an email from Bloomberg, hover over the email address, click "Add to Contacts."

No comments:

Post a Comment

How you could secure your financial future regardless of who wins the election

Discover how September 30th at 12pm ET                               If you want to feel more confident about your investing as we head ...