© 2024 Blaze Media LLC. All rights reserved.
Apple's augmented reality goggles track your voice, eyes, and hand movements at all times, uses AI to mimic your persona
Photo by Justin Sullivan/Getty Images

Apple's augmented reality goggles track your voice, eyes, and hand movements at all times, uses AI to mimic your persona

Apple's new augmented reality goggles called "Apple Vision Pro" intends to have users calling, working, watching movies, and even interacting with their family members using their wearable technology. However, the device will also be tracking the user's movements and using "machine learning" to create a digital persona.

The goggles, like most phones, are capable of using voice recognition to navigate the augmented world, which Apple brags will consist of your typical iPhone/Mac interface and work screens as far as the eye can see. However, it is also tracks user eye and hand movements at all times, allowing users to simply look in the direction of an icon to select it, or slightly move their fingers to scroll a page.

While the possibility of a limitless canvas for work spaces, movie screens, and gaming sessions seems like a giant upgrade from a 15-inch laptop screen, Apple seems to have blown past the reality of augmented reality: It requires a $3,499 pair of goggles to participate.

The capability of changing your small screen into a movie theatre right in your living room seems technologically justified, but at the price of $7,000-$10,000 for a few goggles, this experience will likely be enjoyed alone.

The product launch appeared to be focused on either wearing the goggles or missing out, even showing a man watching his daughters play while he captures video through the device. It then cuts to the man sitting by himself and reliving the memory by alone on his couch.

Where calls are concerned, Apple Vision Pro runs into the same problem that Mark Zuckerberg's "Metaverse" ran into. What's the point of having a video call between two people who are wearing headsets? You can't even see their face. Metaverse attempted to solve that with cartoonish and childlike avatars.

Apple's solution, however, is to use the headset and the data it collects to create a digital, lifelike "persona" of the user to be shown to others on the call who are presumably wearing an Apple Vision Pro as well.

"Users wearing Vision Pro during a FaceTime call are reflected as a Persona," Apple described. "A digital representation of themselves created using Apple’s most advanced machine learning techniques — which reflects face and hand movements in real time. Users can do things together like watch a movie, browse photos, or collaborate on a presentation."

Apple did not immediately respond to questions regarding how the Apple Vision Pro creates a user's "Persona," as well as the total scope of the device's movement tracking. This article will be updated with any future responses.

Like Blaze News? Bypass the censors, sign up for our newsletters, and get stories like this direct to your inbox. Sign up here!

Want to leave a tip?

We answer to you. Help keep our content free of advertisers and big tech censorship by leaving a tip today.
Want to join the conversation?
Already a subscriber?
Andrew Chapados

Andrew Chapados

Andrew Chapados is a writer focusing on sports, culture, entertainment, gaming, and U.S. politics. The podcaster and former radio-broadcaster also served in the Canadian Armed Forces, which he confirms actually does exist.
@andrewsaystv →