Unlike the realm of virtual reality, augmented reality is less about losing yourself in some fantasy environment, and more about getting things done in the real world. So while a number of games have been released that capture the imagination on devices like the Magic Leap One and the HoloLens, when it comes to real world usage, apps that are more practical is where the action is at.
Fittingly, we now have two apps available on the aforementioned devices that cater directly to the notion of using AR to work rather than play. In this case, that work involves communication.
Magic Leap's Avatar Chat, teased during the L.E.A.P. convention, and released a couple of weeks ago in partnership with Twilio, allows any two Magic Leap One users to communicate in real time from remote locations using simplified avatars. On the other hand, New York-based startup Spatial just launched its own remote communication solution for Microsoft's HoloLens that is "a lot" different, but nevertheless serves the same general purpose.
Since so many of the non-gaming AR apps out there are so enterprise-centric, the release of these two AR communication apps offers a unique opportunity compare the effectiveness of the two competing, high-end AR devices when faced with a similar task.
What follows is by no means an exhaustive review of these apps, but after testing both apps and putting them through their paces, I can offer some insight into which one might be for you if you're considering delving into the world of AR-powered remote meetings. This is Part One, focused on Magic Leap, with Part Two, focused on the HoloLens, coming soon after.
Avatar Chat is the one you've probably heard the most about. The free app downloads quickly to your Magic Leap One and is fairly simple to set up. Like many traditional social media accounts, you get to pick a user name (if it's not already taken), and write a description that can include your email address and website name.
Of course, the best part is that you get to pick an avatar (just head, shoulders, and hands) that moves in concert with your real head movements. This aspect includes the ability to be tracked as you spin around in a circle, or cock your head to the quizzically during a conversation. There was no visible lag with regard to this feature, so the prospect of using the app as a real tool for remote conversation in which reactions and real time conversational body language are vital is fairly viable.
Likewise, when you speak, the audio triggers your avatar's mouth movement to simulate speaking, and the eye tracking component on the Magic Leap One delivers avatar eye blinks in (mostly accurate) concert with your real eye movements.
Another important component of Avatar Chat are the privacy controls. Just like normal social media, you can set your avatar account to be public or private, list yourself as busy, offline, or online, and you can control the personal information (phone number, location, real name or pseudonym, etc.) other Avatar Chat users can see.
But since I've had good deal of experience dealing with VR social avatars, I know that some users can sometimes bring the trolling and harassment of the traditional web into immersive computing. So I asked Savannah Niles, a product designer and project leader on the Avatar Chat team, about this area. She confirmed that the app team spent a good deal of time thinking about this issue in particular, which is why the privacy and blocking controls are so robust.
In fact, this approach even bleeds into the usage of the avatars themselves. During a long Avatar Chat session with Niles, she showed me how the app has set boundaries for how close another avatar can get to another, thus avoiding anyone potentially violating someone's personal space in AR. It might sound silly if you've never engaged in an avatar social session in VR or AR, but I can confirm from direct experience that some people will actually violate your avatar's personal space.
And while it's not real, and there's no physical harm, once you're accustomed to the virtual environment, there is a sense inappropriateness when even a virtual avatar starts getting a little too close for comfortable while yelling at you through their virtual face. This attention to the social media aspect of Avatar Chat is something Magic Leap deserves kudos for.
On the positive side of virtual contact, Niles also helped me try out the high five and fist bump functions that allow you to virtually touch a fellow user (each action results in virtual fireworks or flamingos). We also tried the emoji sharing, which was cute, but not something I think I'd use much (and I'm a bit of an emoji fanatic, but I just wasn't excited by that feature).
During the session we did everything from watch a YouTube video together via the Helio app, to share photos using the Gallery app. (To share content with another user, you have to accept a "cast" from the other user first, or initiate it yourself and wait for acceptance of the cast.)
I also put the system's hand tracking abilities to the test, using my real hands to make certain gestures and then having my chat partner mirror those gestures in her avatar form to confirm that my gestures were being interpreted correctly via my avatar form on her side. It's a powerful demonstration of what's possible via this kind of system.
Overall, for one-to-one communication, the app is impressive. But here's where some of the app's shortcomings arise.
The fact that the app is currently only able to facilitate a conversation between two people limits its effectiveness as a true collaboration tool if your team is comprised of more than two people (the initial demo video showed us three people chatting).
I also put the system's hand tracking abilities to the test, using my real hands to make certain gestures and then having my chat partner mirror those gestures in her avatar form to confirm that my gestures were being interpreted correctly via my avatar form on her side...
I was assured that a three-person feature will be coming to the app in the next update, and a four-person update arriving soon after that. Near future updates will also allow users to customize their avatars to look more like their real selves.
Aside from visual interactions, what really surprised me about the app was how crystal clear the audio was. Niles' voice (coming from Florida to my location in New York City) sounded much better than any cell phone call I've made in recent years, and even a little better than most Skype calls.
One quirk with the app was the avatar tracking. Although my avatar seemed as though it generally stayed in place, I found that I frequently had to ask my chat partner to position herself in a specific way in order to get a truly "face to virtual face" experience, otherwise she'd occasionally disappear into my walls. This could be due in part to the fact that I used a very small space to initiate the AR chat. Nevertheless, I haven't had this issue with most other Magic Leap apps (except, of course, space-needy apps like Dr. Grordbort's Invaders).
Finally, one of the best features of the Magic Leap One, which is the ability to record video of what you've done and then instantly share it on YouTube or Twitter, was met with a problem in this instance.
Previously, all my video captures where recorded and sent to YouTube with no problem, but because this video capture was about 30 minutes long, when I tried to share it, the system said that the file was too big. Most meetings last "at least" 30 minutes, so this current limit could be a problem for those looking to save and review an important meeting.
Luckily, I have the Magic Leap One Hub attachment (not included in the default Magic Leap One package, but available to all and priced at $60), which allows me to connect the headset to my computer, open the Lumin SDK and then use a set of Terminal commands to download the video. But I'm guessing that this isn't a process most non-developer users will want to go through, so it's something that should be addressed in future updates to Avatar Chat.
To sum it all up, if you're looking for a way to start having remote, AR-powered meetings with one another person "today," Avatar Chat, which is a free app, is an easy choice. But there are limitations to what Avatar Chat offers, most of which will be apparent in the second part of this feature, which will tackle the Spatial app on Microsoft's HoloLens.