The department meeting, the division meeting, the strategy meeting, the “where is my Fiji coffee mug” meeting. Dread them, love them, snooze them, every office has them. Talking heads congregating around King Arthur’s round table, listening to boring, rambling discussions while munching noodles and granola bars.
Chances are, you’re not getting out of them.
But what if you could show up to the next meeting as Gandalf the Grey, or a centaur, or the Night King from “Game of Thrones,” or a talking pepperoni pizza?
You’ve seen Li’s work in blockbuster films like “Furious 7” and “The Hobbit: Battle of Five Armies,” where he teamed with Weta Digital to introduce novel ways of capturing micro-expressions in the face essential to creating natural dialogue and nuanced actor-specific emotions. Indeed, for his work in facial capture in VR, Microsoft recently named Li the top CS graphics researcher in the world.
Li sees communications — even a typical office meeting — as one of the most immediate and productive uses of VR.
“We all agree that the conference room is probably not where your best ideas are born,” Li said. “We want to let people unleash their creativity and come up with their own ways to beat boredom during office meetings.”
His team, which includes graduate students Kyle Olszewski, Shunsuke Saito and Joseph J. Lim, developed a novel head-mounted display (HMD) that enables complex facial and realistic speech animations that up until now were the realm of A-list digital artists.
“We’ve build the first face-to-face interaction between VR users wearing head-mounted displays in collaboration with Oculus last year, and now we have a solution that enables realistic speech animation using deep neural networks,” Li explained.
Their wearable system is based on FOVE, the world’s first eye-tracking VR headset, and uses integrated cameras to record eye motions and a mouth camera to track the lower part of the face. According to Li, people will show up as orcs to meetings in the next year or two as major platforms begin deploying the technology.
What will your avatar be? If you were wondering, Li’s own repertoire is limited. He prefers to show up as a bobblehead if invited to your next meeting, although he admits stranger things have happened.
But even if you’re an orc, your co-workers will still see you rolling your eyes in total boredom during the meeting. Sorry.