Prolific science fiction author Arthur C. Clarke wrote that “Any sufficiently advanced technology is indistinguishable from magic.” As technology advances, what once was deemed “fantasy” begins to materialize in the world around us. Movies inspire us to have fun with the idea that any sufficiently capable magic is indistinguishable from technology – on-screen magic makes things like teleportation, omnipotent medicine and the creation of objects out of thin air all seem real.
In many ways we already live in a future predicted by yesterday’s science fiction, with interactive touch devices connected to a vast world of information. These universal machines can support experiences of ever-greater richness and complexity. But that very complexity is also a cause of discontent – parents worry that their children are constantly glued to screens rather than out experiencing the real world, and stuffing more apps and functionality into our devices is making them increasingly harder to master. This is what I think of as the “Star Trek” world – a world of powerful interactive devices with glowing, touch-enabled screens.
But we’re also on the cusp of a more magical moment – the “Harry Potter” future – in which everyday objects will spring to life, interactive books will write themselves and portraits will come alive with vivid personalities. Instead of having to search the internet or sift through documents, intelligent assistants will materialize out of thin air to help us with daily tasks.
While some of these goals will require deep breakthroughs in hard science, others may soon be experienced using a new medium that combines virtual reality (VR) and augmented reality (AR) with artificial intelligence (AI).
A fan of Star Trek will object and say that focusing on these complexities isn’t fair. What about the Holodeck?
Alternatively, a fan of Harry Potter would advocate that for real magic to be visible technologically, we will need a merger of these two views of the world, with screens transcending the size of the devices that enable them – a type of magic that is increasingly practical – AR.
In a Harry Potter future, mixing the digital world and physical world together in new, mixed realities will seem completely natural. Combined, these advancements will fundamentally change the human relationship to computing and the way we interact with technology and each other. Cities will be infused with hidden experiences, helpful information and AR art. We will have greater control of how we’re perceived by those around us – with the glasses we wear or with clothes enhanced with fanciful animated embellishments. The elevator at One World Trade Center is a great example of an immersive experience embedded in the device itself: a wall of screens shows Manhattan transforming through the centuries as the elevator rises to dizzying heights.
With ever cheaper complexity, everyday objects will also have embedded behavior and access to information, expressed in a way that harmony with the device's design and function. Such "internet of things" devices will require power, computation and displays - as well as increasing For standalone devices like thermostats, computation will be embedded, but passive objects with AR features can be managed via a personal device, such as AR glasses.
Of course, for this to happen, it has to be created. Technologists will create the devices and ecosystems, but content creators and artists will be the ones to populate this new world with experiences. To enable this kind of Harry Potter universe, we need A new creative canvas - a tool set for creative people to build the kind of 3D, immersive experience the future demands.
Across our teams at Adobe Research, we are chartered with imagining and building this future, exploring new platforms ranging from VR to AR to robots, and then we work to bring it to life through art and science. We're combining enhancements in artificial intelligence Our Expertise the with Machine Learning and in Content and Data to PUSH How We at The Boundaries of the Create Experiences at The Combine that both at The Best of Harry Potter and at The Star Trek Universes. We Call THESE Deep helpful Technologies and the Adobe the Sensei .
Here are a few of the things we are thinking about ...
- • The A new new Creative Canvas -. The In at The Star Trek Universe, Information IS Often field displayed a using CRISP, Graphic the Diagrams and Displays, the In Contrast, Part of at The Magic of at The Harry Potter World IS Seeing Natural Materials, SUCH AS Ink or Smoke, Moving to Convey Information In a more organic way. By using some of the same technologies used to make the movies, we have been inventing systems for interaction that bring the richness and serendipity of real materials into the controllable world of digital tools. This is literally a new creative canvas With rich paints and brushes.
- • Immersive Displays, and at The Rise of 3D Content - Over at The Next Decade, at The Way We See Information Will BE Brought to Life through transparent Displays,, the AR and VR Headsets and More Exotic Technologies Capable of Turning the any Surface INTO A the display of As THESE types of. E Xperiences become more commonplace, it is also becoming clear that many of the more Star Trek-like conventions that worked in two-dimensional surfaces do not work well in an immersive 3D environment. To make other truly unique objects we are exploring a number of Approaches, like virtual clay, which lets you add and subtract material using painting ideas lifted from Photoshop.
- • Parallax Motion -. Another Technology IS the I'm excited the About the with Immersive Video Motion Parallax, at The Change in IE at The Way We at The World looks AS the Move It android.permission US Our head around to the reconstruct 3D Environment A Video footage from 360, Allowing More at The Viewer Freedom to explore within a 360 video experience rather than having a fixed camera. The same technology, in a new exploration with Stanford University, can also be used to stabilize the camera motion of a captured sequence, which should help to prevent viewer discomfort when viewed In a head-mounted display.
- • Integration the with the AI and OTHER Technologies - lastly, breakthroughs in Machine Learning, and Deep Learning in Particular, are Unlocking new new Capabilities for Natural Language Processing, Computer Vision and the AI By Enhancing Conventional Applications the with Voice Control, We are Exploring at The right Blend of Hands. -on design and Harry Pottery naturalness of verbal expression. With this early look at an interactive agent for photo editing, we combine the emerging science of voice interaction with a deep understanding of creative workflows and aspirations.
In an ideal world, the future will be a thoughtful synthesis of both Star Trek-like powerful devices with the magical blended-reality objects of a Harry Potter world. Our technologies should not dictate style, but should give our creative designers wings to imagine new Ones - to allow us to experience thrilling new stories, and delightful everyday objects. When perfected, these technologies will come together to welcome us to explore our own world and interact with the best magic of all - each other.