Very soon, perhaps in five years, the bounded worlds within virtual reality will begin to be networked together into distributed virtual worlds. When you’re wearing the visor of an augmented- or mixed-reality system such as Magic Leap, HoloLens, or Meta, it maps the local environment. To make, say, a virtual teacup appear on your real table, it needs to know where your table is. The visor uses outward-facing cameras and sensors to scan your environment to create this map. Magic Leap (among others) is working on protocols that save a mapped place in the cloud so it doesn’t have to be remapped for each encounter. Your unit (or perhaps another unit in the same location) merely needs to register and update any changes in the space. This in turn will let you share virtual objects across different surroundings, even if participants are in distant places. Someone in Barcelona can drop a virtual flower into your virtual vase in Chicago. Because artificial reality is inherently social, its environments will be inherently social and networked.

ne of the first things I learned from my recent tour of the synthetic-reality waterfront is that virtual reality is creating the next evolution of the Internet. Today the Internet is a network of information. It contains 60 trillion web pages, remembers 4 zettabytes of data, transmits millions of emails per second, all interconnected by sextillions of transistors. Our lives and work run on this internet of information. But what we are building with artificial reality is an internet of experiences. What you share in VR or MR gear is an experience. What you encounter when you open a magic window in your living room is an experience. What you join in a mixed-reality teleconference is an experience. To a remarkable degree, all these technologically enabled experiences will rapidly intersect and inform one another.

I first put my head into virtual reality in 1989. Before even the web existed, I visited an office in Northern California whose walls were covered with neoprene surfing suits embroidered with wires, large gloves festooned with electronic components, and rows of modified swimming goggles. My host, Jaron Lanier, sporting shoulder-length blond dreadlocks, handed me a black glove and placed a set of homemade goggles secured by a web of straps onto my head. The next moment I was in an entirely different place. It was an airy, cartoony block world, not unlike the Minecraft universe. There was another avatar sharing this small world (the size of a large room) with me—Lanier.

Mike is able to have some fast iterations by using After Effects and Cinema 4D, but he also advocates translating other ideas from web design such as the design grid. You can still do a lot of paper prototyping of interface ideas, but VR is a medium that has spatial, depth, and lighting considerations and so it’s helpful to see what it actually might look like in VR as well.