Microsoft's HoloLens explained: How it works and why it's different

From CNET

Microsoft's HoloLens prototype has all the innards of a computer built directly into the headset. That means no cords or even a smartphone required.Microsoft

Microsoft has a vision for the future, and it involves terms and technology straight out of science fiction.

But are we actually glimpsing the future? Yes and no.

Microsoft's HoloLens, which the company unveiled at its Redmond, Wash., headquarters on Wednesday, is a sleek, futuristic headset with transparent lenses. You can see the world around you, but suddenly that world is transformed -- with 3D objects floating in midair, virtual screens on the wall and your living room covered in virtual characters running amok.

In "Minority Report," for instance, Tom Cruise's character used sweeping, midair hand gestures and transparent screens to do police work. Five years later, Apple unveiled the iPhone, and with it, a touchscreen operated by hand and finger gestures. Microsoft in turn served up its Kinect gesture-control device, which tracks people's movements through space and feeds the data into an interface.Technology companies have long promised to bring us the future now, reaching ahead 5 or 10 years to try to amaze consumers with the next big breakthrough. Hollywood, on the other hand, has shown that tech in action (or at least simulations of it).

Going further, "The Matrix" showed hackers plugging computers into people's brains to transport them to imaginary cities. And in "Star Trek," computers used energy fields and visual tricks to create worlds people could touch and feel.

We're not even close to those scenarios yet, but we're taking tiny steps in that direction. Companies like Facebook, Google and Microsoft are now attempting to move that fiction toward reality, and the public is beginning to see those visions of tomorrow take form.

So how does the HoloLens measure up against other reality-altering gadgets?

What's a HoloLens, and how does it work?

Microsoft's HoloLens is not actually producing 3D images that everyone can see; this isn't "Star Trek."

Instead of everyone walking into a room made to reproduce 3D images, Microsoft's goggles show images only the wearer can see. Everyone else will just think you're wearing goofy-looking glasses.

Another key thing about HoloLens is what Microsoft is trying to accomplish.

Microsoft envisions the HoloLens as both a personal and a workplace device.Microsoft

The company is not trying to transport you to a different world, but rather bring the wonders of a computer directly to the one you're living in. Microsoft is overlaying images and objects onto our living rooms.

As a HoloLens wearer, you'll still see the real world in front of you. You can walk around and talk to others without worrying about bumping into walls.

The goggles will track your movements, watch your gaze and transform what you see by blasting light at your eyes (it doesn't hurt). Because the device tracks where you are, you can use hand gestures -- right now it's only a midair click by raising and lowering your finger -- to interact with the 3D images.

There's a whole bunch of other hardware that's designed to help the HoloLens' effects feel believable. The device has a plethora of sensors to sense your movements in a room and it uses this information along with layers of colored glass to create images you can interact with or investigate from different angles. Want to see the back of a virtual bike in the middle of your kitchen? Just walk to the other side of it.

The goggles also have a camera that looks at the room, so the HoloLens knows where tables, chairs and other objects are. It then uses that information to project 3D images on top of and even inside them -- place virtual dynamite on your desk and you might blow a hole to see what's inside.

With Skype video chatting, HoloLens users can let others see through their eyes to help with tasks and even doodle right on top of your line of vision.Microsoft

While playing a demonstration based on the popular game Minecraft, I tapped my finger on a coffee table in the real world. But what I saw was my finger chipping away at its surface. When I was done, I saw a lava-filled cavern inside.

That's just a gimmick, but Microsoft said it indicates potential. HoloLens, Microsoft said, can transform businesses and open up new possibilities for how we interact.

I used the HoloLens to video chat with a Microsoft employee who was using Skype on a tablet. Her task? To help me rewire a light switch. She accessed a camera on the HoloLens to see through my eyes, then she drew diagrams and arrows where I was looking to show me what tools to pick up and how to use them.

Imagine how these tricks could be used to train pilots or guide doctors through complex operations.

Different from the Rift

So how about the Oculus Rift? Created by Oculus VR, a startup Facebook purchased for more than $2 billion in March 2014, the headset is considered the poster child of the blossoming virtual reality market.

From a distance, Oculus' headset looks a bit like Microsoft's HoloLens in that it's a device worn on your head. But that's where the similarities end. Whereas Microsoft wants to help us interact with the real world in new ways, Oculus wants to immerse us in an entirely new world.

To put it simply, the Rift headset is a screen on your face. But when it's turned on, the images it produces trick your brain into thinking you've been teleported to a different world, like a starship out in space, or the the edge of a skyscraper. Oculus could, one day, take a more practical route, transporting you courtside to a live basketball game or to a sun-soaked beach to relax.

Oculus' Rift headset pushes a screen right up against your eyes, allowing the device to transport users to entirely different environments.Nick Statt/CNET

The goal for Oculus is to trick the user into believing they're actually there -- wherever it's bringing you. That feeling is called "presence," an ambition Microsoft's HoloLens isn't reaching for.

Enthusiasts say that moment, where your brain is tricked into believing you're actually somewhere else, is magical.

"I've seen a handful of technology demos in my life that made me feel like I was glimpsing into the future," wrote venture capitalist Chris Dixon, who helped lead investment firm Andreessen Horowitz's funding in Oculus VR. "The best ones were: the Apple II, the Macintosh, Netscape, Google, the iPhone, and -- most recently -- the Oculus Rift."

Oculus isn't alone in its quest. Sony is attempting something similar with its Project Morpheus headset. Both have outspoken plans to use the technology to transform all manner of industries, starting with video games. But developers say it's hard to get it right. The images need to be carefully connected to your physical movements without any delays. When they aren't, consumers feel a form of motion sickness.

Same difference

Ultimately, these companies are on different roads to the same destination, which is trying to reimagine how we interact with computers. We're all used to the mouse and the keyboard, and we're learning to live with the glass screens of smartphones too. So far, each of these devices has been good enough to convey the information from a book or the scenes of a movie.

But Oculus, Microsoft, Google and others believe in a different, potentially more natural way to interact with our technology. These companies and the hardware they're creating imagine a world where hand gestures, 3D images and images superimposed on reality are the next-generation tools for productivity, communication and everything else we use gadgets and the Internet for.

It sounds like science fiction, but if these devices work the way tech luminaries hope they can, such dreams may be reality sooner than we think.