I just tried Google's brand new augmented reality Maps on a one mile walk through San Francisco, and I miss it already

Advertisement
I just tried Google's brand new augmented reality Maps on a one mile walk through San Francisco, and I miss it already

Google Maps

Nick Bastone / Business Insider

Advertisement
  • On Monday, the Google Maps team gave Business Insider the chance to try out its new AR feature for pedestrian maps, which the company first announced at its developer conference last May.
  • The company says the feature is in an "alpha" state and for now, will only be available to "local guides."
  • Even without a definite public release date, we were anxious to see if AR could actually improve the Google Maps experience.
  • Below we describe what it was like to use the new Google Maps AR feature on the streets of San Francisco.

Anyone visiting a new city knows the confusion of emerging from a subway station and trying to figure out in which direction to turn.

Even with your maps app open, orienting yourself in an unfamiliar place can be difficult and lead to some missteps.

Complimentary Tech Event
Transform talent with learning that works
Capability development is critical for businesses who want to push the envelope of innovation.Discover how business leaders are strategizing around building talent capabilities and empowering employee transformation.Know More

Google believes it has solved the problem using augmented reality technology.

On Monday, the Google Maps team gave Business Insider the chance to try out its new AR feature for pedestrian maps, which the company first teased at its developer conference last May. The team says the feature is in an "alpha" state and for now, will only be available to "local guides" - Google Maps enthusiasts who provide useful product feedback.

Advertisement

Even without a definite public release date, we were anxious to see if AR could actually improve the Google Maps experience.

Here's what it was like to use the new Google Maps AR feature on the streets of San Francisco:

Get the latest Google stock price here.

{{}}

We met members of the Google Maps team at Rincon Park, which is right near the San Francisco-Oakland Bay Bridge. We decided we could all use some caffeine, so to test out the new AR feature, we headed to Blue Bottle Coffee on Sansome Street.

We met members of the Google Maps team at Rincon Park, which is right near the San Francisco-Oakland Bay Bridge. We decided we could all use some caffeine, so to test out the new AR feature, we headed to Blue Bottle Coffee on Sansome Street.

We plugged the destination into Google Maps to begin the journey.

This is where the AR magic happens. When you hold your phone up to eye level, the standard map shrinks into a small circle at the bottom of the screen. The majority of your screen shows you the real world that's directly in front of you, as if you were looking through the camera.

This is where the AR magic happens. When you hold your phone up to eye level, the standard map shrinks into a small circle at the bottom of the screen. The majority of your screen shows you the real world that's directly in front of you, as if you were looking through the camera.

But this is an "augmented" version of the real world. After a couple of seconds to process my location, the screen displayed big arrows, layered on top of the view, that pointed me in the right direction to start my walk.

Advertisement

But I wasn't able to hold the phone up for too long. For safety purposes, an alert pops up after a few moments of using the AR feature, telling users to put their phones down while they walk.

But I wasn't able to hold the phone up for too long. For safety purposes, an alert pops up after a few moments of using the AR feature, telling users to put their phones down while they walk.

And it's a good thing that I did. My path was filled with electric scooter riders — an AR accident waiting to happen!

Google said it purposely only displays the arrows during “moments of confusion” so that users don’t walk around with their phones in the air, oblivious to those around them.

Those moments of confusion can include when users first start on their journey (like when exiting the subway), when a turn is approaching, or when arriving at a destination.

Still, it was hard not to hold up the phone to check out the new feature and graphics. I did sometimes notice, depending on the angle I held the phone, the arrow animations got a little wonky.

Still, it was hard not to hold up the phone to check out the new feature and graphics. I did sometimes notice, depending on the angle I held the phone, the arrow animations got a little wonky.
Advertisement

But for the most part, the arrow graphics worked quite nicely.

But for the most part, the arrow graphics worked quite nicely.

Rachel Inman, user-experience lead on the project, told me that her team went through multiple iterations before deciding on the arrows graphics. At one point they tried using a blue line, similar to what is used on the 2D maps, but projected onto the view of the real path in front of the user (think Follow the yellow brick road). However, tests found that users would try to stand on the blue lines exactly while walking along their path.

Arrows seem to offer the right amount of guidance.

The "proper" way to use the feature is to walk with your phone down when you know you're on the right path. This will result in the standard Maps view.

The "proper" way to use the feature is to walk with your phone down when you know you're on the right path. This will result in the standard Maps view.
Advertisement

When you need to decide where to turn next, you can tilt the phone upwards. Google Maps then tries to understand your location based on the imagery around you.

When you need to decide where to turn next, you can tilt the phone upwards. Google Maps then tries to understand your location based on the imagery around you.

That's right. Along with the fancy new AR feature, Google is also trying to improve the accuracy of your location by using Visual Positioning Service (VPS), Street View, and machine learning.

Google calls this technique "global localization."

Today, the company relies on GPS and compass tools, but it says that both have limitations, especially in urban environments where there's a ton of metal and other phones in a dense area.

The technicalities of how Google pinpoints your location can be confusing, but the team says if you've ever struggled with the "blue dot" problem — where the blinking blue dot on a map is across the street or on a different block from where you actually are — then you understand the problem they're trying to solve with imagery and machine learning.

The feature works best if you point the phone towards more permanent structures, like office buildings or cafes, rather than shrubs or bushes that change their shape and color based on the season.

The feature works best if you point the phone towards more permanent structures, like office buildings or cafes, rather than shrubs or bushes that change their shape and color based on the season.

The multicolor dots around the building are meant to let you know that Maps' visual recognition system is busy trying to identify the object in front of it.

Advertisement

Once Google knows exactly where you are, it displays arrows on your screen to make sure you're on track and heading in the right direction.

Once Google knows exactly where you are, it displays arrows on your screen to make sure you're on track and heading in the right direction.

Once you arrive at your destination, a pin-drop will appear with a fun animation to accompany it. Since we were heading to grab a coffee, Google Maps also pulled up information about Blue Bottle in case we wanted to check out photos and reviews before walking in.

Once you arrive at your destination, a pin-drop will appear with a fun animation to accompany it. Since we were heading to grab a coffee, Google Maps also pulled up information about Blue Bottle in case we wanted to check out photos and reviews before walking in.

After picking up a cappuccino, I turned in the Android demo phone, thanked the Google team, and headed back to the Business Insider office.

Not knowing exactly where I was in San Francisco's Financial District, I felt myself longing for the AR maps feature.

Seriously!

Even though I knew I was generally heading in the right direction, the AR feature made it so easy to get a quick "sanity check" that I was correct.

Although the graphics were a little wonky at times, the "alpha" version of the app generally worked smoothly and the user-experience seemed to be spot on.

While Google won't reveal an official launch date, I'd be surprised if a broader roll out wasn't coming very soon based on how close the feature felt to being complete.

And I hope it's true because after only using the AR feature in Google Maps for less than a mile long walk, I miss it already.

Advertisement