Google is combining still images from Street View to animate real life
Today, directors and developers can only create a shot based on how many cameras they have set up at different angles. Bringing deep learning into the field - turning limited information into real-world structures, essentially with educated guesses - could help them achieve otherwise impossible vantage points.
The algorithm, developed using still images from Google Street View, uses multiple pictures in order to "learn" how the images should fit together.
It can then assemble the images into a single fluid animation, as if the viewer were watching a movie.
Developers call it DeepStereo. Have a look.
The algorithm takes each pixel in a given picture and compares the colors and depth to the corresponding pixels in related images.
Using five different vantage points, it then recreates a full picture of the world. The upper righthand corner shows the images collected by Street View.
Sometimes it still has trouble putting the pieces together. As you can see here, in the algorithm's capture of the Acropolis Museum, a sculpture on the lefthand side comes into view piece by piece.
Google's developers say it is a known problem that will work itself out once they can incorporate more vantage points into their existing model.
The technology could eventually be used in cinematography, teleconferencing, virtual reality, and image stabilization, the researchers write in their report on the algorithm.
"To our knowledge, our work is the first to apply deep learning to the problem of new view synthesis from sets of real-world, natural imagery," they explain.
Whether that breakthrough causes motion sickness will be another matter. San Francisco's Lombard St., seen in the GIF below, isn't for the faint of stomach.
- The worst for Indian startups is yet to come — be prepared for layoffs, unicorn slowdown and startup shutdowns in 2022
- Kellyanne Conway says her husband was 'cheating by tweeting' his disdain for former President Trump in her new memoir
- A SpaceX flight attendant said Elon Musk exposed himself and propositioned her for sex, documents show. The company paid $250,000 for her silence.
- IT giant Infosys reappoints Salil Parekh as CEO and MD for next five years
- WhatsApp will end support for iOS 10 and iOS 11 from October onwards
- Xiaomi and Leica partner for a flagship device, Xiaomi 12 Ultra expected to launch in July
- Zomato, HDFC, HDFC Bank, Paytm and other hot stocks to watch out for on May 23
- Telangana minister wants cess scrapped and fuel prices back to 2014 levels