Gemini can talk, photos get AI boost: AI features unveiled at Made By Google event

• Google's Made By Google event was held last night
• Google unveiled some new AI features during the event
• Google Gemini now has a voice mode.

When ChatGPT was launched in 2022, headlines about a “code red” situation at Google were dominating the internet. It was being said that Google CEO Sundar Pichai sounded alarm in Google offices as ChatGPT could become the new search engine for people. Months later, Pichai refused declaring a code red situation and said that he did ask for teams to “move with urgency.”

Google has had its feet deep into AI ever since the introduction of Bard, a chatbot that could answer almost anything. Bard was later renamed to Gemini and the AI model still keeps getting continuous upgrades. During the Made By Google event held last night, Gemini got the powers to talk, just like ChatGPT’s recently-unveiled voice mode. Not only this, Google’s newly launched Pixel 9 series phones also got a host of new AI features. Let us take a look at some AI announcements that got the world’s attention last night.

Add Me: A game-changer for group photos

Among the new features unveiled, Add Me stands out as a particularly clever addition to the Pixel 9’s AI arsenal. This photo feature solves a common problem: ensuring that everyone in your group is in the shot, including the person taking the picture.

With the new AI feature, users can take a group photo, then swap places with the photographer and take another. The AI then seamlessly combines both images, making it look as though the original photographer was always part of the group.

This feature is more than just a novelty—it’s a practical solution that enhances the quality of group photos by allowing the use of the rear camera instead of the front-facing one. The result? Better images with more powerful lenses and greater flexibility. Whether you’re on a trip or enjoying a night out, Add Me could become an essential tool for capturing memories.

Revamped screenshots with AI

Google also introduced a revamped screenshots app that leverages AI to bring order to the chaos of saved screenshots. Let’s admit it, none of us can really sort through our screenshots and have the most random things saved in that folder. But thanks to this new feature, sorting through screenshots is possible.

Powered by Gemini Nano, this app automatically sorts through your screenshots, assigning AI-generated titles and descriptions to make future searches more intuitive. For example, if you’ve taken a screenshot of a comedy show ticket but can’t find it months later, a quick search for “comedy show tickets” will bring it up, thanks to the app’s smart labeling.

In addition to organising your screenshots, the app can pull relevant information directly from the image, such as the event location or seat details. This feature operates entirely on-device using Gemini Nano.

Get creative with Pixel Studio

Google’s answer to Apple’s Image Playground is Pixel Studio, an AI-powered image generator available on the Pixel 9. Users can choose an art style and input a prompt to create custom images. While it may not be as comprehensive as Apple’s offering, which includes quick emoji and sticker creation, Pixel Studio offers versatility by allowing users to import photos, generate AI-enhanced imagery, and even combine elements from different images.

For those who prefer a hands-on approach, Pixel Studio also functions as a basic photo editing tool, enabling users to mark up or mash up photos without AI assistance. Depending on the task, the app uses either cloud-based or on-device AI, so users should be mindful when working with sensitive photos.

Gemini gets powers to talk

Google also unveiled voice mode in Gemini called Gemini Live. This means that Gemini can now engage in natural, conversational interactions with users. What sets it apart is the ability to pause and resume conversations at any time, even from the lock screen. However, Gemini Live is reserved for subscribers of the Gemini Advanced service, highlighting Google’s move toward a subscription-based model for premium AI features.

The event also introduced Gemini Assistant, powered by the advanced Gemini 1.5 Flash model, promising lightning-fast and highly accurate responses. This assistant integrates with various Google applications like Utilities, Calendar, Keep, and Tasks, ensuring users can quickly access and manage information across their devices.

Never missing important details with Call Notes

Rounding out the AI enhancements is Call Notes, a feature that summarises your phone calls as soon as you hang up. Designed to help users quickly extract and review important details from conversations, Google says that Call Notes operates with privacy in mind as summaries are neither shared nor stored in the cloud. Moreover, everyone on the call is notified before the AI begins summarising.

SEE ALSO:
Here's why the creator of Gmail thinks Google fell behind in the AI arms race
Google's Pixel 9 series is a total evolution, with 4 new models including a foldable phone. Here's how to preorder.
Google's big Pixel event was sure giving OpenAI vibes