Google launches Search Live, a Gemini-powered AI search tool that sees through your phone's camera

Google is officially launching its AI-powered Search Live feature in the U.S. on Wednesday, which enables mobile users to get real-time information with their voice and phone camera. Previously available as part of Google Search Labs, Search Live is available now in the Google app on iOS and Android.

Search Live is part of Google's AI Mode search tool, powered by Gemini, that lets users ask questions and receive conversational answers with help from AI. Search Live basically takes AI Mode and integrates a conversational voice feature, but it also goes a step further by letting Gemini see what you see. Using Search Live, users can show Google their camera feed and receive real-time information based on what's in frame.

The Search Live feature, which goes live today, was originally announced in June and required users to opt in via Google Labs to try it out. Now, all U.S. users will be able to access the Search Live feature by simply tapping the Live button under the search bar in the Google app. From there, users can ask questions with their voice or share their camera feed.

In addition, Search Live will also be accessible in Google Lens. Users will simply need to tap the Live icon in the app and start their conversation, as camera sharing in Google Lens is turned on by default.

Mashable got the chance to demo the new feature before its official rollout. In a live demo with Google, Gemini was able to quickly identify objects, products, games, and other items, while also engaging in a back-and-forth conversation with the user about those items.

In our experience with Search Live, even if there were five to 10 objects in the camera's view — and even if those items were upside down — Gemini was still able to correctly identify and answer questions about them.

Google also provided some examples of scenarios where Search Live could be helpful. For example, Search Live could teach you how to fix a broken appliance or learn the rules for a board game with a missing instruction manual. The camera feed can also be used for tech troubleshooting, as a user can show Search Live a new home theater setup and get instructions on what to do. Because queries can be performed with just your voice, Search Live also enables a hands-free experience.

Search Live's official rollout (and prominent placement within the Google app) shows just how much Google is centering AI Mode and AI-powered search over its classic search product. This is happening despite ongoing concerns about the accuracy of AI chatbots and hallucinations, particularly with AI Overviews.

Search Live is only available in English for now, but expect Google to add support for more languages and regions in the future.