With Lens, Google will now be able to answer questions about your surrounding environment in near-real-time. Google updated their camera app called Lens to do more. Now when you record a video with Lens, you can ask questions and get answers right away about what’s happening in the video.
You have to be using an Android or iPhone and have the Google app downloaded. In the app, press and hold the camera button to record a video. As you film, you can ask things like “What kinds of fish are those?” or “Why are those plants shaped like that?”. Google will use their AI called Gemini to understand the video and find the best answers for you.
Gemini helps Google with many products. It helps Lens give you quick facts about what you see. For example, if you ask about fish in a video, it will tell you what kinds they are and why they might be swimming a certain way. Plus it adds links to learn more.
To try the new video question feature, sign up for Google’s Search Labs program. Also, turn on the “AI Overviews and more” option in Labs. Then when you record with Lens, ask your questions out loud or by typing. Google will link to summarized answers from their AI system called Overviews.
The company says this can help satisfy people’s curiosity on the go. Instead of just seeing, you can now learn while watching videos too. Google is also testing understanding videos in real time with their voice assistant. Other companies like Meta and OpenAI are working on similar features for augmented reality glasses and chatbots too.
Lens can now do more than just videos too. You can also search with photos and text at the same time. Launch the Google app camera, take a picture, and then ask a question verbally. Lens will try to recognize what’s in the photo to help answer.
Google also added shopping features to Lens. If it recognizes a product in a photo or video, it will show details like price, reviews, brands and stores that sell it. For now, this works best for things like electronics, toys, and beauty items. Shopping ads may also appear with options and deals. Google wants to use these new tools to help you discover and buy products you see around you more easily.
In summary, Google Lens is getting smarter at teaching you things on the go. By understanding videos and images better with AI, it aims to satisfy people’s curiosity instantly with helpful facts and shopping information too. What questions will you ask Lens next time you see something interesting?
