Google's Ask Photos: Revolutionizing Image Interaction with AI in Google Photos

Recent developments suggest that Google is enhancing its Android offerings with a new AI-driven feature called Ask Photos. This initiative was initially previewed during the company's annual Google I/O event in May. Designed to integrate with Google Photos, this feature will enable the on-device Gemini AI assistant to interact with a user’s images, providing answers to inquiries related to these visuals. Current insights reveal that Ask Photos is in the works and has been detected in the latest beta version of the Google application.

The feature came to light when Android Authority examined the most recent beta version of the Google app, specifically the 15.33.36.29.arm64 release. During their APK teardown process, they uncovered indications of the Ask Photos functionality. However, individuals participating in the Google Play beta program will need to wait for the official rollout by Google before they can utilize it.

Among the code findings was a reference to “assistant_robin_action_ask_photos_single_image_content_description,” signaling that the feature will leverage the Gemini AI assistant. It's interesting to note that “robin” serves as the internal identifier for Gemini. Another code snippet indicated that one possible function of the feature would involve accessing the “Google Photos extension.”

These findings imply that once it is available, the feature will operate through the Gemini AI assistant, with a direct integration into Google Photos. At the Google I/O event, the company mentioned that the Ask Photos feature is intended to respond to user questions about their images. The underlying database for this feature will be the user’s existing Google Photos library, enabling queries like “What did I wear when I visited Jaipur,” to which Gemini will sift through pertinent images to deliver an answer. Users are encouraged to ask not only straightforward questions but also more intricate or vague ones, as Gemini is designed to find relevant information regardless of complexity.

In addition to Ask Photos, Google has introduced a new capability for Google Photos that permits users to hide or block specific individuals from their media collections. According to reports, features labeled Block and Show less have been incorporated. The Show less option allows users to prevent a person from appearing in the memories carousel, while the Block function ensures that the individual does not show up anywhere in the app.