![\"\"](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/05\/Googlebook-Magic-Pointer.jpg\")
<\/p>\n\t<\/p>\n
The Magic Pointer on Googlebook<\/a> was built with Google DeepMind. The research team behind this underlying capability shared more about the premise of AI-enabled pointers.<\/p>\n DeepMind wants to use AI \u201cto help the pointer not only understand what it\u2019s pointing at, but also why it matters to the user.\u201d<\/p>\n Our goal is to address a common frustration: because a typical AI tool lives in its own window, users need to drag their world into it. We want the opposite: intuitive AI that meets users across all the tools they use, without interrupting their flow. For example, imagine pointing to an image of a building, and requesting \u201cShow me directions\u201d. Nothing more is needed when the AI system already understands the context.<\/p>\n The idea is to replace \u201ctext-heavy prompts with simpler, more intuitive interactions.\u201d<\/p>\n An AI-enabled pointer would streamline this process by smoothly capturing the visual and semantic context around the pointer, letting the computer \u201csee\u201d and understand what\u2019s important to the user.\u00a0<\/p>\n Similarly, an \u201cAI system that understands this combination of context, pointing and speech would allow users to make complex requests in natural shorthand.\u201d<\/p>\n \tAdvertisement – scroll for more content<\/p>\n Example use cases include:<\/p>\n could point at a PDF and request a bullet-point summary to paste directly into an email<\/p>\n hover over a table of statistics and request a pie chart version<\/p>\n highlight a recipe and ask for all the ingredients doubled<\/p>\n In the example below, a \u201cpaused frame in a travel video becomes a booking link for that cool-looking restaurant.\u201d<\/p>\n Google has two AI-enabled pointer demos in AI Studio:<\/p>\n Additionally, you will soon have the ability to \u201cuse your pointer to ask Gemini in Chrome about the part of the webpage you care about.\u201d This is in the process of rolling out.\u00a0\u00a0<\/p>\n For example, you can select a few products on a page and ask to compare, or point to where you want to visualize a new couch in your living room.<\/p>\n<\/p>\n
![\"Add](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/11\/1764168249_77_google-preferred-source-badge-dark.png\"){kind=icon}
![\"Add](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/11\/1764168249_206_google-preferred-source-badge-light.png\"){kind=icon}