Google AI Mode gets smarter, now reads PDFs and helps you plan with Canvas

India Today

2 days ago

Google is rolling out a series of updates to its AI Mode in Search. These updates include the ability to analyse PDFs, organise tasks using a new feature called Canvas, and interact with real-time video input through Search Live. The updates are rolling out primarily in the U.S. and India, with some features available only to users enrolled in Google's AI Mode Labs experiment.advertisementUsers will be able to access AI Mode on Android phones, iPhones and desktop. On desktop, users can look for the new AI Mode button on the Google homepage. Google says these new experimental features are designed to make research, planning and information access easier for students, teachers and everyday users.PDF analysis featureGoogle is adding PDF analysis to AI Mode on Android, iOS and desktop browsers, allowing users to upload documents like lecture slides or reports and ask questions about their content. The tool will scan the PDF, pull relevant insights from the web, and provide linked sources allowing users to explore more around the topic.
This new feature builds on existing image analysis features available in the Google app on Android and iOS. Additionally, Google has announced that soon, AI Mode will support other file types, such as those from Google Drive, making the tool more versatile. Meanwhile, the PDF analysis feature is being rolled out first to English-speaking users over 18 in the U.S. and India. Since AI Mode is still experimental, Google advises users to verify responses when necessary.Canvas for project planningGoogle is also releasing a Canvas feature on AI Mode. It is already available in Gemini. In AI Mode this feature will allow users to create and organise plans in a dynamic side panel that updates over time. According to Google this new tool is designed to help users keep track of information across multiple sessions.This feature will allow users to start a project by asking AI Mode for help and then selecting the 'Create Canvas' option. Google says this will be particularly useful for making study schedules, trip itineraries, or managing any project that requires multiple pieces of information.The Canvas feature will also allow users to integrate context from their own files, such as class notes or syllabi, once the upcoming file upload functionality is supported. Users will be able to return to their Canvas project at any time to add, edit or refine the content.As for the availability, Canvas is launching first for U.S.-based users enrolled in the AI Mode Labs experiment and will initially be available only in English.Search Live with video inputadvertisementAnother feature rolling out in AI Mode is 'Search Live' with video input, letting users point their camera at a live scene and ask questions in real time. Powered by Google's Project Astra and integrated with Google Lens, this feature will also enable users to initiate back-and-forth conversations with AI mode. It is launching on mobile devices in the U.S. this week.Lens integration with ChromeGoogle is introducing a new 'Ask Google about this page' option in Chrome's address bar, allowing users to ask questions about anything on their desktop screen, be it a webpage, PDF, or other file types. AI Overview results will appear in a side panel, with the option to dive deeper through follow-up questions using AI Mode.- Ends