Google has expanded Gemini Live with four new capabilities that allow spoken commands to trigger background agents working across Docs, Sheets, and Drive, while enabling hands-free Gmail control and delivering a spoken daily brief. The update, announced recently, enhances the voice assistant’s ability to perform complex tasks without manual input. These changes come as Google prepares to meet obligations under its DMA settlement, which requires opening Android to rival assistants by July 2027.
The new agentic functions let users initiate multi-step workflows using only voice—for example, asking Gemini Live to summarize a document in Docs, update a related spreadsheet in Sheets, and save the result to Drive, all without touching the screen. Hands-free Gmail control allows users to read, reply to, or organize emails through speech, while the spoken daily brief delivers personalized updates on calendar events, weather, and news. Google says these features aim to make Gemini Live a more proactive and context-aware assistant, reducing reliance on touch interfaces.
When a user speaks a command like „Prepare a meeting summary from yesterday’s notes,” Gemini Live interprets the request and activates specialized agents that access relevant files across Google Workspace. These agents operate in the background, pulling data, applying summaries, and formatting outputs without requiring the user to switch apps. The system uses on-device processing where possible to maintain privacy and responsiveness, particularly for sensitive tasks like email handling. Google emphasizes that the agents are designed to understand context and user intent, improving accuracy over time through interaction.
Under the terms of Google’s DMA settlement with the European Commission, the company must ensure that competing voice assistants on Android can access similar system-level functionality by July 2027. This includes the ability to launch background tasks, integrate with core apps, and respond to voice commands without being restricted by default settings. While Gemini Live’s new features are currently exclusive to Google’s ecosystem, the mandate aims to level the playing field for alternatives like Amazon’s Alexa or Microsoft’s Copilot on Android devices. Compliance will require Google to provide open APIs and fair access to hardware and software resources.
Can Gemini Live now fully replace typing for routine tasks? Not entirely, but it significantly reduces the need for manual input in workflows involving document editing, email management, and file organization across Google Workspace apps.
Will these features work offline? Some basic voice commands and on-device processing will function without internet, but full agentic capabilities relying on Docs, Sheets, or Drive require an active connection to access cloud-stored data.
How does Google ensure privacy with background agents processing personal data? Google states that agentic tasks use encrypted processing, with minimal data retention and user controls to review or delete voice history and activity logs through their account settings.