Google has updated Gemini for macOS with system-wide voice dictation and screen-aware commands, allowing users to invoke the AI assistant across apps without leaving their current workflow.
Holding the Fn key activates Gemini's system-wide voice mode, allowing users to dictate into virtually any text field. Google said Gemini can automatically remove filler words, recognize spoken corrections, and generate cleaner text than conventional speech-to-text tools.
The capability is rolling out globally for Gemini on macOS users in English, with additional languages planned for the future.
Gemini can now understand what is on your screen
The update also introduces an optional screen-aware reasoning mode that expands Gemini beyond simple dictation.
After enabling the feature in settings, users can allow Gemini to understand selected content, files, images, and documents on their Mac screen. This lets people use voice commands for tasks such as rewriting text, summarizing information, or creating content directly inside the app they are already using.
The feature is designed to reduce the friction of moving information between apps. Instead of copying text into a chatbot, requesting changes, and pasting the result back, Gemini can place the output directly where the user needs it.
The update shows Google’s broader push to make Gemini less like a separate chatbot and more like an assistant built into everyday computer workflows.
The move puts Gemini closer to the direction Apple has been taking with Apple Intelligence, where AI features are increasingly connected to writing, productivity, and system-level actions. Google’s approach relies heavily on keyboard shortcuts and voice interaction, giving users a consistent way to call up AI help while working.
Privacy and accuracy remain key tradeoffs
As with similar AI assistants, the new features require permission to access on-screen content, raising privacy considerations for users working with sensitive information. Users also need to verify AI-generated summaries and rewrites before relying on them for business or customer communications.
The update continues Google's effort to make Gemini a productivity assistant embedded throughout the desktop experience rather than a standalone chatbot.
Other news: Google recently expanded Gemini in Chrome to desktop users in the U.K.