AI NewsDev toolsAnnouncement

Gemini can now click, type and run Mac apps for paid users

Google is rolling out Gemini computer use in its Mac app. A paid user can ask Gemini to click, type and move through other Mac apps.

AI News

Editorial2 min read

LinkedInX
A laptop screen showing the Gemini chat with a live preview of the Mac desktop beside it

Why it mattersA built-in agent that drives real Mac apps is now something any paid Gemini user has. Every desktop tool has to plan for that user turning the agent on it.

Google has turned on Gemini computer use inside its Mac app. A paid user asks Gemini to do something on a Mac. Gemini then clicks, types and moves through Mac apps and websites in a side window. The user watches every step live.

The feature is rolling out today, November 19. It is in English in the United States. Google says it is for Gemini Plus, Pro and Ultra accounts on a personal Google account. The Mac must be Apple Silicon with macOS Sequoia 15.0 or later. Users must be at least 18. A free Gemini account does not get it. The post is by Michael Friedman, group product manager on the Gemini app.

How it works on the screen

Gemini runs in "an isolated background window" alongside the chat. Google says a user "watches every step live" and "approves key actions before they happen". The user picks which apps Gemini is allowed to open. There is a pause button. The chat window shows a live preview of what Gemini is doing on the desktop.

Google lists example tasks rather than a supported-apps list. The post names four jobs. Resize a folder of photos. Fill a form from a PDF. Pull numbers out of a dashboard into Google Slides. List items for resale. The post says Gemini works with "local files, desktop apps and the web". It does not name a model. There is no mention of Gemini 4 Neon, Carbon or any other specific version.

What is not in the post

Google does not say how many steps Gemini can take in one run. It does not say how long a run can last. It does not give a token or dollar cost per task. There is no computer-use API for Mac developers announced here. The only way in is the paid Gemini app.

Google also does not report any success rate for how often a task completes correctly. The post names the categories of task and the user controls around them.

What a product team should notice

A built-in agent that drives Mac apps changes the floor for every tool the user already pays for. A buyer can now ask Gemini to use your Mac app. Gemini will try. Two practical things to check this week. Whether your app exposes the actions a user does by hand through the macOS accessibility APIs Gemini will read. Whether the things that break a human run also break an agent: a modal dialog, a captcha, a surprise login. Google does not publish either answer today. A team can test both on a staging build before the sales call where the customer asks.

Source

Let Gemini tackle repetitive chores on your Mac, Google, by Michael Friedman.

SourceGoogle

This item was written by an AI system from the linked source. Reveneau is responsible for what it publishes.

Share
LinkedInX
Start a project