The trick: Scope Swap
Google put a screen-tapping agent on a billion phones.
The same kind just went wrong on a gym.
Gemini on the Pixel 11 will order groceries, book rides, make reservations, and call businesses across third-party apps, including apps with no Gemini integration.
Before you read on. Your call?
TRUE, BUT
Reads your screen
the mechanism is the tell. Gemini 'reads what's on your screen, picks out things like text fields, menus, and search bars, and interacts with them in real time just like you would.' No integration, no API. It taps like a human, which is exactly the agent class behind this week's real-world agent failures, like the OpenClaw gym booking that deleted a stranger's spot.
The twist
it is not the shipped, do-anything feature the keynote implies. It is US-only, the connected apps arrive 'over the next few weeks', and even a friendly review says 'you're still faster than Gemini' and reaches for the failed Humane AI Pin and Rabbit R1. A screen-reading agent with your logins is a convenience and a blast radius at once.
There’s more to this story.
Membership opens the full investigation, the strongest counterargument and what to do with what you’ve learned.
Start your free month →First membership: 30 days free, then A$89 a year. One introductory trial per customer. Card required; renews annually until cancelled. Cancel before the trial ends to avoid the first charge. Already a member? Sign in
Couldn't check your access. That's on us.
The trick has a name
We call it Scope Swap: applies to far less than it sounds like. You'll see it again. Learn to spot it →
Receipts
- Supports techcrunch.com:
With Gemini, U.S.-based users will be able to order groceries, book rides, or get coffee, for instance.
- Context techcrunch.com:
Over the next few weeks, a new slate of connected apps will be able to work with Gemini to get things done
- Supports androidpolice.com:
Gemini reads what's on your screen, picks out things like text fields, menus, and search bars, and interacts with them in real time just like you would.
- Refutes androidpolice.com:
In 2024, devices like the Humane AI Pin and the Rabbit R1 were selling the idea that AI could navigate apps and services for you. They failed
- Context android.gadgethacks.com:
It actively navigates through multiple screens, processes variable interface layouts, handles authentication flows
Open the Receipts Pack → What each source proves, every figure traced, and what would change our verdict.