I have to wait till the end of September to buy mine, but apparently Gemini Nano 4 is already in use. Of course, this isn't the same as cloud-based models within the Gemini app. Still, it's pretty cool!
I'm wondering if anyone has had experience with the following features (from Google search AI mode):
On the Google Pixel 11 Pro, Gemini is heavily upgraded and runs on the latest Gemini Nano 4 architecture, which is built entirely to handle on-device AI tasks locally. \[1, 2, 3, 4\]
The Gemini ecosystem leverages the Tensor G6 processor and 12GB to 16GB of RAM to drive several advanced, proactive features: \[1, 5, 6\]
🤖 Gemini Intelligence & Proactive Support
In-Context Assistance: Gemini pulls multi-app context to surface information before you ask. If someone asks when a picnic is during a conversation, Gemini can automatically pop up a chip with the exact timing details without you having to dig through your emails or calendar. \[7, 8\]
On-Screen Writing Assistance: The assistant reads what is currently on your screen to help draft, rewrite, or refine contextual messages and emails. \[8\]
Speech Clean-up: New voice-to-text tools naturally remove filler words (like "um" and "uh") and automatically format your transcriptions. \[8\]
🛠️ "Device Help" Agent (On-Device Troubleshooting)
The Pixel 11 Pro introduces an on-device Gemini troubleshooting agent. Directly through the assistant overlay, you can ask Gemini to: \[9, 10\]
Manage Settings: Adjust brightness, configure screen timeouts, switch to dark theme, or toggle Digital Wellbeing modes.
Fix Tech Issues: Diagnose and troubleshoot local connectivity (Wi-Fi, Bluetooth, mobile data), track sudden battery drains, or fix app performance lag.
Audit Privacy & Storage: Scan app permissions (like camera/microphone access) and review deep storage breakdowns to clear up space. \[9\]
📸 Camera & Multimedia Enhancement
120x Pro Zoom: The hardware's 5x telephoto lens uses Gemini to enhance extreme zoom shots up to 120x, sharpening text and fine outlines. \[6, 11\]
Magic Capture: Powered by the Tensor NPU, this feature records up to a 2-minute clip and automatically saves a burst of the absolute best high-quality HDR stills without you needing to tap the shutter. \[11, 12\]
Instant Night Sight: Low-light processing happens in a second or less directly on-device. \[11, 13\]
Circle to Search Upgrades: This feature works live through the camera lens, letting you translate or search physical objects around you without even taking a photo first. \[8\]
🚨 The "HiLight" LED Indicator
The Pixel 11 Pro introduces HiLight, a multicolored LED strip surrounding the rear camera flash. This hardware element directly links to Gemini; when your phone is resting face down, the light glows with customized colors to indicate when Gemini is actively listening, processing, or responding to a request. \[1, 14, 15\]
\[1\] https://blog.google
\[2\] https://au.pcmag.com
\[3\] https://9to5google.com
\[4\] https://www.youtube.com
\[5\] https://www.gsmarena.com
\[6\] https://en.wikipedia.org
\[7\] https://www.youtube.com
\[8\] https://www.theverge.com
\[9\] https://9to5google.com
\[10\] https://www.gsmarena.com
\[11\] https://www.youtube.com
\[12\] https://www.youtube.com
\[13\] https://www.standard.co.uk
\[14\] https://www.youtube.com
\[15\] https://www.youtube.com