Home>Tech
Use AI to search through your massive library of screenshots.
ByKimberly Gedeon on
Pixel Screenshot helps you search through your massive collection of screenshots with natural language.Credit: Kimberly Gedeon / Mashable
You, like myself, likely have a massive library of screenshots that includes everything from funny social media posts and saved order confirmations.
However, scrolling through a gigantic collection of screenshots for that one saved picture is a pain. That's why Google launched the new Screenshots app, which can be found across all new Pixel 9 series devices, including the Pixel 9, the Pixel 9 Pro, the Pixel 9 Pro XL, and the Pixel 9 Pro Fold. Google walked me through how the Screenshot app works — and it may be one of the must useful AI tools I've seen all year.
SEE ALSO:
Samsung Galaxy S24 to come with a new Google AI feature, and it's a cool oneGoogle’s new ‘Pixel Screenshots’ uses AI search to help you find screenshots
At the Made by Google event, the search engine just dropped the Pixel 9 devices, and along with them, Google dropped the new Screenshot app. Using on-device AI that Google calls "Gemini Nano," the app generates a title and summary for each screenshot.
For example, at a recent press event, a Google rep showed me a screenshot of an article that delved into how one can dip dye their hair for a pop of color. The Screenshots app, just like I mentioned, delivered a headline and a summary for the hair guide.
A screenshot of an article about dip dyeing one's hair.Credit: Kimberly Gedeon / Mashable
(The Google rep didn't point this out, but I did notice an "Add a note" option, so I take it that users will be able to add their own annotations in addition to the AI-generated summaries.)
Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!
Next, the Google rep demonstrated that if users want to find a saved screenshot, they can use the search bar at the bottom of the app to find it.
Use the search bar on the bottom to find your screenshots.Credit: Kimberly Gedeon / Mashable
For example, the word "boots" was typed into the search bar, which prompted the app to populate screenshots that featured images of boots from a user's shopping journey.
After typing in "boots," Gemini Nano did its job and recognized screenshots with images of boots in them.Credit: Kimberly Gedeon / Mashable
To my surprise, not only can you type in a query, but you can tap on the microphone to speak your request into the search bar. For example, the Google rep asked, "What's the Wi-Fi code at Jared's house?"
The Screenshot app surfaced a Wi-Fi code after a spoken request.Credit: Kimberly Gedeon / Mashable
And just like that, after searching through the user's screenshots, the search was able to surface the right screenshots and reveal Jerrod's Wi-Fi credentials front and center — without requiring much digging.
Just when I thought that the Screenshot couldn't get any better, Google said there are suggested actions for certain screenshots. For example, if you save a screenshot with an address in it, a button that says, "Search in Maps" may appear, allowing you to surface directions via Google Maps.
You may see the "Search in Maps" button if Gemini Nano detects directions in your screenshots.Credit: Kimberly Gedeon / Mashable
As a cherry on top, the Screenshots app lets you set reminders for yourself. Let's say you saved a screenshot of an article, but you're too busy to read it. You can tap on the alarm button to remind yourself to read said screenshot. You can't tell me that's not brilliant!
Google rep sets a reminder to help him remember to read an article about dip dyeing one's hair.Credit: Kimberly Gedeon / Mashable
This isn't the only AI-powered feature that had our jaws dropping. Check out all the other new Google features, including Made You Look, Add Me, Reimagine, Gemini Live, and more.
Featured Video For You
The Pixel 9, Pixel 9 Pro, and Pixel 9 Pro Fold tech and specs
Kimberly Gedeon
East Coast Tech Editor
Kimberly Gedeon, at Mashable since 2023, is a tech explorer who enjoys doing deep dives into the most popular gadgets, from the latest iPhones to the most immersive VR headsets. She's drawn to strange, avant-garde, bizarre tech, whether it's a 3D laptop, a gaming rig that can transform into a briefcase, or smart glasses that can capture video. Her journalism career kicked off about a decade ago at MadameNoire where she covered tech and business before landing as a tech editor at Laptop Mag in 2020.
Recommended For You
What to expect at Made by Google 2024: Pixel 9, Pixel 9 Pro XL and more
The next generation of Google Pixel phones is nearly here.
By Amanda Yeo
5 new AI features announced for Pixel 9 series, Pixel 9 Pro Fold, and Pixel Watch 3
Gemini integration, AI photo editing, and more.
By Cecily Mauran
Everything announced at Made by Google 2024, including the new Pixel 9 Pro XL, Pixel Watch 3, and Gemini Live
Lots of news from Google's Pixel 9 event.
By Tim Marcin
Pixel 9 Pro XL: Google announces new third phone that joins Pixel 9 and Pixel 9 Pro
It's bigger, sort of.
By Alex Perry
Upgrade your smartphone with a new Google Pixel 7 Pro or Google Pixel 8 Pro for less
Out with the old, in with the new
By Brittany Vincent
Trending on Mashable
NYT Connections today: See hints and answers for August 19
Everything you need to solve 'Connections' #435.
By Mashable Team
A star-like thing is flying 1 million mph in space. What the heck?
Amateur scientists found it.
By Elisha Sauers
Wordle today: Here's the answer hints for August 19
Here are some tips and tricks to help you find the answer to "Wordle" #1157.
By Mashable Team
Speeding space object triggered a warning. It wasn't an asteroid.
"Hurtling towards Earth."
By Mark Kaufman
Google tried to give new Pixel phones to influencers. Then it backfired.
Creators are leaving the Team Pixel program after its new terms sour trust.
By Elizabeth de Luna
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!