When Gemini Live’s new digital camera function popped up on my cellphone, I did not hesitate to attempt it out. In certainly one of my longer assessments, I turned it on and began strolling by means of my house, asking Gemini what it noticed. It recognized some fruit, chapstick and some different on a regular basis objects with no drawback, however I used to be wowed after I requested the place I left my scissors. “I simply noticed your scissors on the desk, proper subsequent to the inexperienced bundle of pistachios. Do you see them?”
It was proper, and I used to be wowed.
I by no means talked about the scissors whereas I used to be giving Gemini a tour of my house, however I made certain their placement was within the digital camera view for a few seconds earlier than transferring on and asking extra questions on different objects within the room.
I used to be following the lead of the demo that Google did final summer season when it first confirmed off these Live video AI capabilities. Gemini reminded the particular person giving the demo the place they left their glasses, and it appeared too good to be true, so I needed to attempt it out and got here away impressed.
Gemini Live will acknowledge a complete lot greater than family odds and ends. Google says it will show you how to navigate a crowded prepare station or work out the filling of a pastry. It can provide you deeper details about art work, like the place an object originated and whether or not it was a restricted version.
It’s greater than only a souped-up Google Lens. You speak with it, and it talks to you. I did not want to talk to Gemini in any explicit means — it was as informal as any dialog. Way higher than speaking with the previous Google Assistant that the corporate is rapidly phasing out.
Enlarge Image
Here’s a have a look at a part of my dialog with Gemini Live in regards to the objects it was seeing in my house.
Google and Samsung are simply beginning to roll out the function to all Pixel 9 (together with the brand new, Pixel 9a) and Galaxy S25 telephones. It’s free for these gadgets, and different Pixel telephones can entry it by way of a Google AI Premium subscription. Google additionally launched a brand new YouTube video for the April 2025 Pixel Drop showcasing the function, and there is now a devoted web page on the Google Store for it.
To get began, you may go dwell with Gemini, allow the digital camera and begin speaking.
Gemini Live follows on from Google’s Project Astra, first revealed final 12 months as presumably the corporate’s largest “we’re sooner or later” function, an experimental subsequent step for generative AI capabilities, past your merely typing and even talking prompts right into a chatbot like ChatGPT, Claude or Gemini. It comes as AI corporations proceed to dramatically improve the abilities of AI instruments, from video technology to uncooked processing energy. Similar to Gemini Live, there’s Apple’s Visual Intelligence, which the iPhone maker launched in a beta kind late final 12 months.
My massive takeaway is {that a} function like Gemini Live has the potential to alter how we work together with the world round us, melding our digital and bodily worlds collectively simply by holding your digital camera in entrance of just about something.
I put Gemini Live to an actual take a look at
The first time I attempted it, Gemini was shockingly correct after I positioned a really particular gaming collectible of a stuffed rabbit in my digital camera’s view. The second time, I confirmed it to a pal in an artwork gallery. It recognized the tortoise on a cross (do not ask me) and instantly recognized and translated the kanji proper subsequent to the tortoise, giving each of us chills and leaving us greater than somewhat creeped out. In a great way, I feel.
This was the primary object I examined with the brand new Gemini Live function, and it impressively acknowledged what it was and what recreation it was from (American McGee’s Alice). Every different time I requested Gemini to establish the sport the plush was from, it failed.
I acquired to desirous about how I might stress-test the function. I attempted to screen-record it in motion, but it surely persistently fell aside at that job. And what if I went off the overwhelmed path with it? I’m an enormous fan of the horror style — films, TV reveals, video video games — and have numerous collectibles, trinkets and what have you ever. How nicely would it not do with extra obscure stuff — like my horror-themed collectibles?
Initial assessments proved considerably extra profitable than the final, regardless of my giving it a number of hints. Gemini ultimately acquired the sport, Silent Hill: The Short Message, however nonetheless could not give the proper title for the determine, touchdown solely on “Cherry Blossom Monster” as an alternative of Sakurahead, which it had appropriately guessed a number of instances earlier.
First, let me say that Gemini will be each completely unimaginable and ridiculously irritating in the identical spherical of questions. I had roughly 11 objects that I used to be asking Gemini to establish, and it will generally worsen the longer the dwell session ran, so I needed to restrict periods to just one or two objects. My guess is that Gemini tried to make use of contextual info from beforehand recognized objects to guess new objects put in entrance of it, which form of is smart, however in the end, neither I nor it benefited from this.
Sometimes, Gemini was simply on level, simply touchdown the proper solutions with no fuss or confusion, however this tended to occur with newer or common objects. For instance, I used to be shocked when it instantly guessed certainly one of my take a look at objects was not solely from Destiny 2, however was a restricted version from a seasonal occasion from final 12 months.
At different instances, Gemini could be means off the mark, and I would want to present it extra hints to get into the ballpark of the proper reply. And generally, it appeared as if Gemini was taking context from my earlier dwell periods to provide you with solutions, figuring out a number of objects as coming from Silent Hill after they weren’t. I’ve a show case devoted to the sport sequence, so I might see why it will need to dip into that territory rapidly.
This was the toughest of my assessments. I requested Gemini to establish not solely what recreation this nonetheless was from (Silent Hill 2), however what iconic quote the particular person on the prime of the steps stated. Gemini nailed the sport, the characters, and half of the quote on the primary spherical; it took two extra guesses to complete the quote, “You see it, too? For me, it is at all times like this.”
Gemini can get full-on bugged out at instances. On multiple event, Gemini misidentified one of many objects as a made-up character from the unreleased Silent Hill: f recreation, clearly merging items of various titles into one thing that by no means was. The different constant bug I skilled was when Gemini would produce an incorrect reply, and I might appropriate it and trace nearer on the reply — or straight up give it the reply, solely to have it repeat the inaccurate reply as if it was a brand new guess. When that occurred, I might shut the session and begin a brand new one, which wasn’t at all times useful.
One trick I discovered was that some conversations did higher than others. If I scrolled by means of my Gemini dialog record, tapped an previous chat that had gotten a particular merchandise appropriate, and then went dwell once more from that chat, it will have the ability to establish the objects with out difficulty. While that is not essentially stunning, it was attention-grabbing to see that some conversations labored higher than others, even in the event you used the identical language.
Google did not reply to my requests for extra info on how Gemini Live works.
I needed Gemini to efficiently reply my generally extremely particular questions, so I supplied loads of hints to get there. The nudges had been typically useful, however not at all times. Below are a sequence of objects I attempted to get Gemini to establish and supply details about.
For this one, I simply requested Gemini what it noticed. “OK, I see a black and white cat that is basking within the solar on a hardwood ground. The cat is stretched out in a humorous place. There is a inexperienced rug with ‘Home is the place the..’ written on it.” I requested Gemini to guess once more, and I obtained responses from “house is the place the horror is” to “honor,” however it will definitely landed on the proper reply (simply the one phrase, “horror”).
Gemini gave me 4 mistaken characters from the proper recreation earlier than appropriately figuring out this iconic Bioshock Infinite character, Songbird.
Gemini nailed this creepy determine on the primary guess. (Twin Victim, Silent Hill 4: The Room)
No fuss — Gemini appropriately acknowledged Mira from Silent Hill 2, the true one answerable for the city
This one impressed me. While Gemini might “see” that this was a Silent Hill map, it nailed the truth that this was a limited-run print that was part of an ARG that came about final 12 months.
Gemini took a wildly completely different strategy to figuring out this jacket from Silent Hill 2. It requested 24 particular questions based mostly on the knowledge I gave it, with my first trace being that it was from a online game. However, by the nineteenth query, it appeared that it already knew precisely what recreation it was from by the particular questions it was asking me.
This one did not take lengthy, however Gemini initially urged that this portrait is perhaps of American creator and poet John Ashbery. Once I moved the digital camera nearer to the picture and stated it was from a TV present, Gemini replied appropriately, “That’s the Log Lady from Twin Peaks, holding her well-known log.”
This was a straightforward one for Gemini. It instantly acknowledged this as a limited-edition tarot deck that needed to be “earned” by enjoying by means of a particular seasonal occasion in Destiny 2.
