Google Mulling Gemini AI-Powered Chatbot to Tell Personal Life Stories Using Photos, Search Activity: Report

Google reportedly envisioned the Project Ellman chatbot becoming "Your Life Story Teller".

Written by David Delima, Edited by Siddharth Suvarna | Updated: 12 December 2023 16:10 IST

Google Mulling Gemini AI-Powered Chatbot to Tell Personal Life Stories Using Photos, Search Activity: Report

Photo Credit: Google

Google has not specified whether it considering building the chatbot around Google Photos

Highlights

Google could introduce a personalised AI chatbot in the future
The firm considered a chatbot that could provide insight based on photos
There's no word on whether Google is working on 'Project Ellman'

Google is considering the development of a new chatbot that is capable of telling the story of a user's life based on their photos and search history, according to a recent CNBC report. The search giant could use large language models (LLMs), such as the recently unveiled multimodal Gemini model, as part of a new AI project. Gemini is touted to compete with OpenAI's GPT-4 model, and Google claims that its top-of-the-line model outperforms its closest competitor on some benchmarks.

A CNBC report that cites internal documents states that one of Google's AI teams has suggested that the company develop an AI-based technology to use data from users' smartphones — including photos and their search activity — that will be consumed by an AI-powered chatbot. The project, dubbed Project Ellman, can then use the information to provide answers to "previously impossible questions", according to the report.

Instead of simply relying on "just pixels with labels and metadata", Project Ellman would try to spot patterns in a user's photos, studying photos and memories before and after the image to gain context, according to the report. The company's internal document also envisions "Ellman Chat" becoming “Your Life Story Teller.”

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

Google currently collects user's photos that are stored on the company's servers as part of its Google Photos backup and sync feature. The company did not specify whether the data source would be from Google Photos synced to the cloud, or whether the images would be processed on the user's device.

"This was an early internal exploration and, as always, should we decide to roll out new features, we would take the time needed to ensure they were helpful to people, and designed to protect users' privacy and safety as our top priority", a company spokesperson told the publication.

It is unclear whether Google is actively working on adding support for such a personalised AI chatbot that relies on its new Gemini AI models, which were unveiled by the company last week. Google's most powerful model — Gemini Ultra — won't be available until next year and is capable of outperforming OpenAI's GPT-4 model in some tests, according to Google.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Google, Google AI, Gemini, AI, Artificial intelligence, Google Photos, Project Ellman

David Delima

Email David Delima

As a writer on technology with Gadgets 360, David Delima is interested in open-source technology, cybersecurity, consumer privacy, and loves to read and write about how the Internet works. David can be contacted via email at DavidD@ndtv.com, on Twitter at @DxDavey, and Mastodon at mstdn.social/@delima. More