Tell HN: Gemini trains on chat history, even for subscribers (personal accounts)

517 points - today at 10:10 AM


If you have a personal Google AI subscription, all your saved chat history in Gemini can be used for training and there is no way to opt out unless you turn off chat history or use temporary chat sessions. These chat transcripts may even be read by human reviewers. Although Google claims to disconnect them from your account when human-reviewed, they explicitly warn not to enter confidential information.

https://support.google.com/gemini/answer/16836988

“[Gemini app activity] is used to improve Google services for everyone, including by training generative AI models, if your Keep Activity setting is on.“

https://support.google.com/gemini/answer/13594961?hl=en#human_review

“A subset of chats are reviewed by human reviewers”

https://support.google.com/gemini/answer/13594961?hl=en#pn_retain_data

“Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.”

https://support.google.com/gemini/answer/13594961?hl=en#pn_data_usage

“Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google to use to improve our services, including machine-learning technologies.”

To disable their training on your chat sessions, you need to turn off “Keep Activity” in Gemini’s settings. Turning that off means you’ll lose any chat sessions after 72 hours.

I learned this too late, thinking that having a paid subscription = not being turned into the product. Apparently paying is not enough.

Thank you to this user on HN for mentioning in another thread: https://news.ycombinator.com/item?id=50355424

Comments

fny today at 3:20 PM
"These chat transcripts may even be read by human reviewers."

PSA: This is true of all the frontier model providers even if you disable activity tracking. They are all constantly monitoring your interactions for problematic behavior.

[0]: https://www.nytimes.com/wirecutter/advice/ai-chat-privacy/

[1]: https://www.404media.co/inside-project-lily-the-humans-readi...

[2]: https://www.winknews.com/news/woman-arrested-after-ai-threat...

richrichardsson today at 11:49 AM
What's worse is if you have a Pixel phone then Gemini is completely useless without enabling this setting.

I had it switched off:

"Hey Google, remind me at 7pm <something>"

"OK, your reminder is set for 7pm"

Next day:

"Hey Google, why didn't you remind me at 7pm"

"I can't do anything with your phone unless you enable chat history."

WTAF!

devsda today at 12:52 PM
> Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google

If Gemini has access to app data like gallery, mail etc that can also be subjected to human review? I imagine that will also be part of the context.

They are vague when they say 'don't enter'. Is it only prompts or does it also cover other data too.

giwook today at 2:55 PM
Is this really surprising to anyone?

I just sorta assumed that Google was hoovering up anything I type into its AI and don't tell it anything too personal or sensitive.

Is anyone under the illusion that our data is not being collected, whether it's Google or literally even the seemingly innocuous TVs in our home that have been found to be spying on us 24/7?

purplemantis today at 6:26 PM
It's stuff like this that makes me happy that at least one big tech company (Apple) cares about privacy. Hope they don't lose that. Although I wonder how much of that is exactly why they're behind in AI...
233mhz today at 10:53 AM
imho you should act as if everything you type, not even send, is stored forever and might be used for training whenever they decide to retro actively change their TOS, no matter how much money you pay
viraptor today at 11:46 AM
I don't trust any of the providers, but at the same time I think you're reading into the terms too much for wrong reasons. Yes, you have to opt out. But:

> A subset of chats are reviewed by human reviewers

This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.

> Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.

They're being retained for legal purposes.

> Please don’t enter confidential information...

This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.

Those points make sense for them, regardless what other T&C rules apply.

jwr today at 12:08 PM
I am not sure why anyone expected anything different from Google. This is a company that lives and thrives on user data and tracking users. Users are the material that is being run through this entire huge ad-selling machine.
andsoitis today at 5:32 PM
I’m very very surprised that anyone is surprised by this!
mackwell today at 2:14 PM
And if you do want privacy, and you purchase a workspace business plan instead… well then you have the pleasure of paying more and not having access to the latest models (and having no idea when you might get access to them eventually months later).
ljlolel today at 6:51 PM
it’s all trained. that’s why i made trustedrouter so that it can be end to end encrypted ai chats
baggachipz today at 1:46 PM
Is anyone actually surprised by this? They've devoured the whole internet for training already, the stream of shit coming in from users is the only way to hoover up more training data.
profstasiak today at 6:39 PM
They train on our code as well so they can replace us sooner
therealmarv today at 4:16 PM
They should offer history + not training (every other big AI company is offering that). The only way to get that currently is to use Gemini in Google Workspace.

There is also no opt out of training on their personal AI coding side with Antigravity.

And while there at it they should also allow to buy Youtube Premium Full normally when you've got Google AI Pro yearly which includes Youtube Premium Lite. The add+on price is like over 100% the price than buying Youtube Premium Full in my country and no way to buy normally :(

Haven880 today at 12:04 PM
This why I advocate Deepseek, GLM, Kimi, Qwen as in hosted directly (send data) to China. Think about it, what can they do worse off than what our own backyard AI can do? There is no privacy advantage in Western AI. It is way more likely ours leak your data to dark web (solid track records for decades) or get law enforcers on you. Meanwhile, am I suppose to be worried, China sending their Ming-like Eastern Bureau to my home in the west? On dark web, aplenty western companies leaks. How frequent the eastern one?
okdood64 today at 6:39 PM
Aren't they all like that?
elzbardico today at 6:53 PM
Why do you all think they got so good at coding and why they give us cheap personal cheap subscriptions for $200/month?

Of course they have been using our data all this time.

fweimer today at 11:41 AM
Even if they don't train on your content, Google reserves the right to use it for improving their services in other ways:

“ This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities. ”

https://policies.google.com/terms?hl=en-US#toc-permission

The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.

WarmWash today at 2:42 PM
This shouldn't be surprising at all.

Anytime you aren't paying full price for something, you are paying the rest with something else. We know the real cost because there is an API that comes with all the confidentiality, and that is much more expensive.

FYI, this is true for the other labs too.

resters today at 4:03 PM
This probably explains why I see random google employees I've never met in my facebook "people you may know" feed.
hollowturtle today at 2:58 PM
We're out of training data, they need to get fresh data somewhere
cby821555203 today at 2:38 PM
In this true age of AI, privacy is virtually non-existent. I now make it a point not to share my secret keys or account information when chatting with Gemini, for fear that such data might be leaked.
123102937946124 today at 3:51 PM
I always keep this in mind when interacting with proprietary LLMs. As someone who heavily relies on residential proxies over Tor and constantly rotates accounts (or avoids creating them entirely, as with Gemini Flash), I sometimes exploit this to subtly inject or promote public-interest ideas (mostly related to privacy) into the training data.
rdtsc today at 1:30 PM
Is there a way to use an API to export locally all the temporary chats and restore them as temporary chats for the next session? I am sure they’ll disable those eventually too, or even worse block your whole account for misuse.
xyst today at 6:37 PM
The fact that HN has to be told this is quite surprising. Google et al have been doing this underhanded, sneaky behavior well before LLM hype.

Privacy at big tech is a facade.

rheisen_ today at 6:17 PM
Friendly reminder that you should take measures to ensure your agentic workflows are secret-blind. E.g. place secrets by reference, check by reference, do NOT have agents read secret sensitive files without redaction measures in place, and be prepared to rotate on contact
Tryvrsakjo10 today at 12:45 PM
I know they say not to enter confidential information, but they are basically using the LLM to spy on users it's unfortunate. Even deleting chats doesn't help because they keep that information for another year or 2.
deleted today at 12:06 PM
avereveard today at 12:24 PM
Jokes on them all my gemini chat are youtube link I want a summary of
icantevenhold today at 10:52 AM
I assume that everyone does this no matter what they say. Seems like too juicy a target
officeplant today at 6:24 PM
>thinking that having a paid subscription = not being turned into the product

This has never been true in techbro capitalism land. The paying members of a project are even more valuable in your datasets because you want to understand their behavior so you can pull more whales, I mean convert some customers :)

croisillon today at 11:31 AM
training on "no i don't need google search to nurse me after a breakup, i was just asking what movie has the line she just dumped me"
realsarm today at 11:37 AM
Then people are totally fine puting all sort of private stuff in Notebooklm or Gemini notebook.
ConfusedDog today at 1:23 PM
Use a self-hosted chat app with paid-tier of API tokens.
advenn today at 11:42 AM
that's why i don't use gemini for anything serious or personal. if you want persistant memory you should enable keep activity, but keeping activity allows google to use your chats.
whycome today at 11:41 AM
It's just keeping track of all the times you were mean
bethekidyouwant today at 4:19 PM
You guys must be joking if you don’t want the AI to get better stop using it. NIMBY for your precious chat logs.
frevib today at 11:46 AM
If a company can do something that benefits them, and there is no way the customer can find out or prove that, the company will do it.
zodwick today at 4:00 PM
why am i not suprised
wewewedxfgdf today at 11:03 AM
It might matter if Gemini was good enough to use but its not - I only use ChatGPT and Claude.
EbNar today at 12:03 PM
This is one of the reasons why I unsubscribed from Gemini Pro, apart from the fact that the experience with Gemini has been frankly underwhelming.
hosteur today at 12:16 PM
Never trust google.
dzonga today at 2:41 PM
we already knew this - google is gonna google - same way they train on your google photos and emails.
taspeotis today at 2:08 PM
If it’s not an iPhone it’s … not an iPhone.
jbrooks84 today at 11:48 AM
Every AI trains on the input given to it
Zeruxe today at 11:55 AM
Scary!
r_lee today at 10:41 AM
another Google W I guess? gemini really leading the pack over here
tonyhart7 today at 2:41 PM
I mean, this is google we talking about

also the same cases for antrophic and open ai

why would anyone trust company that literally need data to improve their product ????

ankur_misra today at 4:55 PM
[flagged]
niksmac today at 3:56 PM
[flagged]
GianlucaBav today at 3:28 PM
[flagged]
rishabhjtripath today at 3:48 PM
[flagged]
deleted today at 3:48 PM
ssuunnyy today at 12:41 PM
[flagged]
moooff today at 3:58 PM
[dead]
magus-stoopr today at 2:21 PM
[dead]
cooluser today at 1:13 PM
[dead]
deleted today at 1:13 PM
nyxthreepi today at 1:33 PM
[flagged]
squidmaster today at 11:07 AM
[dead]
StanislavPetrov today at 11:07 AM
We should all be writing bots that constantly spam all of these so-called AIs with random nonsense to poison the well.