Tell HN: Gemini trains on chat history, even for subscribers (personal accounts)
517 points - today at 10:10 AM
If you have a personal Google AI subscription, all your saved chat history in Gemini can be used for training and there is no way to opt out unless you turn off chat history or use temporary chat sessions. These chat transcripts may even be read by human reviewers. Although Google claims to disconnect them from your account when human-reviewed, they explicitly warn not to enter confidential information.
https://support.google.com/gemini/answer/16836988
“[Gemini app activity] is used to improve Google services for everyone, including by training generative AI models, if your Keep Activity setting is on.“
“Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google to use to improve our services, including machine-learning technologies.”
To disable their training on your chat sessions, you need to turn off “Keep Activity” in Gemini’s settings. Turning that off means you’ll lose any chat sessions after 72 hours.
I learned this too late, thinking that having a paid subscription = not being turned into the product. Apparently paying is not enough.
Thank you to this user on HN for mentioning in another thread: https://news.ycombinator.com/item?id=50355424
Comments
fnytoday at 3:20 PM
"These chat transcripts may even be read by human reviewers."
PSA: This is true of all the frontier model providers even if you disable activity tracking. They are all constantly monitoring your interactions for problematic behavior.
What's worse is if you have a Pixel phone then Gemini is completely useless without enabling this setting.
I had it switched off:
"Hey Google, remind me at 7pm <something>"
"OK, your reminder is set for 7pm"
Next day:
"Hey Google, why didn't you remind me at 7pm"
"I can't do anything with your phone unless you enable chat history."
WTAF!
devsdatoday at 12:52 PM
> Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google
If Gemini has access to app data like gallery, mail etc that can also be subjected to human review? I imagine that will also be part of the context.
They are vague when they say 'don't enter'. Is it only prompts or does it also cover other data too.
giwooktoday at 2:55 PM
Is this really surprising to anyone?
I just sorta assumed that Google was hoovering up anything I type into its AI and don't tell it anything too personal or sensitive.
Is anyone under the illusion that our data is not being collected, whether it's Google or literally even the seemingly innocuous TVs in our home that have been found to be spying on us 24/7?
purplemantistoday at 6:26 PM
It's stuff like this that makes me happy that at least one big tech company (Apple) cares about privacy. Hope they don't lose that. Although I wonder how much of that is exactly why they're behind in AI...
233mhztoday at 10:53 AM
imho you should act as if everything you type, not even send, is stored forever and might be used for training whenever they decide to retro actively change their TOS, no matter how much money you pay
viraptortoday at 11:46 AM
I don't trust any of the providers, but at the same time I think you're reading into the terms too much for wrong reasons. Yes, you have to opt out. But:
> A subset of chats are reviewed by human reviewers
This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.
> Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.
They're being retained for legal purposes.
> Please don’t enter confidential information...
This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.
Those points make sense for them, regardless what other T&C rules apply.
jwrtoday at 12:08 PM
I am not sure why anyone expected anything different from Google. This is a company that lives and thrives on user data and tracking users. Users are the material that is being run through this entire huge ad-selling machine.
andsoitistoday at 5:32 PM
I’m very very surprised that anyone is surprised by this!
mackwelltoday at 2:14 PM
And if you do want privacy, and you purchase a workspace business plan instead… well then you have the pleasure of paying more and not having access to the latest models (and having no idea when you might get access to them eventually months later).
ljloleltoday at 6:51 PM
it’s all trained. that’s why i made trustedrouter so that it can be end to end encrypted ai chats
baggachipztoday at 1:46 PM
Is anyone actually surprised by this? They've devoured the whole internet for training already, the stream of shit coming in from users is the only way to hoover up more training data.
profstasiaktoday at 6:39 PM
They train on our code as well so they can replace us sooner
therealmarvtoday at 4:16 PM
They should offer history + not training (every other big AI company is offering that). The only way to get that currently is to use Gemini in Google Workspace.
There is also no opt out of training on their personal AI coding side with Antigravity.
And while there at it they should also allow to buy Youtube Premium Full normally when you've got Google AI Pro yearly which includes Youtube Premium Lite. The add+on price is like over 100% the price than buying Youtube Premium Full in my country and no way to buy normally :(
Haven880today at 12:04 PM
This why I advocate Deepseek, GLM, Kimi, Qwen as in hosted directly (send data) to China. Think about it, what can they do worse off than what our own backyard AI can do? There is no privacy advantage in Western AI. It is way more likely ours leak your data to dark web (solid track records for decades) or get law enforcers on you. Meanwhile, am I suppose to be worried, China sending their Ming-like Eastern Bureau to my home in the west? On dark web, aplenty western companies leaks. How frequent the eastern one?
okdood64today at 6:39 PM
Aren't they all like that?
elzbardicotoday at 6:53 PM
Why do you all think they got so good at coding and why they give us cheap personal cheap subscriptions for $200/month?
Of course they have been using our data all this time.
fweimertoday at 11:41 AM
Even if they don't train on your content, Google reserves the right to use it for improving their services in other ways:
“
This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities.
”
The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.
WarmWashtoday at 2:42 PM
This shouldn't be surprising at all.
Anytime you aren't paying full price for something, you are paying the rest with something else. We know the real cost because there is an API that comes with all the confidentiality, and that is much more expensive.
FYI, this is true for the other labs too.
resterstoday at 4:03 PM
This probably explains why I see random google employees I've never met in my facebook "people you may know" feed.
hollowturtletoday at 2:58 PM
We're out of training data, they need to get fresh data somewhere
cby821555203today at 2:38 PM
In this true age of AI, privacy is virtually non-existent. I now make it a point not to share my secret keys or account information when chatting with Gemini, for fear that such data might be leaked.
123102937946124today at 3:51 PM
I always keep this in mind when interacting with proprietary LLMs. As someone who heavily relies on residential proxies over Tor and constantly rotates accounts (or avoids creating them entirely, as with Gemini Flash), I sometimes exploit this to subtly inject or promote public-interest ideas (mostly related to privacy) into the training data.
rdtsctoday at 1:30 PM
Is there a way to use an API to export locally all the temporary chats and restore them as temporary chats for the next session? I am sure they’ll disable those eventually too, or even worse block your whole account for misuse.
xysttoday at 6:37 PM
The fact that HN has to be told this is quite surprising. Google et al have been doing this underhanded, sneaky behavior well before LLM hype.
Privacy at big tech is a facade.
rheisen_today at 6:17 PM
Friendly reminder that you should take measures to ensure your agentic workflows are secret-blind. E.g. place secrets by reference, check by reference, do NOT have agents read secret sensitive files without redaction measures in place, and be prepared to rotate on contact
Tryvrsakjo10today at 12:45 PM
I know they say not to enter confidential information, but they are basically using the LLM to spy on users it's unfortunate. Even deleting chats doesn't help because they keep that information for another year or 2.
deletedtoday at 12:06 PM
avereveardtoday at 12:24 PM
Jokes on them all my gemini chat are youtube link I want a summary of
icantevenholdtoday at 10:52 AM
I assume that everyone does this no matter what they say.
Seems like too juicy a target
officeplanttoday at 6:24 PM
>thinking that having a paid subscription = not being turned into the product
This has never been true in techbro capitalism land. The paying members of a project are even more valuable in your datasets because you want to understand their behavior so you can pull more whales, I mean convert some customers :)
croisillontoday at 11:31 AM
training on "no i don't need google search to nurse me after a breakup, i was just asking what movie has the line she just dumped me"
realsarmtoday at 11:37 AM
Then people are totally fine puting all sort of private stuff in Notebooklm or Gemini notebook.
ConfusedDogtoday at 1:23 PM
Use a self-hosted chat app with paid-tier of API tokens.
advenntoday at 11:42 AM
that's why i don't use gemini for anything serious or personal. if you want persistant memory you should enable keep activity, but keeping activity allows google to use your chats.
whycometoday at 11:41 AM
It's just keeping track of all the times you were mean
bethekidyouwanttoday at 4:19 PM
You guys must be joking if you don’t want the AI to get better stop using it. NIMBY for your precious chat logs.
frevibtoday at 11:46 AM
If a company can do something that benefits them, and there is no way the customer can find out or prove that, the company will do it.
zodwicktoday at 4:00 PM
why am i not suprised
wewewedxfgdftoday at 11:03 AM
It might matter if Gemini was good enough to use but its not - I only use ChatGPT and Claude.
EbNartoday at 12:03 PM
This is one of the reasons why I unsubscribed from Gemini Pro, apart from the fact that the experience with Gemini has been frankly underwhelming.
hosteurtoday at 12:16 PM
Never trust google.
dzongatoday at 2:41 PM
we already knew this - google is gonna google - same way they train on your google photos and emails.
taspeotistoday at 2:08 PM
If it’s not an iPhone it’s … not an iPhone.
jbrooks84today at 11:48 AM
Every AI trains on the input given to it
Zeruxetoday at 11:55 AM
Scary!
r_leetoday at 10:41 AM
another Google W I guess? gemini really leading the pack over here
tonyhart7today at 2:41 PM
I mean, this is google we talking about
also the same cases for antrophic and open ai
why would anyone trust company that literally need data to improve their product ????
ankur_misratoday at 4:55 PM
[flagged]
niksmactoday at 3:56 PM
[flagged]
GianlucaBavtoday at 3:28 PM
[flagged]
rishabhjtripathtoday at 3:48 PM
[flagged]
deletedtoday at 3:48 PM
ssuunnyytoday at 12:41 PM
[flagged]
mooofftoday at 3:58 PM
[dead]
magus-stooprtoday at 2:21 PM
[dead]
coolusertoday at 1:13 PM
[dead]
deletedtoday at 1:13 PM
nyxthreepitoday at 1:33 PM
[flagged]
squidmastertoday at 11:07 AM
[dead]
StanislavPetrovtoday at 11:07 AM
We should all be writing bots that constantly spam all of these so-called AIs with random nonsense to poison the well.