Tell HN: Gemini trains on chat history, even for subscribers (personal accounts)

727 points by jameslk 3 days ago


If you have a personal Google AI subscription, all your saved chat history in Gemini can be used for training and there is no way to opt out unless you turn off chat history or use temporary chat sessions. These chat transcripts may even be read by human reviewers. Although Google claims to disconnect them from your account when human-reviewed, they explicitly warn not to enter confidential information.

https://support.google.com/gemini/answer/16836988

“[Gemini app activity] is used to improve Google services for everyone, including by training generative AI models, if your Keep Activity setting is on.“

https://support.google.com/gemini/answer/13594961?hl=en#human_review

“A subset of chats are reviewed by human reviewers”

https://support.google.com/gemini/answer/13594961?hl=en#pn_retain_data

“Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.”

https://support.google.com/gemini/answer/13594961?hl=en#pn_data_usage

“Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google to use to improve our services, including machine-learning technologies.”

To disable their training on your chat sessions, you need to turn off “Keep Activity” in Gemini’s settings. Turning that off means you’ll lose any chat sessions after 72 hours.

I learned this too late, thinking that having a paid subscription = not being turned into the product. Apparently paying is not enough.

Thank you to this user on HN for mentioning in another thread: https://news.ycombinator.com/item?id=50355424

fny - 3 days ago

"These chat transcripts may even be read by human reviewers."

PSA: This is true of all the frontier model providers even if you disable activity tracking. They are all constantly monitoring your interactions for problematic behavior.

[0]: https://www.nytimes.com/wirecutter/advice/ai-chat-privacy/

[1]: https://www.404media.co/inside-project-lily-the-humans-readi...

[2]: https://www.winknews.com/news/woman-arrested-after-ai-threat...

devsda - 3 days ago

> Please don’t enter confidential information that you wouldn’t want a reviewer to see or Google

If Gemini has access to app data like gallery, mail etc that can also be subjected to human review? I imagine that will also be part of the context.

They are vague when they say 'don't enter'. Is it only prompts or does it also cover other data too.

giwook - 3 days ago

Is this really surprising to anyone?

I just sorta assumed that Google was hoovering up anything I type into its AI and don't tell it anything too personal or sensitive.

Is anyone under the illusion that our data is not being collected, whether it's Google or literally even the seemingly innocuous TVs in our home that have been found to be spying on us 24/7?

viraptor - 3 days ago

I don't trust any of the providers, but at the same time I think you're reading into the terms too much for wrong reasons. Yes, you have to opt out. But:

> A subset of chats are reviewed by human reviewers

This is expected these days for threads which may make the provider liable. Just look at the recent death case due to bad GPT medication recommendation.

> Chats reviewed by human reviewers [...] are not deleted when you delete your activity. Instead, they are retained for up to three years.

They're being retained for legal purposes.

> Please don’t enter confidential information...

This is so they don't accidentally preserve it for review, but also they don't want you to share private info that the agent will post somewhere without an explicit approval.

Those points make sense for them, regardless what other T&C rules apply.

233mhz - 3 days ago

imho you should act as if everything you type, not even send, is stored forever and might be used for training whenever they decide to retro actively change their TOS, no matter how much money you pay

jwr - 3 days ago

I am not sure why anyone expected anything different from Google. This is a company that lives and thrives on user data and tracking users. Users are the material that is being run through this entire huge ad-selling machine.

pydevgo - 7 hours ago

The implicit contract used to be simple: if you pay for a subscription, you aren't the product anymore. its broke!

snowchaser - a day ago

This is true of all paid “Pro” type plans from all the AI companies. These plans fall under “Consumer” style plans that do not explicitly forbid training. This is inn contrast to actual “Commercial” plans that do have formal Data Processing Agreements in place.

I respect Google’s position on the language in the Consumer ToS. It’s plain as day that they train on the consumer plans.

https://antigravity.google/terms/

Section 5, in Bold. “We use Interactions to evaluate, develop, and improve Google and Alphabet research, products, services and machine learning technologies. Interactions are collected and used in accordance with this Agreement and the Privacy Policy. Google employees and contractors may access, view, review and use Interactions. Please don’t submit confidential information or any data you wouldn’t want a reviewer to see or Google to use to improve our products, services and machine-learning technologies. If you don’t want your Interactions used in this way, navigate to settings to change your preference on how such data is used. Even when your Telemetry is toggled off, Google still uses your data to provide the service, process any feedback and help keep Antigravity safe.”

That last line is clear that they “use your data to provide the service”.

This is in contrast to the Google Workspace ToS, where it clearly says they don’t train (but it’s really hard ti find:

https://workspace.google.com/terms/service-terms/

“12.11 Training Restriction. Google will not use Customer Data to train or fine-tune any of its generative artificial intelligence models supporting the Google Workspace Generative AI Services without Customer's prior permission or instruction.”

Of course, Workspace doesn’t give you a good coding model, for that you have to go to API billing, which also has the DPA attached.

Anthropic and OAI have similar Team/Enterprise plans that prohibit training also, but they cost more than the basic Pro plans.

wafflemaker - 3 days ago

While we're touching on de-googling.

Can anybody recommend a good Swype¹ keyboard that is not G-board?

Old Swype+Dragon is dead.

Google regularly removes words they don't like from my dictionary. For example swear words, or today, I had to re-type GrapheneOS.

AD 1: By Swype I mean writing on Android by dragging my finger through the letters making up the words I want to type.

I also miss being able to easily use ctrl+c,x,v or easily entering space or other special characters, using special gestures.

There is just so many FOSS keyboards, that it's hard to choose from them. And I hope somebody with similar usage patterns could share what they are using.

fweimer - 3 days ago

Even if they don't train on your content, Google reserves the right to use it for improving their services in other ways:

“ This license is for the limited purpose of operating the services, which means allowing the services to work as designed and creating new features and functionalities. ”

https://policies.google.com/terms?hl=en-US#toc-permission

The training exclusion has always been a distraction. These service providers have plenty of other uses for your data.

baggachipz - 3 days ago

Is anyone actually surprised by this? They've devoured the whole internet for training already, the stream of shit coming in from users is the only way to hoover up more training data.

everdrive - 3 days ago

It's good to record this sort of information, but I hope no one expects any of the big LLM tools to be even remotely private. This is big tech in 2026. They don't even need to prove they can make money on your information. They're going to take every little last bit of information they can conceive of. 100% of the time.

teejaypeeps - a day ago

Yes, I wpuld be surprised if it was not. The type of information people are putting into these models, with blind faith people aren't reading them, is mind boggling really. One reason locally hosted models "win" is things like "sort out my monthly finances " and stuff you do not want to be saying to Big Tech.

DevOpsy - a day ago

This has an easy solution. Use Google Workspace, their private policy there promises to not using your chats for training. They don't want to alienate companies, so their privacy policy is much stronger there.

purplemantis - 3 days ago

It's stuff like this that makes me happy that at least one big tech company (Apple) cares about privacy. Hope they don't lose that. Although I wonder how much of that is exactly why they're behind in AI...

therealmarv - 3 days ago

They should offer history + not training (every other big AI company is offering that). The only way to get that currently is to use Gemini in Google Workspace.

There is also no opt out of training on their personal AI coding side with Antigravity.

And while there at it they should also allow to buy Youtube Premium Full normally when you've got Google AI Pro yearly which includes Youtube Premium Lite. The add+on price is like over 100% the price than buying Youtube Premium Full in my country and no way to buy normally :(

Byte-Naut - 2 days ago

I know it and use Gemini based on this background, with another background that most of my personal information is not interesting for potiential human reviewers. Just take it easy ~ :-)

lencastre - 2 days ago

For subscribing users: Disable “Keep Activity”, don’t use Gemini Web/Mobile apps and do all your chatting needs inside a Gemini Notebook. I understood that Notebooks are walled off. To the extent that that is true I cannot be sure. YMMV. Alternatively, maybe run models locally.

jay_kyburz - 3 days ago

Does this mean that if I take the time to correct an AI and show it how its wrong, later training data will include the correction?

That would be quite good actually.

Right now when the AI wrong I don't bother to correct it, I just open an new chat and change topics.

WarmWash - 3 days ago

This shouldn't be surprising at all.

Anytime you aren't paying full price for something, you are paying the rest with something else. We know the real cost because there is an API that comes with all the confidentiality, and that is much more expensive.

FYI, this is true for the other labs too.

wewewedxfgdf - 3 days ago

It might matter if Gemini was good enough to use but its not - I only use ChatGPT and Claude.

rdtsc - 3 days ago

Is there a way to use an API to export locally all the temporary chats and restore them as temporary chats for the next session? I am sure they’ll disable those eventually too, or even worse block your whole account for misuse.

hod6654 - 2 days ago

What can one currently use instead to have the same experience but preserving privacy?

icantevenhold - 3 days ago

I assume that everyone does this no matter what they say. Seems like too juicy a target

Tryvrsakjo10 - 3 days ago

I know they say not to enter confidential information, but they are basically using the LLM to spy on users it's unfortunate. Even deleting chats doesn't help because they keep that information for another year or 2.

- 3 days ago
[deleted]
cby821555203 - 3 days ago

In this true age of AI, privacy is virtually non-existent. I now make it a point not to share my secret keys or account information when chatting with Gemini, for fear that such data might be leaked.

hollowturtle - 3 days ago

We're out of training data, they need to get fresh data somewhere

elzbardico - 3 days ago

Why do you all think they got so good at coding and why they give us cheap personal cheap subscriptions for $200/month?

Of course they have been using our data all this time.

xyst - 3 days ago

The fact that HN has to be told this is quite surprising. Google et al have been doing this underhanded, sneaky behavior well before LLM hype.

Privacy at big tech is a facade.

andsoitis - 3 days ago

I’m very very surprised that anyone is surprised by this!

resters - 3 days ago

This probably explains why I see random google employees I've never met in my facebook "people you may know" feed.

nbulka - 3 days ago

I use File -> Save Page As ... does a good enough job, I just have to keep a folder on my computer.

realsarm - 3 days ago

Then people are totally fine puting all sort of private stuff in Notebooklm or Gemini notebook.

wseqyrku - 2 days ago

> unless you turn off chat history

That just blocks your own view.

blubber - 3 days ago

So we learn the difference between retail and business subscriptions.

advenn - 3 days ago

that's why i don't use gemini for anything serious or personal. if you want persistant memory you should enable keep activity, but keeping activity allows google to use your chats.

profstasiak - 3 days ago

They train on our code as well so they can replace us sooner

ozgung - 3 days ago

I’m disappointed it is not common knowledge that:

1- In Google/Gemini/Antigravity there is no “opt-out” (without making the service completely unusable). Your code/data is directly in their training set.

2- Others have partial “opt-out”. They can still read your chat history, run models on them, probably indirectly train some internal models.

whycome - 3 days ago

It's just keeping track of all the times you were mean

ConfusedDog - 3 days ago

Use a self-hosted chat app with paid-tier of API tokens.

richrichardsson - 3 days ago

What's worse is if you have a Pixel phone then Gemini is completely useless without enabling this setting.

I had it switched off:

"Hey Google, remind me at 7pm <something>"

"OK, your reminder is set for 7pm"

Next day:

"Hey Google, why didn't you remind me at 7pm"

"I can't do anything with your phone unless you enable chat history."

WTAF!

mackwell - 3 days ago

And if you do want privacy, and you purchase a workspace business plan instead… well then you have the pleasure of paying more and not having access to the latest models (and having no idea when you might get access to them eventually months later).

Haven880 - 3 days ago

This why I advocate Deepseek, GLM, Kimi, Qwen as in hosted directly (send data) to China. Think about it, what can they do worse off than what our own backyard AI can do? There is no privacy advantage in Western AI. It is way more likely ours leak your data to dark web (solid track records for decades) or get law enforcers on you. Meanwhile, am I suppose to be worried, China sending their Ming-like Eastern Bureau to my home in the west? On dark web, aplenty western companies leaks. How frequent the eastern one?

janilowski - a day ago

They’ve been doing that since Gemini was released!

I’m surprised it’s only trending now, I guess nobody reads the ToS and privacy policy :p

123102937946124 - 3 days ago

I always keep this in mind when interacting with proprietary LLMs. As someone who heavily relies on residential proxies over Tor and constantly rotates accounts (or avoids creating them entirely, as with Gemini Flash), I sometimes exploit this to subtly inject or promote public-interest ideas (mostly related to privacy) into the training data.

h8f1z - a day ago

That's AI. Who thinks their data is safe with AI companies? That's literally their business.

avereveard - 3 days ago

Jokes on them all my gemini chat are youtube link I want a summary of

croisillon - 3 days ago

training on "no i don't need google search to nurse me after a breakup, i was just asking what movie has the line she just dumped me"

bethekidyouwant - 3 days ago

You guys must be joking if you don’t want the AI to get better stop using it. NIMBY for your precious chat logs.

EbNar - 3 days ago

This is one of the reasons why I unsubscribed from Gemini Pro, apart from the fact that the experience with Gemini has been frankly underwhelming.

rheisen_ - 3 days ago

Friendly reminder that you should take measures to ensure your agentic workflows are secret-blind. E.g. place secrets by reference, check by reference, do NOT have agents read secret sensitive files without redaction measures in place, and be prepared to rotate on contact

ljlolel - 3 days ago

it’s all trained. that’s why i made trustedrouter so that it can be end to end encrypted ai chats

frevib - 3 days ago

If a company can do something that benefits them, and there is no way the customer can find out or prove that, the company will do it.

okdood64 - 3 days ago

Aren't they all like that?

hosteur - 3 days ago

Never trust google.

taspeotis - 3 days ago

If it’s not an iPhone it’s … not an iPhone.

jbrooks84 - 3 days ago

Every AI trains on the input given to it

dzonga - 3 days ago

we already knew this - google is gonna google - same way they train on your google photos and emails.

Zeruxe - 3 days ago

Scary!

tonyhart7 - 3 days ago

I mean, this is google we talking about

also the same cases for antrophic and open ai

why would anyone trust company that literally need data to improve their product ????

zodwick - 3 days ago

why am i not suprised

officeplant - 3 days ago

>thinking that having a paid subscription = not being turned into the product

This has never been true in techbro capitalism land. The paying members of a project are even more valuable in your datasets because you want to understand their behavior so you can pull more whales, I mean convert some customers :)

j45 - 3 days ago

This is a pretty disappointing thing to read.

r_lee - 3 days ago

another Google W I guess? gemini really leading the pack over here

dario_cositore - a day ago

[flagged]

wecide-apps - 2 days ago

[flagged]

EmX_3000 - 3 days ago

[dead]

LoboxPlatform - 2 days ago

[flagged]

rishabhjtripath - 3 days ago

[flagged]

ssuunnyy - 3 days ago

[flagged]

ankur_misra - 3 days ago

[flagged]

GianlucaBav - 3 days ago

[flagged]

- 3 days ago
[deleted]
niksmac - 3 days ago

[flagged]

cooluser - 3 days ago

[dead]

magus-stoopr - 3 days ago

[dead]

moooff - 3 days ago

[dead]

- 3 days ago
[deleted]
squidmaster - 3 days ago

[dead]

nyxthreepi - 3 days ago

[flagged]

StanislavPetrov - 3 days ago

We should all be writing bots that constantly spam all of these so-called AIs with random nonsense to poison the well.