TikTok's 'Addictive Design' Found to Be Illegal in Europe

nytimes.com

165 points by thm 2 hours ago


erzhan89 - 2 hours ago

https://archive.is/V1NPt

jamesblonde - an hour ago

I gave a talk at PyData Berlin on how to build your own TikTok recommendation algorithm. The TikTok personalized recommendation engine is the world's most valuable AI. It's TikTok's differentiation. It updates recommendations within 1 second of you clicking - at human perceivable latency. If your AI recommender has poor feature freshness, it will be perceived as slow, not intelligent - no matter how good the recommendations are.

TikTok's recommender is partly built on European Technology (Apache Flink for real-time feature computation), along with Kafka, and distributed model training infrastructure. The Monolith paper is misleading that the 'online training' is key. It is not. It is that your clicks are made available as features for predicitons in less than 1 second. You need a per-event stream processing architecture for this (like Flink - Feldera would be my modern choice as an incremental streaming engine).

* https://www.youtube.com/watch?v=skZ1HcF7AsM

* Monolith paper - https://arxiv.org/pdf/2209.07663

eggy - 37 minutes ago

I'm skeptical about banning design patterns just because people might overuse them. Growing up, I had to go to the theater to see movies, but that didn't make cliffhangers and sequels any less compelling. Now we binge entire Netflix series and that's fine, but short-form video needs government intervention? The real question is: where do we draw the line between protecting people from manipulative design and respecting their ability to make their own choices? If we're worried about addictive patterns, those exist everywhere—streaming platforms, social feeds, gaming, even email notifications. My concern isn't whether TikTok's format is uniquely dangerous. It's whether we trust adults to manage their own media consumption, or if we need regulatory guardrails for every compelling app. I'd rather see us focus on media literacy and transparency than constantly asking governments to protect us from ourselves.

You can't legislate intelligence...

llbbdd - an hour ago

Idk how to feel about this specifically but I kind of hope they come for Duolingo next. They are up to some similar mind hacking shit to keep people from leaving. There's the downright abusive streak management tactics that have become a major part of their brand and PR, and the lesson plans seem designed to plateau to prevent you from actually getting proficient enough in a language to ever unsub. They reset your cleared lessons and require you to redo them if they add new vocab to them, as well as randomly clearing them in the name of making you practice them again. I don't know what the solution is but I've known multiple people now who've gotten frustrated and blamed themselves for not being able to advance their skills with a language, but Duolingo's business model, like Tinder's, is completely opposed with the goals of their users. If Duolingo R&D discovered a magical new method of making you fluent in a language overnight, they would not sell it to you. Tinder R&D might have discovered the actual honest-to-God formula for True Love years ago and burned it because they can make more if you swipe forever.

Aurornis - 34 minutes ago

The headline overstates what actually happened. Ironic that they’re using clickbait headlines on an article about a service using tricks to get people to engage with something.

They haven’t concluded anything yet. It’s early in the process and they’re opening the process of having TikTok engage and respond.

The article starts with a headline the makes it sound like the conclusion was already made, then the more you read the more it becomes clear that this is the early part of an investigation, not an actual decision.

> Now European Union regulators say those same features that made TikTok so successful are likely illegal.

> No timeline was given on when authorities will make a final decision in the case.

lozenge - 2 hours ago

I don't understand the legal side, but after gaining and kicking a Tiktok addiction during and after COVID, I believe it. I was there 4-8 hours a day and tried to scroll videos while washing dishes (and during nearly any other activity).

Retr0id - an hour ago

The press release: https://ec.europa.eu/commission/presscorner/detail/en/ip_26_...

> At this stage, the Commission considers that TikTok needs to change the basic design of its service. For instance, by disabling key addictive features such as ‘infinite scroll' over time, implementing effective ‘screen time breaks', including during the night, and adapting its recommender system.

Most of these seem concretely doable, and maybe effective. But the core of the addictiveness comes from the "recommender system", and what are they supposed to do there? Start recommending worse content? How much worse do the recommendations have to be before the EC is satisfied?

RobotToaster - 2 hours ago

> On Friday, the regulators released a preliminary decision that TikTok’s infinite scroll, auto-play features and recommendation algorithm amount to an “addictive design” that violated European Union laws for online safety.

How is that any different to Facebook?

pier25 - 35 minutes ago

I only tried it once and like 30 mins passed in the blink of an eye. Never again.

uriahlight - 8 minutes ago

Europeans really need to get their heads out of their butts. Their solution to every problem is nanny state regulation.

amadeuspagel - 11 minutes ago

Banning infinite scroll comes close to banning good design. If removing pointless interruptions is illegal, we might as well throw every designer in prison. And why stop there? Why not force TikTok to add other pointless barriers, like making the user solve a puzzle before watching another video? What about other uninterrupted experiences, like watching TV?

I find twitter more addictive then TikTok. Should it be forced to make me click "next" before seeing another tweet?

Banning recommendation engines is also incredible. Is it really the EU's case that they're all illegal, from the youtube recommendation engine to amazon's "people who bought this also bought" to twitter's "who to follow"? Is TikTok's just too good?

graemep - an hour ago

No, one branch of the EU (not European) government has said it is likely (there has been no ruling) that its illegal.

Its a good thing, but its not what the title says it is

glimshe - 2 hours ago

Maybe I don't get addicted easily, but after 30 minutes of forcing myself to watch tiktok, I just uninstalled it. Friends told me I didn't give it enough time to learn my tastes but... How could it, given that literally 100% of the videos in my interest areas were trash?

SlightlyLeftPad - an hour ago

I hope they go after Whatnot, Youtube shorts, and LinkedIn as well.

LinkedIn has become such a pit of force-fed self-help vitriol it’s completely lost its purpose.

heyheyhouhou - 34 minutes ago

They should do the same with Instagram and Youtube shorts... but wait, they are not chinese, they are allowed to mine us...

delichon - an hour ago

I use X almost entirely from the desktop where I have an extension installed that lets me whitelist my follows, and see nothing else. I recently browsed the same feed on mobile ... and it was entirely different! I think I spent a half hour and saw zero content from my follows, just one ticktok style video after another. For those who find these services without value, I now understand. But I feel revolted rather than addicted. Will I now experience a mysterious compulsion to view the naked feed?

semiquaver - an hour ago

Just curious for anyone who pays more attention to this than me: is the company being sanctioned by the EU for this behavior the one that US law forced an ownership change of or does that company only operate in the US?

bdcravens - 25 minutes ago

So what's next, Hacker News is illegal because the point system encourages retention?

juancn - 44 minutes ago

Isn't this exactly the same with Instagram, Snapchat, Facebook, etc.?

What makes TikTok different?

concats - 37 minutes ago

TikTok has a lot of issues, such as privacy, dubious content, 'brainrot', etc. I don't want to seem like I'm necessarily defending TikTok specifically here.

But this really just stinks of Regulatory Capture to me. Their main argument is that the consumers like to use the app too much?

Why? Because it's smarter and not as enshittified as the competitors?

I'm sure if youtube, facebook, reddit, etc reduced the number of ads, and started showing more relevant content that people actually cared about, they too would start being "more addictive". Do we really want to punish that?

What's the end goal here?

shafyy - 30 minutes ago

Direct link to EU Commission's statement: https://ec.europa.eu/commission/presscorner/detail/en/ip_26_...

ddmma - 32 minutes ago

They will pay upfront or put some geopolitical pressure https://www.bbc.com/news/articles/c24g8v6qr1mo

ajsnigrutin - an hour ago

Might be a generational thing, but I never understood the "shorts" (in any format on any social network).

I can watch a 9 hour video on GTA games without problems (not in one sitting, but in parts), but 3 'shorts' in a row with not enough info and explanation to be interesting makes me close any of the 'shorts' apps (tiktok, youtube shorts, instagram....).

(eg, the 9 hour video: https://www.youtube.com/watch?v=Faxpr_3EBDk )

christkv - an hour ago

So will they also go after youtube?

andrewinardeer - 2 hours ago

Infinite scroll is banned on this phone. Using NextDNS.

WhereIsTheTruth - 2 hours ago

Funny how Europe's "concern" for digital health only kicks in when a non US platform starts winning

globular-toast - 2 hours ago

Good. I feel like since cracking down on smoking in the 90s we've become really complacent to the dangers of addiction. Just like with smoking you'll get people inside the industry defending it too (like in this very comment section).

vachina - an hour ago

lol. Imagine needing an authoritarian figure to dictate what you can and cannot consume. Are you that feeble minded.

mothballed - 2 hours ago

[flagged]

aurareturn - 2 hours ago

[flagged]

keepamovin - an hour ago

Purity! Purity! Purity! The stewards of civilization! The guards of righteousness! Oh, Europe, how beautifully doth your actions grace this heathen world with enlightenment. Oh, Europe, glory of the Human Race, Pride of the Old Gods, may you exist a 1000 generations!