TikTok has one of the most extensive content moderation system as the content its users create is reviewed by… artificial intelligence?!?!
In order to make that claim about TikTok’s moderation, one must understand the status quo in moderation today.
As content moderation was one of the first problems regarding user-generated content that computer-vision scientists were assigned to solve – filtering content that is NSFW (not safe for work) and inappropriate.
Asking what is the right balance between very little and very heavy moderation is a complex question that all platforms are facing – especially when consumers might not be aware that content is being filtered out.
Designing content from a product perspective only involves three variations on a theme:
- Search: Goal oriented, I know what I’m looking for – e.g. Google
- Browse: Aimless, not sure what I want – e.g. Netflix
- Contextual: Finding something else along the way – e.g. Wikipedia
Whenever browse based systems are prioritized in a product such as algorithmic feeds or “discover” screens – such as the “For You” page on TikTok – there is a possibility of users living in a content bubble is inherent in the design. If platforms could influence the content users consume then platforms could possibly influence public opinion, according to TechCrunch.
Content bubbles – such as the For You Page – the word algorithm has worked its way into people talking about their Facebook feeds and why their Instagram post isn’t doing well, in the last few years.
At the end of the day, TikTok decides who becomes famous based on the content they put out and what theme it belongs in as AI sorts through the content and decides what to put on the For You page on the application.
What are your thoughts? Let us know in the comments below.
Photo Credit: Shutterstock