Can AI solve the content-moderation problem?
'Content moderation is one of the crucial issues of our day and it is essentially broken," says Carolina Are, a researcher at the Center for Digital Citizens at Northumbria University in the U.K. One major difficulty is that different users have different ideas about what should be prohibited online. Are swear words fair game? Nudity? Violent imagery? In the Cato survey, 60% of users said they wanted social-media platforms to provide them with greater choice to pick and choose what they see and what they don't.
Soon this kind of personalized content moderation may become a reality, thanks to generative AI tools. In a paper presented this spring at the ACM Web Conference in Sydney, Australia, researchers Syed Mahbubul Huq and Basem Suleiman created a YouTube filter based on commercially available large language models. They used four AI chatbots to analyze subtitles from 4,098 public YouTube videos across 10 popular genres, including cartoons and reality TV. Each video was assessed on 17 metrics used by the British Board of Film Classification to assign film ratings, including violence, nudity and self-harm.
Two of the chatbots, GPT-4 and Claude 3.5, were able to identify content that human checkers assessed as harmful at least 80% of the time. The system isn't perfect, and so far it can only assess language in videos, not images. It's also expensive: 'To filter every video [on YouTube] would cost trillions of dollars at today's prices," Huq said.
But the demonstration model points to a future in which social media users are able to choose exactly what kinds of content they see. 'If the parent of a child thinks it's suitable for their child to see content that's high in sexual scenes, but low intensity in drugs, they can adjust it," says Huq. With the cost of AI access rapidly dropping, 'we're not far away from when this will be possible."
Maarten Sap, assistant professor at Carnegie Mellon University, believes effective content moderation will require specialized LLMs, since off-the-shelf models are 'not built for nuanced tasks." For instance, recent research by Sap and his colleagues find AIs have trouble understanding 'relationship backstory," leaving them unable to distinguish between playful banter among friends and personal attacks on strangers. Still, he agrees that LLMs offer an 'opportunity" to develop more finely-grained moderation tools.
Customized social-media filters could raise problems as well as solving them. Zeerak Talat, a computer scientist studying content moderation at the University of Edinburgh, notes that users could fine-tune their feeds to see more hate speech instead of less: 'If everyone has personalized moderation, we have no way of controlling illegal content." One option could be to tailor AI content moderation to the laws and preferences of different countries, rather than to individuals: Sexual or political content that would be normal in Silicon Valley could be offensive or illegal in a conservative, religious society.
Still, some critics worry that by giving individual users the power to filter what they see, tech giants would be letting themselves off the hook for problems they created. 'I'm reluctant to see the onus of everything being put on the user," says Are. 'I don't want to be told that I deserve to get raped, and I have to be the one putting it in the feed."
Talat agrees, noting that customized moderation may protect an individual user, but it doesn't stop hateful or offensive content from spreading to others. 'It defends your stream," he says. 'But it does nothing about what is said about you."
Chris Stokel-Walker is a journalist and author based in the U.K. His latest book is 'How AI Ate the World."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
17 minutes ago
- Time of India
Mr Faisu aka Faisal Shaikh reacts to his breakup rumours with Jannat Zubair; says, 'Abhi main single hun, 1-1.5 saal mein shaadi kar lunga'
Faisal Shaikh, who won many hearts with his last show Celebrity MasterChef, recently shared a vlog on his YouTube channel. The reality show star featured Elvish Yadav in his cooking vlog, and the two opened up about their personal as well as professional lives. Elvish asked Faisu about his relationship status and his alleged breakup with Jannat Zubair . While Jannat and Faisu never confirmed their relationship, the two had been close friends for many years. However, they unfollowed each other a few months ago, leaving everyone shocked. Ever since then, neither Faisu nor Jannat has reacted to their fallout. Recently, Faisu shared a vlog with Elvish where they made several revelations. It started with Faisu asking Elvish about his breakup with ex-girlfriend Kriti Mehra. Elvish refused to answer and said there was no such thing. Later, Elvish asked Faisu if he's currently dating anyone. Responding to this, Faisu said, 'Meri reh chuki hai ek girlfriend, and aap jo soch rahe ho, wohi bohot log soch rahe hain, but aisa kuch nahi hai. Abhi main single hun, and 1-1.5 saal mein shaadi kar lunga.' Elvish reacted to this and said, 'Haan same, main bhi 1-1.5 saal mein shaadi kar hi lunga.' The two then cooked a dish together and talked about their lives. Elvish said, 'I know I trolled you previously, however, I didn't dislike you. I knew that you're the nice one from your Team 07, and I realise how far you've come in life. Now we are good friends, and I'm happy about it.'
Time of India
28 minutes ago
- Time of India
Adam Levine says he's 'done' with tattoos
Picture Credit: Facebook Singer Adam Levine said that he is done getting tattoos and also revealed the reason behind it. In an interview with the Maroon 5 frontman, spoke about his extensive body art, noting that his latest tattoo was a refresh on his left arm sleeve. While the musician said that getting fresh tattoos is "fun," he called the overall process "painful," reports "I covered up my sleeve with another sleeve. Who does that? What is wrong with me? Psychotic," Levine said. He further stressed that his latest tattoo session "really hurt," deciding ultimately that "he's kind of done with the pain." "Now, I've softened. Now, when I get a tattoo, I'm like, 'This hurts so badly.' Like, 'What's wrong?' We're done," he said. Asked which was his favourite tattoo, Levine said there were "too many" to choose from before ultimately telling that his favourite were the ones on his hands, which spell out "true love" across his fingers. Levine is the lead singer, rhythm guitarist and sole continuous member of the pop rock band Maroon 5. He began his musical career in 1994 with the band Kara's Flowers, for which he served as lead vocalist and lead guitarist. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like 4BHK+Family Lounge+Utility room at 4.49Cr (All Incl)* ATS Triumph, Gurgaon Book Now Undo After the commercial failure of their only album, The Fourth World, the group was reformed in 2001 as Maroon 5 - with James Valentine replacing him as lead guitarist. In 2002, they released their first album, Songs About Jane, which went multi-platinum in the US; since then, they have released six more albums: It Won't Be Soon Before Long, Hands All Over, Overexposed, V, Red Pill Blues and Jordi. As part of Maroon 5, Levine has received multiple accolades, including three Grammy Awards. As a solo artist, he achieved concurrent commercial success with his guest appearance on Gym Class Heroes' 2011 single "Stereo Hearts", which peaked within the top five of the Billboard Hot 100.
Time of India
28 minutes ago
- Time of India
‘LAC: Battle of Galwan' director on facing CBFC roadblocks: They asked us to remove the photos of the 20 real-life martyrs
Recently, the upcoming movie 'Battle of Galwan' starring Salman Khan made news with the release of its teaser. The movie has been the talk of the town ever since; however, did you know that there is another movie made on the same subject, which was quietly released on YouTube owing to multiple CBFC cuts and suggestions. Tired of too many ads? go ad free now The movie we are talking about is 'LAC: Battle of Galwan,' which has been written and directed by Nitin Kumar Gupta. Starring Rahul Roy, the movie presents a fictional version of the 2020 battle between Indian and Chinese troops in Ladakh. The movie was initially planned to be released on June 15, 2023, on the anniversary of the Galwan Valley conflict. 'I wanted the martyrs' families to see the film in theatres," said the director, according to a Mid-Day report. He further highlighted that the film faced significant challenges during its process with the Central Board of Film Certification (CBFC). Filmed in November 2020, it was presented to the CBFC in June 2022. Subsequently, it was screened in August for the Additional Directorate General of Public Information committee from the Ministry of Defence, and then again for the CBFC. In September 2022, the board recommended several modifications. 'They asked me to remove LAC from the title, delete references to the actual location, and reduce violence by 33 per cent — essentially asking us to dilute the reality of hand-to-hand combat our soldiers faced," Gupta revaled before adding, 'The most painful was when they asked us to remove the photos of the 20 real-life martyrs from the end credits.' He mentioned that the photos they used were already in the public domain, released by the government with their names. Tired of too many ads? go ad free now Despite taking several precautions, which included changing martyrs' names and avoiding direct reference to China. A revised version was sent in September 2022, but there was no reply. Nitin said he tried knocking on every door for three years. Salman Khan's upcoming film, 'Battle of Galwan,' is generating buzz after the release of its intense first look, which showcases a bloodied Salman. While much of the cast remains a mystery, it's now confirmed that Chitrangda Singh will join him as the female lead, highlighting a new on-screen pairing.
