TikTok, YouTube rack up views of AI-generated Pope sermons
An AFP investigation identified dozens of YouTube and TikTok pages that have been churning out AI-generated messages delivered in the pope's voice or otherwise attributed to him since he took charge of the Catholic Church last month.
The hundreds of fabricated sermons and speeches, in English and Spanish, underscore how easily hoaxes created using artificial intelligence can elude detection and dupe viewers.
"There's natural interest in what the new pope has to say, and people don't yet know his stance and style," said University of Washington professor emeritus Oren Etzioni, founder of TrueMedia.org, a nonprofit focused on fighting deepfakes. "A perfect opportunity to sow mischief with AI-generated misinformation."
After AFP presented YouTube with 26 channels posting predominantly AI-generated pope content, the platform terminated 16 of them for violating its policies against spam, deceptive practices and scams, and another for violating YouTube's terms of service.
"We terminated several channels flagged to us by AFP for violating our Spam policies and Terms of Service," spokesperson Jack Malon said.
TikTok similarly removed 11 accounts that AFP pointed out – with over 1.3 million combined followers – citing the platform's policies against impersonation, harmful misinformation and misleading AI-generated content of public figures.
With names such as "Pope Leo XIV Vision," the social media pages portrayed the pontiff supposedly offering a flurry of warnings and lessons he never preached.
But disclaimers annotating their use of AI were often hard to find – and sometimes nonexistent.
On YouTube, a label demarcating "altered or synthetic content" is required for material that makes someone appear to say something they did not. But such disclosures only show up toward the bottom of each video's click-to-open description.
A YouTube spokesperson said the company has since applied a more prominent label to some videos on the channels flagged by AFP that were not found to have violated the platform's guidelines.
TikTok also requires creators to label posts sharing realistic AI-generated content, though several pope-centric videos went unmarked.
A TikTok spokesperson said the company proactively removes policy-violating content and uses verified badges to signal authentic accounts.
Brian Patrick Green, director of technology ethics at Santa Clara University, said the moderation difficulties are the result of rapid AI developments inspiring "chaotic uses of the technology."
The AI-generated sermons not only "corrode the pope's moral authority" and "make whatever he actually says less believable," Green said, but could be harnessed "to build up trust around your channel before having the pope say something outrageous or politically expedient." afp
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Express Tribune
2 days ago
- Express Tribune
Google Pixel 10 release date announced: Find out full details of leaked specs ahead of 'Made by Google' event in August
Google has officially confirmed the date for its highly anticipated Pixel 10 launch event, set to take place on August 20, 2025, in New York City. The event will kick off at 1 PM ET, with the company expected to unveil its new lineup of Pixel phones, including the much-anticipated Pixel 10 series, as well as updates to its Pixel Watch, Pixel Buds, and more. The Pixel 10 series, which has been subject to numerous leaks, is expected to feature several models, including the standard Pixel 10, the Pixel 10 Pro, and the larger Pixel 10 Pro XL. Rumours suggest that the base Pixel 10 will come with a triple-camera setup, improving on its predecessor's dual-camera system, as reported by The Verge. New Made by Google (Pixel) event officially August 20th — Marques Brownlee (@MKBHD) July 16, 2025 There is also speculation that Google will unveil a dustproof version of the Pixel 10 Pro, the Pixel 10 Pro Fold, which could include a larger cover screen. In addition to the phones, Google may reveal updates to its wearables, including the Pixel Watch 4, which is expected to feature a larger battery and a slightly thicker profile. While details on the next generation of Pixel Buds are scarce, some reports suggest that Google may introduce a new budget-friendly model, the Pixel Buds 2a. The event is expected to be streamed live on YouTube, allowing fans and tech enthusiasts to watch the announcements in real time. With a wide range of devices set to be revealed, the Pixel 10 event promises to be a major showcase for Google's growing hardware division, continuing the company's push into the consumer electronics market.
Express Tribune
4 days ago
- Express Tribune
Teenagers in America seeking AI friends
Nearly three in four American teenagers have used AI companions, with more than half qualifying as regular users despite growing safety concerns about these virtual relationships, according to a new survey released on Wednesday, as per AFP. AI companions – chatbots designed for personal conversations rather than simple task completion – are available on platforms like Replika, and Nomi. Unlike traditional artificial intelligence assistants, these systems are programmed to form emotional connections with users. The findings come amid mounting concerns about the mental health risks posed by AI companions. The nationally representative study of 1,060 teens aged 13-17, conducted for Common Sense Media, found that 72 per cent have used AI companions at least once, while 52 per cent interact with such platforms a few times per month. Common Sense Media is a leading American nonprofit organisation that reviews and provides ratings for media and technology with the goal of providing information on their suitability for children. The survey revealed that 30 per cent of respondents use the platforms because "it's entertaining" and 28 per cent are driven by curiosity about the technology. However, concerning patterns emerged: one-third of users have chosen to discuss serious matters with AI companions instead of real people, while 24 per cent have shared personal information including real names and locations. Perhaps most troubling, 34 per cent of teen users reported feeling uncomfortable with something an AI companion had said or done, though such incidents were infrequent. "The reality that nearly three-quarters of teens have used these platforms, with half doing so regularly, means that even a small percentage experiencing harm translates to significant numbers of vulnerable young people at risk," the report said. The survey revealed an age divide in trust levels. While half of all teens expressed distrust in AI companion advice, younger teens (ages 13-14) were more likely than older teens (15-17) to trust advice from these systems. Despite widespread usage, most teens maintained perspective on these relationships: two thirds found AI conversations less satisfying than human interactions, and 80 per cent spent more time with real friends than AI companions. Based on the findings, Common Sense Media recommended that no one under 18 use AI companions until stronger safeguards are implemented. "Companies have put profits before kids' well-being before, and we cannot make the same mistake with AI companions," the report said.
Express Tribune
5 days ago
- Express Tribune
Netflix integrates generative AI in media production, starting with 'El Atonata'
Netflix has officially begun incorporating generative artificial intelligence (GenAI) into its film and television productions, marking a significant shift in the entertainment industry. The company revealed this development during its post-results conference call on Thursday, 17 July. Ted Sarandos, co-CEO of Netflix, shared that the platform had used GenAI for the first time in creating final footage for a scene in the Argentine show El Atonata. The AI-generated scene features a building collapse, which was completed ten times faster than traditional visual effects methods and at a reduced cost, as reported by TechCrunch. Sarandos emphasised that Netflix views AI not just as a tool for cutting costs but as a means to enhance the creative process. 'We remain convinced that AI represents an incredible opportunity to help creators make films and series better, not just cheaper," he said. "There are AI-powered creator tools that allow real people to do real work with better tools. Our creators are already seeing benefits in production, particularly in pre-visualisation, shot planning, and visual effects.' Netflix used AI to create a scene in the show 'El Atonata,' finishing it 10x faster and cheaper than traditional effects. AI also helps with personalization, search, and upcoming interactive ads. Netflix Q2 revenue: $11B, with 95B hours watched so far in 2025. — Road to superintelligence (@roadtoasi) July 18, 2025 The use of AI tools in visual effects previously required high budgets, with advanced techniques like de-aging reserved for larger projects. However, Sarandos explained that AI is now enabling smaller-scale productions to access these cutting-edge tools. Greg Peters, Netflix's co-CEO, also mentioned that GenAI is being utilised in other areas of the company's operations, including personalisation, search, and advertising. Netflix is aiming to roll out interactive ads in the second half of 2025, following the successful launch of AI-powered search earlier this year. Netflix reported a revenue of $11.08 billion for the second quarter of 2025, marking a 16% increase compared to the same period last year. The company also reported a profit of $3.13 billion and highlighted that users watched over 95 billion hours of content in the first half of the year, with non-English titles accounting for one-third of all views.
