Reports indicate a massive uptick in AI-generated CSAM throughout the internet
AI-generated child sexual abuse material (CSAM) has been flooding the internet, according to a report by The New York Times . Researchers at organizations like the Internet Watch Foundation and the National Center for Missing & Exploited Children are warning that this new AI-created CSAM is nearly indistinguishable from the real thing.
Let's go over some numbers. The Internet Watch Foundation, a nonprofit that investigates and collects reports of CSAM , has identified 1,286 AI-generated videos so far this year. This is compared with just two videos identified in the first half of 2024. That's an exponential increase. To view this content, you'll need to update your privacy settings. Please click here and view the "Content and social-media partners" setting to do so.
🔎 Developments in artificial intelligence (AI) come with a range of benefits, including supporting learning and innovation. There is, however, growing concern for how AI can also be misused to create and share child sexual abuse material (CSAM), referred to as AI-CSAM.
In… pic.twitter.com/lgfRQNBk8N
— Internet Watch Foundation (IWF) (@IWFhotline) July 8, 2025
The National Center for Missing & Exploited Children re-affirms those statistics. It told NYT that it has received 485,000 reports of AI-generated CSAM, including still images and videos, in the first half of 2025. This is compared to 67,000 for all of 2024. That's another massive uptick
'It's a canary in the coal mine,' said Derek Ray-Hill, interim chief executive of the Internet Watch Foundation. 'There is an absolute tsunami we are seeing.'
This technology is constantly improving, so the videos and images have become more realistic. The Internet Watch Foundation found an internet forum in which users were praising how realistic the new videos were. Reporting suggests that this content is distributed through the dark web, making it harder for law enforcement agencies to identify the offenders.
It's worth remembering how AI image generators work. They are trained using real images and videos. The New York Times says that much of this new glut of AI-generated content includes real CSAM that has been repurposed by the algorithm. Some of the material even uses real photos of children scraped from school websites and social media.
The issue dates back to the early days of this technology. In 2023, researchers at the Stanford Internet Observatory found hundreds of examples of CSAM in a data set used in an early version of the image generator Stable Diffusion. Stability AI says it has introduced safeguards to improve safety standards and "is deeply committed to preventing the misuse of our technology, particularly in the creation and dissemination of harmful content, including CSAM."
That did lead other companies to start reporting AI-generated CSAM to the National Center for Missing & Exploited Children. Amazon reported a whopping 380,000 instances of AI-generated CSAM in the first half of this year, all of which it took down. OpenAI reported 75,000 cases . To view this content, you'll need to update your privacy settings. Please click here and view the "Content and social-media partners" setting to do so.
NCMEC Applauds the California State Legislature for Passing AB 1831 and looks forward to it being signed into law.
NCMEC supports AB 1831 because it addresses gaps in California's legal remedies for child victims of Generative AI CSAM. We are heartened to see states move… pic.twitter.com/qZt1mgD7Eo
— National Center for Missing & Exploited Children (@NCMEC) September 4, 2024
Courts have been slow to catch up with this tech. The DOJ made its first known arrest last year of a man suspected of possessing and distributing AI-generated CSAM . A UK man recently got 18 months in jail for using AI to generate the foul images, which he sold.
'The Department of Justice views all forms of AI-generated CSAM as a serious and emerging threat,' Matt Galeotti, head of the Justice Department's criminal division, told NYT .
It's worth noting that despite the alarming uptick in occurrences, AI-generated content still represents a mere fraction of all CSAM identified by authorities and watchdog organizations. For instance, the Internet Watch Foundation confirmed 291,273 reports of CSAM in 2024 and, as previously noted, just two instances were AI-generated.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Entrepreneur
a minute ago
- Entrepreneur
Robinhood Is Using AI to Generate Half of All New Code
Robinhood co-founder and CEO, Vlad Tenev, says almost all engineers at the company have adopted AI coding tools. Engineers at the stock trading and investing app Robinhood are using AI to generate new code instead of writing it themselves. Robinhood CEO Vlad Tenev said on the 20VC podcast earlier this week that "close to 100%" of software engineers at the company are using AI to write blocks of code, tapping into tools like Cursor and Windsurf, which advertise advanced coding, debugging, and editing capabilities. According to Tenev, over 50% of new code at Robinhood is AI-generated, the same percentage as Salesforce. Related: Robinhood Is Offering a Credit Card for the First Time — and It's Available in 10-Karat Gold Tenev said that it was difficult to differentiate between AI-written code and human-created code, estimating that only a "minority" of new code at Robinhood was now written by humans. "It's hard to even determine what the human-generated code is," Tenev said on the podcast. "If I had to guess, it's in the minority." Meanwhile, Google CEO Sundar Pichai and Microsoft CEO Satya Nadella have individually stated that AI writes 30% of the code at their respective companies, putting Robinhood's AI coding adoption ahead of those big tech companies. Robinhood CEO Vlad Tenev. Photo byfor Breakthrough Prize Tenev also said on the podcast that AI has had a "huge" impact on Robinhood internally, affecting teams like customer support. For example, Robinhood built its own version of ChatGPT for customer service. "The impact that it's had on internal teams, ranging from software engineering to customer support, the really big internal teams, has been huge," Tenev said on the podcast. Related: OpenAI Blasts Robinhood for Selling OpenAI Tokens: 'We Do Not Endorse It' Robinhood has more than quadrupled its market capitalization in the past eight months, from $21 billion in November to about $90 billion at the time of writing. In 2024, the company achieved total net revenue of $2.95 billion, up 58% year-over-year.
Yahoo
29 minutes ago
- Yahoo
PG&E Corporation (PCG) Calls Innovators to Help Solve California's Energy Challenge
PG&E Corporation (NYSE:PCG) is one of the Best 52-Week Low Stocks to Buy According to Analysts. On July 7, PG&E Corporation (NYSE:PCG) announced that it is calling for innovators to help solve California's toughest energy challenges. The company has up to $25 million to fund new projects. They want entrepreneurs, inventors, and tech experts to join their 2025 Innovation Pitch Fest. The event will take place from September 23 to September 25, at PG&E's Oakland headquarters. It focuses on breakthrough technologies that need strong collaboration between PG&E and external innovators. The company updated its strategy in 2024, highlighting key problem areas and increased emphasis on using Artificial Intelligence to improve energy systems. Brightly-lit nighttime view of an electricity power grid with distribution lines and transmission substations. For this year's Innovation Pitch Fest, PG&E Corporation (NYSE:PCG) has set 10 specific problem statements. They include challenges like managing the energy demands of growing AI data centers, accelerating neighborhood electrification, reducing wildfire risks, and improving safety through AI. PG&E wants fast, scalable solutions to these urgent problems. PG&E Corporation (NYSE:PCG) is a major utility serving northern and central California. It provides electricity and natural gas to about 16 million people across a 70,000-square-mile area. While we acknowledge the potential of PCG as an investment, we believe certain AI stocks offer greater upside potential and carry less downside risk. If you're looking for an extremely undervalued AI stock that also stands to benefit significantly from Trump-era tariffs and the onshoring trend, see our free report on the best short-term AI stock. READ NEXT: 30 Stocks That Should Double in 3 Years and 11 Hidden AI Stocks to Buy Right Now. Disclosure: None. This article is originally published at Insider Monkey. Sign in to access your portfolio
Yahoo
29 minutes ago
- Yahoo
LATIMER.AI AND GRAMMARLY PARTNER TO DELIVER THE INDUSTRY'S FIRST INCLUSIVE AI WRITING ASSISTANT BUNDLE FOR HIGHER EDUCATION
Engagement Will Increase Access to AI Bias Mitigation for Thousands of Educational Institutions NEW YORK, July 17, 2025 /PRNewswire/ -- the first inclusive Large Language Model (LLM), and Grammarly, the trusted AI assistant for communication and productivity, announced today a partnership to provide Grammarly for Education customers with exclusive access to the two services, which together can improve writing quality and cultural awareness, helping institutions enhance student success and drive inclusive learning outcomes, without sacrificing usability or scale. The partnership will roll out in phases, with increasing collaboration across product, go-to-market, and educational impact initiatives over the coming year. "At Grammarly, we've been committed to the responsible use of AI in education since our founding in 2009," says Jenny Maxwell, Head of Education at Grammarly. "Our partnership with Latimer helps us further demonstrate this commitment by providing an inclusive LLM to the more than 3,000 educational institutions we work with, supporting equity efforts in higher education." Latimer utilizes a Retrieval Augmented Generation ("RAG") mode and is the premier online Artificial Intelligence resource for accurate historical information and bias-free interaction. Unlike other LLMs, Latimer uses licensed and exclusive content from esteemed sources, such as the New York Amsterdam News, which is the second-oldest Black newspaper published in the United States, to build its training platform. "Our collaboration with Grammarly reflects a shared commitment to equipping the next generation with the tools they need to write with confidence, think critically, and share their voices with the world," says Latimer CEO, John Pasmore. "Additionally, Grammarly for Education's focus on providing writing support is complementary to what we're building, and reinforces the idea that writers need not become overly reliant on AI, but rather that AI is a tool that augments without replacing the work of real people." As a customer of both Grammarly and Latimer, Dr. Robert MacAuslan, VP of AI at Southern New Hampshire University (SNHU) adds, "As the largest university in the U.S. [more than 200,000 learners] with an incredibly diverse student body, we recognize two essential truths about artificial intelligence: first, that AI literacy and exposure are critical to student success; and second, that these tools inherently reflect the biases of those who design and maintain them. Acknowledging this means that we have a responsibility to equip our learners with technologies that minimize bias and to teach them how to use these tools ethically and effectively. Our partnership with Latimer marks a meaningful step in that direction—providing students with a safe, trustworthy AI platform built on inclusive, ethically sourced training data. With Latimer, SNHU can confidently offer AI resources that better represent and support all our students." As LLMs evolve, Latimer's platform can provide a solution. By deploying a more diverse database that works in concert with foundation models, Latimer is working to mitigate bias. To learn more, please visit: ABOUT LATIMERAI is amplifying the bias, inaccuracy, and erasure of diverse cultural data. Latimer was built to solve this. Founded and led by serial entrepreneur John N. Pasmore, Latimer has gathered some of the most notable names across various industries to create a more inclusive and equitable platform. The business is named for Lewis Latimer, a Black inventor whose legacy and historical scientific contributions are often overlooked. The LLM provides users with more inclusive data sources. To learn more, please visit ABOUT GRAMMARLYGrammarly is the trusted AI assistant for communication and productivity, helping over 40 million people, 3,000 educational institutions, and 50,000 organizations do their best work. Companies like Atlassian, Databricks, and Zoom rely on Grammarly to brainstorm, compose, and enhance communication that moves work forward. Grammarly works where you work, integrating seamlessly with over 500,000 applications and websites. Learn more at View original content to download multimedia: SOURCE Latimer
