
Cloudflare introduces AI bot blocker
Cloudflare's tech targets AI firm bots – also known as crawlers – which are programs that explore the web, indexing and collecting data as they go. They are important to the way AI firms build, train and operate their systems. So far, Cloudflare says its tech is active on a million websites.
Roger Lynch, chief executive of Condé Nast, whose print titles include GQ, Vogue, and The New Yorker, said the move was 'a game-changer' for publishers. 'This is a critical step toward creating a fair value exchange on the Internet that protects creators, supports quality journalism and holds AI companies accountable', he wrote in a statement. However, other experts say stronger legal protections will still be needed.
Initially the system will apply by default to new users of Cloudflare services, plus sites that participated in an earlier effort to block crawlers. Many publishers accuse AI firms of using their content without permission.
Cloudflare argues AI breaks the unwritten agreement between publishers and crawlers. AI crawlers, it argues, collect content like text, articles, and images to generate answers, without sending visitors to the original source—depriving content creators of revenue. 'If the Internet is going to survive the age of AI, we need to give publishers the control they deserve and build a new economic model that works for everyone,' wrote the firm's chief executive Matthew Prince.
To that end the company is developing a 'Pay Per Crawl' system, which would give content creators the option to request payment from AI companies for utilising their original content.
According to Cloudflare there has been an explosion of AI bot activity. 'AI Crawlers generate more than 50 billion requests to the Cloudflare network every day', the company wrote in March. And there is growing concern that some AI crawlers are disregarding existing protocols for excluding bots. In an effort to counter the worst offenders Cloudflare previously developed a system where the worst miscreants would be sent to a 'Labyrinth' of web pages filled with AI generated junk.
The new system attempts to use technology to protect the content of websites and to give sites the option to charge AI firms a fee to access it.
Source: BBC News
Image Credit: Cloudflare
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles


Khaleej Times
28 minutes ago
- Khaleej Times
CX Evolve UAE 2025: How top brands use tech to build customer loyalty, trust
Presented by Khaleej Times under the KT Events banner, the 5th edition of CX Evolve UAE returns to Dubai on August 28, 2025, hosted at the iconic JW Marriott Hotel Marina. As customer experience moves from buzzword to business imperative, this flagship summit is building up to the grand unveiling of the UAE's top CX leaders, bringing together marketing visionaries, government pioneers, and transformation champions ready to redefine how experience drives growth in a digitally accelerated era. In 2025, experience is no longer reactive; it's predictive, intentional, and measurable. With AI, behavioural analytics, and emotional intelligence reshaping the CX playbook, CX Evolve UAE 2025 explores how organisations are building adaptive, ethical, and scalable CX ecosystems that deliver impact at every touchpoint. From data-led personalisation and purposeful design to responsible AI and internal transformation, attendees will get a front-row seat to how leading brands are turning customer experience into a true competitive edge. Confirmed brands shaping the conversation include: Etisalat, Majid Al Futtaim, Banque Misr UAE, Cigna Healthcare International Health, Ogilvy, Samana-Group, GMG, and many other prominent brands, all set to share trailblazing insights, real-world case studies, and their vision for the future. Set against the UAE's dynamic digital-first economy, CX Evolve UAE 2025 offers unmatched insights into how top organisations are breaking data silos, embedding empathy into automation, and cultivating internal cultures that deliver consistent, emotionally intelligent customer journeys. From finance to the public sector, healthcare to retail, this summit is where leaders discover how to align technology with human insight to build trust and loyalty at scale. For solution providers, the summit provides direct access to the C-suite, innovation officers, and transformation heads seeking next-generation tools, platforms, and partnerships to elevate experience strategies. Partnering with CX Evolve UAE means stepping into the heart of one of the world's most advanced customer experience ecosystems. For brands, platforms, and CX enablers, this is your stage to connect with decision-makers, demonstrate ROI-driven solutions, and shape the regional dialogue around experience innovation.


Tahawul Tech
an hour ago
- Tahawul Tech
OpenAI to rent gigawatts of capacity from Oracle
OpenAI has agreed to rent computing power from Oracle for use in US data centres as part of the ChatGPT developers' Stargate joint venture project. Bloomberg reported OpenAI plans to rent data centre capacity from Oracle totalling roughly 4.5 gigawatts. The news site stated a gigawatt is like the capacity output of a single nuclear reactor and enough electricity for roughly 750,000 homes. Its unnamed sources explained Oracle will build multiple data centres across the US with its partners to meet the additional demand from OpenAI. Oracle initially focused on a building a data centre site for OpenAI in the US state of Texas, but Bloomberg explained new sites across Texas, Michigan, Wisconsin and Wyoming are also under consideration. The site in Texas will expand from a current capacity of 1.2 gigawatts to about 2 gigawatts, Bloomberg reported. Open AI is also interested in additional data centre sites in New Mexico, Georgia, Ohio and Pennsylvania. While the new sites will be part of the Stargate project, the news agency noted details of the plan are fluid. Oracle recently stated in a regulatory filing it signed a cloud deal worth $30 billion in annual revenue, with revenue expected to start in fiscal year 2028. The Stargate project with OpenAI will make up part of the $30 billion contract, Bloomberg reported. In May, OpenAI, Oracle, SoftBank Group, Nvidia, and Cisco teamed to build a Stargate AI campus in the United Arab Emirates (UAE), marking the first international deployment of the joint venture. OpenAI and SoftBank Group reportedly want to expand the presence of their $500 billion US project to build out AI infrastructure to additional countries such as the UK, Germany and France. Source: Mobile World Live Image Credit: OpenAI


Tahawul Tech
an hour ago
- Tahawul Tech
Trump Administration Archives
With Veo 3 now built into the Gemini app, people can write the scene they want to watch. This description is called a 'prompt' and with it, Veo 3 will whip up a custom eight-second video complete with sound, dialogue, and music, at 720p output.