Latest news with #MatthewHolman
CNBC
01-07-2025
- Business
- CNBC
Web giant Cloudflare to block AI bots from scraping content by default
Internet firm Cloudflare will start blocking artificial intelligence crawlers from accessing content without website owners' permission by default, in a move that could significantly impact AI developers' ability to train their models. Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow AI crawlers, effectively giving them the ability to prevent bots from scraping data from their websites. Cloudflare is what's called a content delivery network, or CDN. It helps businesses deliver online content and applications faster by caching the data closer to end-users. They play a significant role in making sure people can access web content seamlessly every day. Roughly 16% of global internet traffic goes directly through Cloudflare's CDN, the firm estimated in a 2023 report. "AI crawlers have been scraping content without limits. Our goal is to put the power back in the hands of creators, while still helping AI companies innovate," said Matthew Prince, co-founder and CEO of Cloudflare, in a statement Tuesday. "This is about safeguarding the future of a free and vibrant Internet with a new model that works for everyone," he added. AI crawlers are automated bots designed to extract large quantities of data from websites, databases and other sources of information to train large language models from the likes of OpenAI and Google. Whereas the internet previously rewarded creators by directing users to original websites, according to Cloudflare, today AI crawlers are breaking that model by collecting text, articles and images to generate responses to queries in a way that users don't need to visit the original source. This, the company adds, is depriving publishers of vital traffic and, in turn, revenue from online move builds on a tool Cloudflare launched in September last year that gave publishers the ability to block AI crawlers with a single click. Now, the company is going a step further by making this the default for all websites it provides services for. OpenAI says it declined to participate when Cloudflare previewed its plan to block AI crawlers by default on the grounds that the content delivery network is adding a middleman to the system. The Microsoft-backed AI lab stressed its role as a pioneer of using a set of code that prevents automated scraping of web data, and said its crawlers respect publisher preferences. "AI crawlers are typically seen as more invasive and selective when it comes to the data they consumer. They have been accused of overwhelming websites and significantly impacting user experience," Matthew Holman, a partner at U.K. law firm Cripps, told CNBC. "If effective, the development would hinder AI chatbots' ability to harvest data for training and search purposes," he added. "This is likely to lead to a short term impact on AI model training and could, over the long term, affect the viability of models."
Sharjah 24
08-06-2025
- Science
- Sharjah 24
Scientists rule out 'Planet X' in most suspected sky regions
Extensive survey with PAN-STARRS1 Telescope The findings come from a comprehensive survey of the outer solar system using the PAN-STARRS1 telescope in Hawaii. The results were published on the preprint server Broad search yields hundreds of small celestial bodies Led by Matthew Holman of the Harvard-Smithsonian Center for Astrophysics, the team conducted one of the most extensive searches to date for distant planetary objects. They identified 692 small celestial bodies, including 23 dwarf planets and 109 newly discovered objects. No trace of Planet X found Despite the wide-ranging search, no sign of a large ninth planet was detected. However, the survey significantly narrowed the potential location where Planet X could still exist. Innovative detection method The team developed a specialised algorithm to analyze images from 2009 to 2017. The PAN-STARRS1 telescope, typically used to detect fast-moving objects like asteroids, was repurposed to identify slow-moving bodies far from the Sun—those located at 80 AU or more. By cross-referencing known asteroid paths, the algorithm tracked motion in the distant solar system, but found no evidence of Planet X. Remaining search area near Milky Way plane The only region left unexamined is a narrow area near the plane of the Milky Way, which PAN-STARRS1 has not yet surveyed in detail due to the density of stars and dust. This region remains the final candidate for Planet X's possible location. Background: The Planet X hypothesis Interest in Planet X surged in 2016 after scientists Konstantin Batygin and Michael Brown proposed its existence. They suggested a Neptune-sized planet orbiting far beyond Pluto, at distances of at least 670 AU from the Sun. Scientific debate continues Despite multiple searches, no direct observation of Planet X has been made. This has led some astronomers to question its existence and investigate alternative explanations for the unusual gravitational patterns in the outer solar system.
