AI firms ‘unprepared' for dangers of building human-level systems, report warns
The Future of Life Institute (FLI) said none of the firms on its AI safety index scored higher than a D for 'existential safety planning'.
One of the five reviewers of the FLI's report said that, despite aiming to develop artificial general intelligence (AGI), none of the companies scrutinised had 'anything like a coherent, actionable plan' to ensure the systems remained safe and controllable.
AGI refers to a theoretical stage of AI development at which a system is capable of matching a human in carrying out any intellectual task. OpenAI, the developer of ChatGPT, has said its mission is to ensure AGI 'benefits all of humanity'. Safety campaigners have warned that AGI could pose an existential threat by evading human control and triggering a catastrophic event.
The FLI's report said: 'The industry is fundamentally unprepared for its own stated goals. Companies claim they will achieve artificial general intelligence (AGI) within the decade, yet none scored above D in existential safety planning.'
The index evaluates seven AI developers – Google DeepMind, OpenAI, Anthropic, Meta, xAI and China's Zhipu AI and DeepSeek – across six areas including 'current harms' and 'existential safety'.
Anthropic received the highest overall safety score with a C+, followed by OpenAI with a C and Google DeepMind with a C-.
The FLI is a US-based non-profit that campaigns for safer use of cutting-edge technology and is able to operate independently due to an 'unconditional' donation from crypto entrepreneur Vitalik Buterin.
SaferAI, another safety-focused non-profit, also released a report on Thursday warning that advanced AI companies have 'weak to very weak risk management practices' and labelled their current approach 'unacceptable'.
The FLI safety grades were assigned and reviewed by a panel of AI experts, including British computer scientist Stuart Russell, and Sneha Revanur, founder of AI regulation campaign group Encode Justice.
Max Tegmark, a co-founder of FLI and a professor at Massachusetts Institute of Technology, said it was 'pretty jarring' that cutting-edge AI firms were aiming to build super-intelligent systems without publishing plans to deal with the consequences.
He said: 'It's as if someone is building a gigantic nuclear power plant in New York City and it is going to open next week – but there is no plan to prevent it having a meltdown.'
Tegmark said the technology was continuing to outpace expectations, citing a previously held belief that experts would have decades to address the challenges of AGI. 'Now the companies themselves are saying it's a few years away,' he said.
He added that progress in AI capabilities had been 'remarkable' since the global AI summit in Paris in February, with new models such as xAI's Grok 4, Google's Gemini 2.5, and its video generator Veo3, all showing improvements on their forebears.
A Google DeepMind spokesperson said the reports did not take into account 'all of Google DeepMind's AI safety efforts'. They added: 'Our comprehensive approach to AI safety and security extends well beyond what's captured.'
OpenAI, Anthropic, Meta, xAI, Zhipu AI and DeepSeek have also been approached for comment.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Independent
26 minutes ago
- The Independent
Scotland will be at ‘forefront of UK's technological revolution', says Murray
Scotland is in line for billions of pounds of investment, the UK Government said as it announced plans to site an AI Growth Zone north of the border. Scottish Secretary Ian Murray said the move will help put the country at the 'forefront of the UK's technological revolution'. It was announced as part of the UK Government's Compute Roadmap, which promises £1 billion to expand the country's AI research resource 20-fold over the next five years. It is understood several promising sites for the AI Growth Zone – which ministers hope will speed up the rollout of vital infrastructure like data centres – have already been identified in Scotland. It is hoped researchers and businesses at the centres will be able to process huge amounts of data to deliver the next generation of breakthroughs and innovations – including potentially finding new ways to treat and beat diseases, speeding up how we can diagnose conditions like cancer, and even using AI to help in the fight against climate change. Confirmation of an AI Growth Zone for Scotland comes after the UK Government announced £750 million of funding to build the UK's new national supercomputer at the University of Edinburgh. As part of the Compute Roadmap, ministers have now also confirmed the capital will be home to the UK's first National Supercomputing Centre. This will be a dedicated centre of expertise, with individual sites hosting everything from large data sets to cutting-edge processing power. Science, Innovation and Technology Secretary Peter Kyle said: 'From the shipyards of the Clyde to developments in steam engine technology, Scottish trailblazers were central to the industrial revolution. 'AI is this generation's next great industrial leap, so who better to help drive that change than a nation with innovation hardwired in its DNA.'We've set out an ambitious plan to cement our position as a global leader in AI, with Scotland set to play a key role – unlocking fresh investment and new opportunities. That's how we're putting our Plan for Change into action.' Mr Murray said: 'This is a landmark moment and will place Scotland at the forefront of the UK's technological revolution. 'The up to £750 million investment in Edinburgh's new supercomputer also places Scotland at the cutting edge of computing power globally. 'This will see Scotland playing a leading role in creating breakthroughs that have a global benefit – such as new medicines, health advances, and climate change solutions. 'This is the Plan for Change – delivering real opportunities and economic growth for communities across Scotland.' Scottish Government business minister Richard Lochhead said: 'With our world-renowned talent for research, innovation and ingenuity, Scotland is perfectly placed to capitalise on AI's rapid growth and be a supplier of this transformational technology, not just a consumer. 'We are also home to vital supporting and enabling infrastructure – from good-quality digital connectivity to the abundant renewable energy supplies needed to power the huge demand from computer processing in a sustainable way. 'The UK Government's confirmation that an AI Growth Zone and National Supercomputing Centre will be established in Scotland is welcome. 'It will help unlock new opportunities for businesses, researchers, citizens and communities — supporting high-quality jobs through economic growth and boosting productivity.'
The Independent
26 minutes ago
- The Independent
Microsoft wants to use human poop to lower its vast carbon footprint
Microsoft is looking to lower its vast carbon footprint by pumping human waste 5,000 feet below the ground's surface. The tech giant hopes to offset its massive carbon footprint, only exacerbated by its ventures into artificial intelligence, by using an unusual greenhouse gas removal strategy. On Thursday, Microsoft announced a deal to purchase 4.9 million metric tons of durable carbon dioxide removal from Vaulted Deep. The company's 'bioslurry,' or mix of human and farm waste, is injected deep underground – in exchange for carbon credits. Microsoft's purchase will span 12 years, starting next year. For each ton of carbon they shuttle deep underground, they will receive a carbon removal credit. 'We're taking different types of organic waste,' Julia Reichelstein, the co-founder and chief executive of Vaulted Deep, told the Journal. 'It's sludgy, often contaminated organic waste that today causes problems above ground, and instead we take the waste and put it really deep underground for permanent carbon removal,' Reichelstein added. The waste used by Vaulted Deep is typically a slurry, not quite solid, liquid, or gas. Traditionally, this type of waste is difficult to treat and often ends up being left in fields, leading to nutrient runoff and the spread of PFAS, or "forever chemicals," into water systems. Vaulted Deep, however, takes the slurry and pipes it deep under natural rock formations. The company then sells carbon credits based on the amount of carbon it stores below the ground. They currently sell for about $350 a metric ton, according to the report. Companies like Microsoft, which emitted 75.5 million tons of CO2 from 2020 to 2024, hope that storing organic waste thousands of feet underground will help them meet their emission targets. Microsoft has a goal of becoming carbon negative by 2030, and by 2050, hopes to remove more greenhouse gases than the company has emitted since its founding. To date, Microsoft has bought many carbon removal credits. It has acquired more than 83 million tons of carbon removal, of which 59 million tons have been bought so far this year, not including the deal with Vaulted Deep, according to the report. Brian Marrs, the tech giant's senior director of energy and carbon removal, touted the investment in Vaulted Deep as being mutually beneficial. 'They're essentially taking biosolids, and much of that today is spread over fields,' he said. 'It can create nutrient [runoff] and other pollutants for watersheds, and sealing out that biosolid where it can't be a nuisance to the environment and where it will not repatriate carbon into the atmosphere – that approach, that co-benefits approach is very, very interesting to us.'
Scotsman
26 minutes ago
- Scotsman
AI to unlock 'billions of pounds of investment and thousands of new jobs' in Scotland
Scotland to be epicentre of 'next great industrial leap' as AI Growth Zone confirmed Sign up to our Politics newsletter Sign up Thank you for signing up! Did you know with a Digital Subscription to The Scotsman, you can get unlimited access to the website including our premium content, as well as benefiting from fewer ads, loyalty rewards and much more. Learn More Sorry, there seem to be some issues. Please try again later. Submitting... Scotland is poised to be at the centre of 'this generation's next great industrial leap' with billions of pounds of investment and thousands of new jobs created after the UK government earmarked an AI Growth Zone to be established north of the Border. The country's booming offshore wind industry is set to power the strategy - which could see data centres and other crucial technology infrastructure built. Advertisement Hide Ad Advertisement Hide Ad Data centres could be built in Scotland as part of an AI Growth Zone The UK government has pointed to Scotland's access to wind, hydro and solar power sources making up a renewable energy capacity of 17.6 GW – enough to power more than 10 million homes . Labour UK ministers see it as an ideal base to help drive forward the UK's AI agenda, but other emerging sectors, including low carbon hydrogen are hoping to take advantage of an excess in renewable electricity being generated. The Scottish Government has welcomed the announcement and it is understood that devolved enterprise agencies north of the Border are working with partners that are seeking to support credible investment proposals and ensure Scottish content can be maximised in the construction and operation of the facilities. AI Growth Zones were unveiled by the UK government in January – and will serve as dedicated hotbeds for AI that speed up the rollout of vital infrastructure like data centres which are crucial to the technology's development. Advertisement Hide Ad Advertisement Hide Ad READ MORE: New supercomputer for Scotland and funding for Acorn Project confirmed in Spending Review Concerns have been raised about the scale-up of AI - including around jobs, security, reliability and the sheer amount of energy required to power AI data centres amid the climate crisis when energy demand will need to be reduced. The UK government believes new data centres will allow researchers and businesses to process huge amounts of data to deliver the next generation of breakthroughs and innovations. It is hoped the technology can assist efforts to find new ways to treat and cure diseases, speed up how conditions like cancer can be diagnosed - while there are even ambitions to use AI to help in the fight against climate change. Advertisement Hide Ad Advertisement Hide Ad AI is being harnessed in Scotland to develop a 25-minute skin cancer diagnosis test - with artificial intelligence projects around skin and breast cancer diagnostics being pushed forward. The rollout will mean that permanent, high-skilled jobs alongside construction roles will be created with the UK government hoping to scale up the sector at pace. In a further boost for the Scottish economy, Edinburgh will be home to the UK's first national supercomputing centre after Chancellor Rachel Reeves announced up to £750 million of funding for the project in last month's Spending Review. Previous plans for a supercomputer at University of Edinburgh's Advanced Computing Facility were shelved by the UK govenrment The centre, to be based at Edinburgh University, will work as a dedicated centre of expertise, with individual sites hosting everything from large data sets and cutting-edge processing power, to linking up researchers and academics with leading talent in their region. Advertisement Hide Ad Advertisement Hide Ad It is hoped the new supercomputer will give scientists from across the UK the capacity needed to carry out research – including related to personalised medical treatments, making air travel more sustainable or modelling climate change. The supercomputer plan was initially shelved by Prime Minister Sir Keir Starmer's Labour government last August amid reported concerns the project was not focused enough on artificial intelligence. That move angered SNP First Minister John Swinney who claimed projects in Scotland were being neglected in favour of investment projects south of the Border. The supercomputer will work alongside an AI research resource (AIRR), a network of the UK's most powerful supercomputers, that were built to bolster scientific research. Advertisement Hide Ad Advertisement Hide Ad The AIRR is already being used to research Alzheimer's vaccines and treatments for cancer by simulating how drugs work inside the body and 'testing' millions of potential drugs virtually to speed up the creation of new medicines. UK Science, Innovation, and Technology Secretary, Peter Kyle, said: 'From the shipyards of the Clyde to developments in steam engine technology, Scottish trailblazers were central to the industrial revolution. Labour MP and Tech and Science Secretary | Getty Images 'AI is this generation's next great industrial leap, so who better to help drive that change than a nation with innovation hardwired in its DNA.' He added: 'We've set out an ambitious plan to cement our position as a global leader in AI, with Scotland set to play a key role – unlocking fresh investment and new opportunities. Advertisement Hide Ad Advertisement Hide Ad 'That's how we're putting our plan for change into action.' Scottish Secretary, Ian Murray, said the announcement was 'a landmark moment' that 'will place Scotland at the forefront of the UK's technological revolution'. Scottish Secretary Ian Murray | PA He added: 'The up to £750 million investment in Edinburgh's new supercomputer also places Scotland at the cutting edge of computing power globally. 'This will see Scotland playing a leading role in creating breakthroughs that have a global benefit - such as new medicines, health advances, and climate change solutions. This is the plan for change – delivering real opportunities and economic growth for communities across Scotland." Advertisement Hide Ad Advertisement Hide Ad The Labour plans form part of the new compute roadmap, a strategy aimed at reducing reliance on foreign processing power and transform the UK's public compute capacity. By 2030, the UK government expects this capacity to increase to 420 AI exaFLOP – the equivalent of one billion people spending 13,316 years doing what the system will do in one second. To support the plans, researchers, academics and tech bosses have been brought together to develop an AI science strategy to be published in the autumn. Advertisement Hide Ad Advertisement Hide Ad The group includes Google DeepMind vice-president Pushmeet Kohli, vice-president of the Royal Society Alison Noble and chairwoman of the Engineering and Physical Sciences Research Council Charlotte Deane. Ms Reeves said the plans would 'transform our public services, drive innovation and fuel economic growth that puts money in people's pockets'. SNP Business Minister, Richard Lochhead, said the Westminster announcement was 'welcome', adding that Holyrood will work 'collaboratively with the UK government to make sure 'Scotland is at the heart of this globally-important industry'. Richard Lochhead He said: 'With our world-renowned talent for research, innovation and ingenuity Scotland is perfectly placed to capitalise on AI's rapid growth and be a supplier of this transformational technology, not just a consumer. Advertisement Hide Ad Advertisement Hide Ad 'We are also home to vital supporting and enabling infrastructure - from good quality digital connectivity to the abundant renewable energy supplies needed to power the huge demand from computer processing in a sustainable way.' 'The UK government's confirmation that an AI Growth Zone and national supercomputing centre will be established in Scotland is welcome', he added. 'It will help unlock new opportunities for businesses, researchers, citizens and communities—supporting high-quality jobs through economic growth and boosting productivity. 'The Scottish Government and our enterprise agencies have been working with prospective Scottish AI Growth Zone projects to support high quality bids into the national selection process being led by the UK government. Advertisement Hide Ad Advertisement Hide Ad
