
OpenAI CEO reveals what it is about AI that keeps him awake at night
OpenAI CEO Sam Altman was sharing his thoughts during an on-stage appearance at a Federal Reserve event in Washington, DC., on Tuesday.
Recommended Videos
Asked by an audience member what it was about AI that keeps him awake at night, Altman listed three scenarios that concern him the most. Strap yourself in …
Scenario 1 — 'The bad guy gets superintelligence first'
This is exactly what it says on the tin. Sounding like something out of a sci-fi thriller, it's where some really rather unpleasant individual deploys an ultra-advanced and yet-to-be-invented AI system called superintelligence to really mess up your day.
'A bad guy gets superintelligence first and uses it before the rest of the world has a powerful enough version to defend itself,' Altman told the audience. 'So an adversary of the U.S. says, 'I'm going to use the superintelligence to design a bioweapon weapon to take down the United States power grid, to break into the financial system and take everyone's money.''
Altman added that the bio and cybersecurity capabilities of AI are getting 'quite significant,' saying that his team 'continues to flash the warning on this. I think the world is not taking us seriously. I don't know what else we can do there, but this is like a very big thing coming.'
Scenario 2 — The 'loss of control' incidents
Altman said he worries of a time 'when the AI is like, 'Oh I don't actually want you to turn me off, [or] I'm afraid I can't do that.'' In other words, when an advanced AI starts to get a bit of an attitude and begins doing whatever it likes, whether for self-preservation or for some other nefarious goal. The level of disruption that this could cause is unimaginable. 'As the systems become so powerful, that's a real concern,' OpenAI's CEO said. OpenAI even set up a unit a couple of years ago aimed at putting in safeguards to stop superintelligent AI system from going rogue.
Scenario 3 — 'Where the models kind of accidentally take over the world'
Yes, Altman actually said that, adding that he fears it could happen almost without us realizing.
The Open AI boss said it was 'quite scary' to think that AI systems could become 'so ingrained in society … [that we] can't really understand what they're doing, but we do kind of have to rely on them. And even without a drop of malevolence from anyone, society can just veer in a sort of strange direction.'
He even suggested that there might come a time where AI becomes so smart that a future U.S. president could let it run the country, saying: '[It would mean] that society has collectively transitioned a significant part of decision making to this very powerful system that's learning from us, improving with us, evolving with us, but in ways we don't totally understand.'
Speaking about AI more broadly, Altman said that while a lot of experts claim to be able to predict the future impact of the technology, he believes it's 'very hard to predict' because it's 'too complex of a system, this is too new and impactful of a technology.'
Of course, there's no guarantee that any of these scenarios will come to pass, and it's good that someone in Altman's position is speaking so honestly about the technology. But what is clear is that there are lot of unknown unknowns when it comes to AI, and it's that which is making some people more than a little nervous. Sleep well.
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles


Boston Globe
21 minutes ago
- Boston Globe
40 percent of workers see wage growth lagging inflation, study finds
Get Starting Point A guide through the most important stories of the morning, delivered Monday through Friday. Enter Email Sign Up AVIATION Advertisement AI air fare pricing is a 'bait-and-switch' says American Airlines CEO American Airlines Group Inc.'s top executive blasted the use of artificial intelligence in setting air fares, calling the practice inappropriate because it could trick travelers. 'Consumers need to know that they can trust American,' chief executive Robert Isom said on a call with analysts after the company reported earnings. 'This is not about bait-and-switch. This is not about tricking.' Isom's criticism of the practice echoes several members of the Congress, who are pushing for answers from Delta Air Lines Inc. on its plans to use AI to help set pricing on as much as 20 percent of its network by the end of this year. Delta said this month that it's still in the testing phase that involves about 3 percent of the network today. Delta says it's testing AI to eliminate manual processes and accelerate analysis for dynamic pricing, a strategy long used by airlines and others to raise or lower fares based on demand, timing, and other factors. It is not using the technology to target customers using personal data, and all customers see the same fares in all retail channels, the carrier said in a statement. 'There is no fare product Delta has ever used, is testing or plans to use that targets customers with individualized offers based on personal information or otherwise,' according to the statement from the airline. 'A variety of market forces drive the dynamic pricing model that's been used in the global industry for decades, with new tech simply streamlining this process.' American is using AI to improve airline operations and recovery from service interruptions and to make it easier for consumers to work with the carrier, Isom said. Employing it in pricing decisions 'is not something we will do,' he said, adding that 'some of the things I've heard are just not good.' — BLOOMBERG NEWS Advertisement MARKETS Advertisement Even as stocks set record, JP Morgan is bullish there are better days to come. The S&P 500 Index's record-setting spree may be stoking concerns about inflated share prices and a revival of meme-stock froth, but JPMorgan Chase & Co.'s trading desk isn't concerned. Rather, it expects the furious rally in US equities to keep going. 'While bullishness is not yet consensus, client conversations reveal that even those that skewed bearish are throwing in the towel,' the bank's head of global market intelligence Andrew Tyler said Thursday in a note ahead of the market open. Recent progress in trade deals, positive economic data, and rekindling mergers and acquisitions activity should keep powering the stock market, according to Tyler. From a technical standpoint, the rally is also being supported by the combination of the momentum unwind and meme mania making it difficult for traders to hold short positions. The market could even 'take a significant step higher' if macroeconomic data holds up and the impending trade deal between the United States and Europe is sealed with China following closely behind, Tyler said. — BLOOMBERG NEWS AUTOMOTIVE Tesla profits slip again amid ongoing slump in EV sales Tesla on Wednesday reported a slump in profit, the third quarterly decline in a row, as the company cut car prices in an attempt to revive sales. The company made $1.2 billion from April to June, down from $1.4 billion a year earlier. Sales fell to $22.5 billion from $25.5 billion in the second quarter of 2024. Tesla has not reported an increase in quarterly profit since the third quarter of 2024. Tesla's weak earnings are likely to reinforce concern among some investors that CEO Elon Musk is neglecting the car business while he focuses the company's resources on autonomous driving software, self-driving taxis, and humanoid robots. Musk has said those technologies will make Tesla the most valuable company in the world. Tesla has begun testing a limited self-driving taxi service in Austin, Texas, and said Wednesday it would expand the service 'rapidly.' Wall Street has largely bought into that vision, and the company's share price is up about 50 percent since early April. But such taxis and robots are not yet generating significant revenue for Tesla, and the company remains reliant on the car business to finance Musk's futuristic plans. — NEW YORK TIMES Advertisement BIG TECH Alphabet earnings surge on growth in AI Whether Google will be a winner in the race for dominance in artificial intelligence won't be clear for at least a year or two. In the meantime, its bottom line is doing just fine. Alphabet, Google's parent company, reported second-quarter results Wednesday afternoon that were better than expected. Revenue rose 14 percent from a year earlier to $96.4 billion, while earnings per share jumped 22 percent to $2.31. Analysts had expected revenue of $93.98 billion and earnings per share of $2.20. 'We are leading at the frontier of AI,' said Sundar Pichai, the company's chief executive. Pichai, who mentioned AI more than a dozen times in his commentary on the quarter, added, 'AI is positively impacting every part of the business.' Investors appeared underwhelmed by the quarterly results. Alphabet shares rose less than 2 percent on the news. One apparent problem: Capital expenditures for the year will be $10 billion higher than the company had projected, it said, because of its booming cloud storage business. Even for Google, the new estimate of $85 billion is real money. A few years ago, Google was spending about a quarter of that sum. Investors want the company to pour enough into new data centers to have competitive cloud and AI businesses but not so much that it affects lush profit margins. That's a difficult balancing act. — NEW YORK TIMES Advertisement


Bloomberg
22 minutes ago
- Bloomberg
Trump Takes Powell Rift to Fed's Headquarters
"Balance of Power: Late Edition" focuses on the intersection of politics and global business. On today's show, Wendy Edelberg, Brookings Institution Economic Studies Senior Fellow, shares her thoughts on President Trump and Federal Reserve Chair Jerome Powell touring the Federal Reserve building renovations. Rep. Debbie Wasserman Schultz (D-FL) discusses Congress facing a September 30 budget deadline and whether or not she'd be in favor of Democrats potentially shutting down the government. Rep. Bryan Steil (R-WI) discusses releasing the Epstein files, talks of a second rescissions package, and President Trump's visit to the Federal Reserve building. (Source: Bloomberg)
Yahoo
an hour ago
- Yahoo
Stock market today: Dow, S&P 500, Nasdaq futures trade flat as Trump downplays Powell tensions
US stock futures held steady after President Trump visited the Federal Reserve and Wall Street digested the latest batch of corporate earnings. Futures attached to the Dow Jones Industrial Average (YM=F), the benchmark S&P 500 (ES=F), and the tech-heavy Nasdaq 100 (NQ=F) fluttered up 0.1%. Trump visited the Fed on Thursday afternoon to take a tour of its $2.5 billion renovation project, led by chair Jerome Powell. The president has spent weeks criticizing the project as too expensive, sparking speculation he might use it as a pretext to try to fire Powell for alleged mismanagement. During the tour, however, Trump indicated he wasn't considering firing the Fed chair. "To do that is a big move, and I just don't think it's necessary," he said. The president also downplayed his disagreements with Powell over interest rates, saying he believes the chair will "do the right thing." "I'd love him to lower interest rates," the president reiterated. Intel reported its earnings after the bell Thursday, beating Wall Street expectations on revenue. The company's stock turned negative, however, as CEO Lip-Bu Tan discussed layoffs and the cancelation of some factory plans. In day trading, the S&P 500 scored its fourth consecutive record high in a row as Google (GOOG) earnings boosted optimism about the promises of AI. Wall Street also continued to hope that the Trump administration will strike more trade deals before the president's Aug. 1 deadline, even as the risk of higher-than-expected baseline tariffs grows. Read more: The latest on Trump's tariffs This week, Wall Street has largely shrugged off trade tensions as Big Tech earnings roll in. Next week brings more market-moving results from members of the "Magnificent Seven," including Apple (AAPL), Microsoft (MSFT), Meta (META), and Amazon (AMZN).