Nvidia software aims to create marketplace for AI computing power
Nvidia's graphics processors, or GPUs, dominate the market for training AI models and a raft of new cloud players called "neoclouds" such as CoreWeave and Nebius Group have emerged to specialise in renting out Nvidia's chips to software developers.
The Santa Clara, California-based company announced the new tool called Lepton that lets cloud computing companies sell GPU capacity in one spot.
In addition to CoreWeave and Nebius, other firms joining the Lepton platform are Crusoe, Firmus, Foxconn, GMI Cloud, Lambda, Nscale, SoftBank Corp and Yotta Data Services.
Nvidia cloud vice president Alexis Bjorlin said that despite demand surging for chips at startups and large companies, the process of finding available chips has been "very manual".
"It's almost like everyone's calling everyone for what compute capacity is available," Bjorlin told Reuters in an interview. "We're just trying to make it seamless, because it enables the ecosystem to grow and develop, and it enables all of the clouds - the global clouds and the new cloud providers - access to Nvidia's entire developer ecosystem."
Absent so far from Nvidia's Lepton partner list are major cloud providers such as Microsoft, Amazon Web Services or Alphabet's Google. Bjorlin said the system is designed for them to be able to sell their capacity on the marketplace if they choose.
Lepton will eventually allow developers to search for Nvidia chips located in specific countries to meet data storage requirements, Bjorlin said. It will also allow companies that already own some Nvidia chips to more seamlessly search for more to rent.
"It's a good move for them," said Mario Morales, group vice president at research firm IDC. "Nvidia is close to about 5 million developers. So they want to figure out a way where they can give them (developers) more access to the technology."
Nvidia did not disclose what the business model will be for the new software platform or say whether it would charge commissions or fees to either developers or clouds.
However, Bjorlin said developers will "still retain their own relationship to the underlying compute providers, so they've contracted directly with them."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Sun
an hour ago
- The Sun
Trump administration to supercharge AI sales to allies, loosen environmental rules
The Trump administration released a new artificial intelligence blueprint on Wednesday that aims to loosen environmental rules and vastly expand AI exports to allies, in a bid to maintain the American edge over China in the critical technology. President Donald Trump marked the plan's release with a speech where he laid out the stakes of the technological arms race with China, calling it a fight that will define the 21st century. 'America is the country that started the AI race. And as President of the United States, I'm here today to declare that America is going to win it,' Trump said. The plan, which includes some 90 recommendations, calls for the export of U.S. AI software and hardware abroad as well as a crackdown on state laws deemed too restrictive to let it flourish, a marked departure from predecessor Joe Biden's 'high fence' approach that limited global access to coveted AI chips. 'We also have to have a single federal standard, not 50 different states regulating this industry in the future,' Trump said. Michael Kratsios, head of the Office of Science and Technology Policy, told reporters on Wednesday the departments of Commerce and State will partner with the industry to 'deliver secure full-stack AI export packages, including hardware models, software applications and standards to America's friends and allies around the world.' An expansion in exports of a full suite of AI products could benefit AI chip juggernauts Nvidia and AMD as well as AI model giants Alphabet's Google, Microsoft, OpenAI and Facebook parent Meta. Trump signed three executive orders on Wednesday that incorporated elements of the action plan, including the loosening of environmental rules, establishing rules for chip exports and seeking to limit political bias in AI technology. Biden feared U.S. adversaries like China could harness AI chips produced by companies like Nvidia and AMD to supercharge its military and harm allies. The former president, who left office in January, imposed a raft of restrictions on U.S. exports of AI chips to China and other countries that it feared could divert the semiconductors to America's top global rival. Trump rescinded Biden's executive order aimed at promoting competition, protecting consumers and ensuring AI was not used for misinformation. He also rescinded Biden's so-called AI diffusion rule, which capped the amount of American AI computing capacity some countries were allowed to obtain via U.S. AI chip imports. 'Our edge (in AI) is not something that we can sort of rest on our laurels,' Vice President JD Vance said in a separate appearance at the event, which was organized by White House AI and crypto czar David Sacks and his co-hosts on the 'All-In' podcast. 'If we're regulating ourselves to death and allowing the Chinese to catch up to us, that's not something ... we should blame the Chinese for..., that is something we should blame our own leaders for, for having stupid policies that allow other countries to catch up with America,' Vance said. The AI plan, according to a senior administration official, does not address national security concerns around Nvidia's H20 chip, which powers AI models and was designed to walk right up to the line of prior restrictions on Chinese AI chip access. Trump blocked the export of the H20 to China in April but allowed the company to resume sales earlier this month, sparking rare public criticism from fellow Republicans. FAST-TRACKING DATA CENTERS The plan also calls for fast-tracking the construction of data centers by loosening environmental regulations and utilizing federal land to expedite development of the projects, including any power supplies. The administration will seek to establish new exclusions for data centers under the National Environmental Policy Act and streamline permits under the Clean Water Act. Trump directed his administration in January to develop the plan. Trump is expected to take additional actions in the upcoming weeks that will help Big Tech secure the vast amounts of electricity it needs to power the energy-guzzling data centers needed for the rapid expansion of AI, Reuters previously reported. U.S. power demand is hitting record highs this year after nearly two decades of stagnation as AI and cloud computing data centers balloon in number and size across the country. The export expansion plans take a page from deals unveiled in May that gave the United Arab Emirates expanded access to advanced artificial intelligence chips from the United States after previously facing restrictions over Washington's concerns that China could access the technology. - Reuters
The Sun
an hour ago
- The Sun
Trump administration to supercharge AI sales to allies
The Trump administration released a new artificial intelligence blueprint on Wednesday that aims to loosen environmental rules and vastly expand AI exports to allies, in a bid to maintain the American edge over China in the critical technology. President Donald Trump marked the plan's release with a speech where he laid out the stakes of the technological arms race with China, calling it a fight that will define the 21st century. 'America is the country that started the AI race. And as President of the United States, I'm here today to declare that America is going to win it,' Trump said. The plan, which includes some 90 recommendations, calls for the export of U.S. AI software and hardware abroad as well as a crackdown on state laws deemed too restrictive to let it flourish, a marked departure from predecessor Joe Biden's 'high fence' approach that limited global access to coveted AI chips. 'We also have to have a single federal standard, not 50 different states regulating this industry in the future,' Trump said. Michael Kratsios, head of the Office of Science and Technology Policy, told reporters on Wednesday the departments of Commerce and State will partner with the industry to 'deliver secure full-stack AI export packages, including hardware models, software applications and standards to America's friends and allies around the world.' An expansion in exports of a full suite of AI products could benefit AI chip juggernauts Nvidia and AMD as well as AI model giants Alphabet's Google, Microsoft, OpenAI and Facebook parent Meta. Trump signed three executive orders on Wednesday that incorporated elements of the action plan, including the loosening of environmental rules, establishing rules for chip exports and seeking to limit political bias in AI technology. Biden feared U.S. adversaries like China could harness AI chips produced by companies like Nvidia and AMD to supercharge its military and harm allies. The former president, who left office in January, imposed a raft of restrictions on U.S. exports of AI chips to China and other countries that it feared could divert the semiconductors to America's top global rival. Trump rescinded Biden's executive order aimed at promoting competition, protecting consumers and ensuring AI was not used for misinformation. He also rescinded Biden's so-called AI diffusion rule, which capped the amount of American AI computing capacity some countries were allowed to obtain via U.S. AI chip imports. 'Our edge (in AI) is not something that we can sort of rest on our laurels,' Vice President JD Vance said in a separate appearance at the event, which was organized by White House AI and crypto czar David Sacks and his co-hosts on the 'All-In' podcast. 'If we're regulating ourselves to death and allowing the Chinese to catch up to us, that's not something ... we should blame the Chinese for..., that is something we should blame our own leaders for, for having stupid policies that allow other countries to catch up with America,' Vance said. The AI plan, according to a senior administration official, does not address national security concerns around Nvidia's H20 chip, which powers AI models and was designed to walk right up to the line of prior restrictions on Chinese AI chip access. Trump blocked the export of the H20 to China in April but allowed the company to resume sales earlier this month, sparking rare public criticism from fellow Republicans. FAST-TRACKING DATA CENTERS The plan also calls for fast-tracking the construction of data centers by loosening environmental regulations and utilizing federal land to expedite development of the projects, including any power supplies. The administration will seek to establish new exclusions for data centers under the National Environmental Policy Act and streamline permits under the Clean Water Act. Trump directed his administration in January to develop the plan. Trump is expected to take additional actions in the upcoming weeks that will help Big Tech secure the vast amounts of electricity it needs to power the energy-guzzling data centers needed for the rapid expansion of AI, Reuters previously reported. U.S. power demand is hitting record highs this year after nearly two decades of stagnation as AI and cloud computing data centers balloon in number and size across the country. The export expansion plans take a page from deals unveiled in May that gave the United Arab Emirates expanded access to advanced artificial intelligence chips from the United States after previously facing restrictions over Washington's concerns that China could access the technology. - Reuters
The Star
an hour ago
- The Star
T-Mobile raises forecast for annual subscriber additions
FILE PHOTO: A T-Mobile logo is seen on the storefront door of a store in Manhattan, New York, U.S., April 30, 2018. REUTERS/Shannon Stapleton/File Photo (Reuters) -T-Mobile raised its annual forecast for postpaid net customer additions on Wednesday and added more wireless subscribers than expected in the second quarter, signaling steady demand for the telecom giant's top-tier mobile services. Shares of the Bellevue, Washington-based company rose 3.5% in extended trading. The carrier now expects to add between 6.1 million and 6.4 million subscribers in 2025, compared with its prior projection of 5.5 million to 6 million additions. Telecom operators in the U.S. have boosted their plans with attractive trade-in deals and price guarantees to fend off competition as they grapple for a shrinking pool of new users. T-Mobile's postpaid Experience plans, which bundle streaming services such as Netflix and Apple TV+, come with a five-year price guarantee for customers. Its aggressive promotions and add-on perks have helped the company maintain an edge over rivals and increase its market share. It added 830,000 postpaid phone customers in the second quarter, surpassing FactSet estimates of 700,300 additions. T-Mobile, the last among the big three U.S. telecom carriers to report results, posted second-quarter total revenue of $21.13 billion, beating analysts' estimates of $21.02 billion, according to data compiled by LSEG. Rival AT&T beat quarterly profit estimates on Wednesday and added more wireless subscribers than expected, while Verizon raised the lower end of its annual profit forecast on Monday. (Reporting by Juby Babu in Mexico City; Editing by Devika Syamnath)
