Nvidia launches Lepton AI chip marketplace for cloud firms
Nvidia's graphics processors, or GPUs, dominate the market for training AI models and a raft of new cloud players called 'neoclouds' such as CoreWeave and Nebius Group have emerged to specialize in renting out Nvidia's chips to software developers.
The Santa Clara, California-based company announced the new tool called Lepton that lets cloud computing companies sell GPU capacity in one spot.
In addition to CoreWeave and Nebius, other firms joining the Lepton platform are Crusoe, Firmus, Foxconn, GMI Cloud, Lambda, Nscale, SoftBank Corp and Yotta Data Services.
Nvidia cloud vice president Alexis Bjorlin said that despite demand surging for chips at startups and large companies, the process of finding available chips has been 'very manual'.
'It's almost like everyone's calling everyone for what compute capacity is available,' Bjorlin told Reuters in an interview. 'We're just trying to make it seamless, because it enables the ecosystem to grow and develop, and it enables all of the clouds - the global clouds and the new cloud providers - access to Nvidia's entire developer ecosystem.'
Absent so far from Nvidia's Lepton partner list are major cloud providers such as Microsoft, Amazon Web Services or Alphabet's Google. Bjorlin said the system is designed for them to be able to sell their capacity on the marketplace if they choose.
Lepton will eventually allow developers to search for Nvidia chips located in specific countries to meet data storage requirements, Bjorlin said. It will also allow companies that already own some Nvidia chips to more seamlessly search for more to rent.
Nvidia did not disclose what the business model will be for the new software platform or say whether it would charge commissions or fees to either developers or clouds.
However, Bjorlin said developers will 'still retain their own relationship to the underlying compute providers, so they've contracted directly with them.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Star
a minute ago
- The Star
‘It's the most empathetic voice in my life': How AI is transforming the lives of neurodivergent people
-For Cape Town-based filmmaker Kate D'hotman, connecting with movie audiences comes naturally. Far more daunting is speaking with others. 'I've never understood how people [decipher] social cues,' the 40-year-old director of horror films says. D'hotman has autism and attention-deficit hyperactivity disorder (ADHD), which can make relating to others exhausting and a challenge. However, since 2022, D'hotman has been a regular user of ChatGPT, the popular AI-powered chatbot from OpenAI, relying on it to overcome communication barriers at work and in her personal life. 'I know it's a machine,' she says. 'But sometimes, honestly, it's the most empathetic voice in my life.' Neurodivergent people — including those with autism, ADHD, dyslexia and other conditions — can experience the world differently from the neurotypical norm. Talking to a colleague, or even texting a friend, can entail misread signals, a misunderstood tone and unintended impressions. AI-powered chatbots have emerged as an unlikely ally, helping people navigate social encounters with real-time guidance. Although this new technology is not without risks — in particular some worry about over-reliance — many neurodivergent users now see it as a lifeline. How does it work in practice? For D'hotman, ChatGPT acts as an editor, translator and confidant. Before using the technology, she says communicating in neurotypical spaces was difficult. She recalls how she once sent her boss a bulleted list of ways to improve the company, at their request. But what she took to be a straightforward response was received as overly blunt, and even rude. Now, she regularly runs things by ChatGPT, asking the chatbot to consider the tone and context of her conversations. Sometimes she'll instruct it to take on the role of a psychologist or therapist, asking for help to navigate scenarios as sensitive as a misunderstanding with her best friend. She once uploaded months of messages between them, prompting the chatbot to help her see what she might have otherwise missed. Unlike humans, D'hotman says, the chatbot is positive and non-judgmental. That's a feeling other neurodivergent people can relate to. Sarah Rickwood, a senior project manager in the sales training industry, based in Kent, England, has ADHD and autism. Rickwood says she has ideas that run away with her and often loses people in conversations. 'I don't do myself justice,' she says, noting that ChatGPT has 'allowed me to do a lot more with my brain.' With its help, she can put together emails and business cases more clearly. The use of AI-powered tools is surging. A January study conducted by Google and the polling firm Ipsos found that AI usage globally has jumped 48%, with excitement about the technology's practical benefits now exceeding concerns over its potentially adverse February, OpenAI told Reuters that its weekly active users surpassed 400 million, of which at least 2 million are paying business users. But for neurodivergent users, these aren't just tools of convenience and some AI-powered chatbotsare now being created with the neurodivergent community in mind. Michael Daniel, an engineer and entrepreneur based in Newcastle, Australia, told Reuters that it wasn't until his daughter was diagnosed with autism — and he received the same diagnosis himself — that he realised how much he had been masking his own neurodivergent traits. His desire to communicate more clearly with his neurotypical wife and loved ones inspired him to build Neurotranslator, an AI-powered personal assistant, which he credits with helping him fully understand and process interactions, as well as avoid misunderstandings. 'Wow … that's a unique shirt,' he recalls saying about his wife's outfit one day, without realising how his comment might be perceived. She asked him to run the comment through NeuroTranslator, which helped him recognise that, without a positive affirmation, remarks about a person's appearance could come across as criticism. 'The emotional baggage that comes along with those situations would just disappear within minutes,' he says of using the app. Since its launch in September, Daniel says NeuroTranslator has attracted more than 200 paid subscribers. An earlier web version of the app, called Autistic Translator, amassed 500 monthly paid subscribers. As transformative as this technology has become, some warn against becoming too dependent. The ability to get results on demand can be 'very seductive,' says Larissa Suzuki, a London-based computer scientist and visiting NASA researcher who is herself neurodivergent. Overreliance could be harmful if it inhibits neurodivergent users' ability to function without it, or if the technology itself becomes unreliable — as is already the case with many AI search-engine results, according to a recent study from the Columbia Journalism Review.'If AI starts screwing up things and getting things wrong,' Suzuki says, 'people might give up on technology, and on themselves." Baring your soul to an AI chatbot does carry risk, agrees Gianluca Mauro, an AI adviser and co-author of Zero to AI. 'The objective [of AI models like ChatGPT] is to satisfy the user,' he says, raising questions about its willingness to offer critical advice. Unlike therapists, these tools aren't bound by ethical codes or professional guidelines. If AI has the potential to become addictive, Mauro adds, regulation should follow. A recent study by Carnegie Mellon and Microsoft (which is a key investor in OpenAI) suggests that long-term overdependence on generative AI tools can undermine users' critical-thinking skills and leave them ill-equipped to manage without it. 'While AI can improve efficiency,' the researchers wrote, 'it may also reduce critical engagement, particularly in routine or lower-stakes tasks in which users simply rely on AI.' While Dr. Melanie Katzman, a clinical psychologist and expert in human behaviour, recognises the benefits of AI for neurodivergent people, she does see downsides, such as giving patients an excuse not to engage with others. A therapist will push their patient to try different things outside of their comfort zone. "I think it's harder for your AI companion to push you," she says. But for users who have come to rely on this technology, such fears are academic. 'A lot of us just end up kind of retreating from society,' warns D'hotman, who says that she barely left the house in the year following her autism diagnosis, feeling overwhelmed. Were she to give up using ChatGPT, she fears she would return to that traumatic period of isolation. 'As somebody who's struggled with a disability my whole life,' she says, 'I need this.' (Editing by Yasmeen Serhan and Sharon Singleton)
The Star
a minute ago
- The Star
Trump administration issues plan to limit AI exports to China
The White House on Wednesday released proposals to restrict exports of American AI equipment and limit the spread of Chinese AI models as part of a sweeping plan to shape the rules governing the fast-moving technology. The 28-page AI Action Plan marks US President Donald Trump's administration's first comprehensive strategy on the topic and comes as national security hawks have raised concerns that superior American chips may reach China – including through third countries – and advance its AI and military development. Under the plan, the US Commerce Department will lead an effort to develop new export controls on chipmaking components to close 'loopholes' in current restrictions that now focus on major systems. The department will also lead efforts to increase the monitoring of exported US chip end users and to explore using new chip location verification features to keep them out of 'countries of concern' – a term often used to refer to China, Iran, North Korea and Russia, among others. The plan also directs the Defence and Commerce departments to coordinate with allies on adopting US export controls and to prohibit American adversaries from being involved in their defence supply chains. 'Artificial intelligence is a revolutionary technology with the potential to transform the global economy and alter the balance of power in the world,' White House AI tsar David Sacks said in a written statement. 'To win the AI race, the US must lead in innovation, infrastructure, and global partnerships ... This Action Plan provides a road map for doing that,' he added. The Trump administration decision last week to allow American chipmaker Nvidia to sell its H20 chips to China reinvigorated furious debate about how to extend the US technological lead without compromising national security. That came months after the administration revoked a rule put in place under former President Joe Biden that limited how much US AI computing capability certain countries could access through imported US chips. American AI companies face increased competition from such Chinese rivals as Hangzhou-based DeepSeek, which sent global shock waves earlier this year when it released powerful AI models built far more cheaply than many had thought possible. Trump has previously warned of China's potential to surpass the US in the race for AI dominance. Speaking about the White House plan at an AI summit on Wednesday, Trump said he wants to make the US an 'AI export powerhouse' while maintaining 'necessary protections for our national security'. Commerce Secretary Howard Lutnick and Secretary of State Marco Rubio 'will work to rapidly expand American AI exports of all kinds, from chips to software to data storage', he said, before signing executive orders to fast-track AI development and promote exports. Ryan Fedasiuk, a former technology policy advisor in the State Department's Office of China Coordination, said that taken together, the export control proposals 'thread a difficult needle' in the lead-up to US-China trade talks in Stockholm next week. 'They tighten technology controls without risking an existential blow to the provisional trade deal struck in London, and they focus on enforcement gaps rather than adding sweeping new restrictions,' he said. The real impact of the plan will depend 'entirely' on its execution, Fedasiuk added. 'Allied coordination is where the rubber meets the road. Export controls only work if they're multilateral, and we've seen too many cases where US restrictions just pushed business to Dutch or Japanese competitors.' The new administration blueprint also makes several recommendations focused on countering the spread of Chinese models. To ensure 'that free speech flourishes in the era of AI', the Commerce Department is to evaluate advanced Chinese AI models for alignment with Communist Party talking points and censorship practices. Along with the US State Department, Commerce will lead a campaign to 'vigorously advocate' for international AI governance approaches that 'counter Chinese influence' at diplomatic and standard-setting bodies. Too many existing efforts 'have advocated for burdensome regulations, vague 'codes of conduct' that promote cultural agendas that do not align with American values, or have been influenced by Chinese companies attempting to shape standards for facial recognition and surveillance', the plan said. The two departments will also lead a new initiative to share technology protection measures, including measures in basic research and higher education, with allies and partners. To promote the use of American AI technology rather than that of adversaries, the Commerce Department will gather industry proposals for 'full-stack AI export packages' – bundled systems that include AI hardware, software, and related services intended for export. In recent years, the US has pushed its European and Asian allies to stop exports of advanced chipmaking equipment to China. Wednesday's document carries a thinly veiled threat to allies, warning that failure to align with US export controls could trigger punitive trade measures through secondary tariffs. - SOUTH CHINA MORNING POST
The Sun
an hour ago
- The Sun
China proposes global AI cooperation body amid US tech rivalry
SHANGHAI: China said on Saturday it wanted to create an organisation to foster global cooperation on artificial intelligence, positioning itself as an alternative to the U.S. as the two vie for influence over the transformative technology. China wants to help coordinate global efforts to regulate fast-evolving AI technology and share the country's advances, Premier Li Qiang told the annual World Artificial Intelligence Conference in Shanghai. President Donald Trump's administration on Wednesday released an AI blueprint aiming to vastly expand U.S. AI exports to allies in a bid to maintain the American edge over China in the critical technology. Li did not name the United States but appeared to refer to Washington's efforts to stymie China's advances in AI, warning that the technology risked becoming the 'exclusive game' of a few countries and companies. China wants AI to be openly shared and for all countries and companies to have equal rights to use it, Li said, adding that Beijing was willing to share its development experience and products with other countries, particularly the 'Global South'. The Global South refers to developing, emerging or lower-income countries, mostly in the southern hemisphere. How to regulate AI's growing risks was another concern, Li said, adding that bottlenecks included an insufficient supply of AI chips and restrictions on talent exchange. 'Overall global AI governance is still fragmented. Countries have great differences particularly in terms of areas such as regulatory concepts, institutional rules,' he said. 'We should strengthen coordination to form a global AI governance framework that has broad consensus as soon as possible.' SHANGHAI HEADQUARTERS The three-day Shanghai conference brings together industry leaders and policymakers at a time of escalating technological competition between China and the United States - the world's two largest economies - with AI emerging as a key battleground. Washington has imposed export restrictions on advanced technology to China, including the most high-end AI chips made by companies such as Nvidia and chipmaking equipment, citing concerns that the technology could enhance China's military capabilities. Despite these restrictions, China has continued making AI breakthroughs that have drawn close scrutiny from U.S. officials. China's Vice Foreign Minister Ma Zhaoxu told a roundtable of representatives from over 30 countries, including Russia, South Africa, Qatar, South Korea and Germany, that China wanted the organisation to promote pragmatic cooperation in AI and was considering putting its headquarters in Shanghai. The foreign ministry released online an action plan for global AI governance, inviting governments, international organisations, enterprises and research institutions to work together and promote international exchanges including through a cross-border open source community. The government-sponsored AI conference typically attracts major industry players, government officials, researchers and investors. Saturday's speakers included Anne Bouverot, the French president's special envoy for AI, computer scientist Geoffrey Hinton, known as 'the Godfather of AI', and former Google CEO Eric Schmidt. Tesla CEO Elon Musk, who has in past years regularly appeared at the opening ceremony in person or by video, did not speak this year. Besides forums, the conference features exhibitions where companies demonstrate their latest innovations. This year, more than 800 companies are participating, showcasing more than 3,000 high-tech products, 40 large language models, 50 AI-powered devices and 60 intelligent robots, according to organisers. The exhibition features predominantly Chinese companies, including tech giants Huawei and Alibaba and startups such as humanoid robot maker Unitree. Western participants include Tesla, Alphabet and Amazon. - Reuters
