logo
SambaNova Launches AI Inference Solution For Datacenters

SambaNova Launches AI Inference Solution For Datacenters

SambaNova has announced SambaManaged, the industry's first inference-optimized datacenter product offering, deployable in just 90 days — dramatically faster than the typical 18 to 24 months. Designed for rapid deployment, this modular product enables existing datacenters to immediately stand up AI inference services with minimal infrastructure modification.
As global AI inference demands soar, traditional datacenters grapple with lengthy deployment timelines of 18–24 months, extensive power requirements, and costly facility upgrades. SambaManaged addresses these critical barriers, enabling organizations to quickly launch profitable AI inference services leveraging existing power and network infrastructure.
'Data centers are struggling with power, cooling, and expertise challenges as AI demand grows,' said Abhi Ingle, Chief Product and Strategy Officer at SambaNova. 'SambaManaged delivers high-performance AI with just 10kW of air-cooled power and minimal infrastructure changes—making rapid deployment simple for any data center.'
Key Advantages for Data Centers and Cloud Providers: Unmatched Efficiency: Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership.
Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership. Rapid Deployment: Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value.
Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value. Open Model Flexibility: Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations.
Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations. Modular, Scalable Design: Scale from small to large deployments with ease, including the capability to build a 1 MW 'Token Factory' (100 racks or 1,600 chips) or larger that scales with evolving business needs.
Scale from small to large deployments with ease, including the capability to build a 1 MW 'Token Factory' (100 racks or 1,600 chips) or larger that scales with evolving business needs. Managed or Self-Service Options: Choose a fully managed service or take over operations as internal expertise grows, supported by a customizable developer/enterprise UI and flexible pricing models.
SambaManaged is already being adopted by a major US public company with a large power footprint. The platform will deliver the highest throughput on DeepSeek and similar models, empowering them to maximize inference revenue while optimizing Power Usage Effectiveness (PUE).
'While others talk about the future of AI, we're delivering it — today,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'SambaManaged is a game-changer for organizations that want to accelerate their AI initiatives without compromising on speed, scale, or efficiency. Anywhere you have power and networking, we can bring your AI infrastructure online in record time.'
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Nvidia's Huang says 'doing our best' to serve Chinese market
Nvidia's Huang says 'doing our best' to serve Chinese market

Al Etihad

time8 hours ago

  • Al Etihad

Nvidia's Huang says 'doing our best' to serve Chinese market

16 July 2025 12:43 BEIJING (AFP)Nvidia CEO Jensen Huang said on Wednesday his firm was "doing [its] best" to serve China's vast market for semiconductors after meeting Beijing is in the Chinese capital this week to attend the China International Supply Chain Expo, and said officials had told him the country was "open and stable"."We spoke about... China welcoming foreign companies to invest here and build businesses here, and that China is open and stable," he told reporters at the also said he had told them his firm, which this week became the first to hit $4 trillion in market value, was keen to serve the massive Chinese market for microchips needed in everything from mobile phones to electric vehicles."They want to know that Nvidia continues to invest here, that we are still doing our best to serve the market here," he also addressed the expo's opening ceremony on Wednesday morning, when he hailed China's role in pioneering artificial intelligence."China's open-source AI is a catalyst for global progress, giving every country and industry a chance to join the AI revolution," he said in a reference to Chinese AI startup DeepSeek. "AI is transforming every industry, from scientific research and healthcare to energy, transportation and logistics," he said. Huang praised China's "super-fast" innovation, powered by its "researchers, developers and entrepreneurs".Nvidia announced on Tuesday that it will resume sales of its H20 AI chips to China after Washington pledged to remove licensing restrictions that had halted exports. The California-based company produces some of the world's most advanced developed the H20 specifically for export to China."The US government has assured Nvidia that licences will be granted, and Nvidia hopes to start deliveries soon," the company said in a statement Tuesday, adding it was "filing applications to sell the Nvidia H20 GPU again".The announcement from Nvidia boosted tech firms around the world, with Wall Street's Nasdaq exchange rising to another record foreign ministry in Beijing also hailed Wednesday's expo as a "new calling card for China's high-level opening up to the outside world". "China is willing to continue working with all parties to safeguard the stability and smooth operation of global production and supply chains and promote the building of an open world economic system," spokesman Lin Jian said.

AI giant Nvidia makes history as first $4 tn company
AI giant Nvidia makes history as first $4 tn company

Sharjah 24

time7 days ago

  • Sharjah 24

AI giant Nvidia makes history as first $4 tn company

Shortly after the stock market opened, Nvidia, which is led by electrical engineer Jensen Huang, vaulted as high as $164.42, giving it a valuation above $4 trillion before retreating slightly. "The market has an incredible certainty that AI is the future," said Steve Sosnick of Interactive Brokers. "Nvidia is certainly the company most positioned to benefit from that gold rush." Nvidia has now attained a market value greater than the GDP of France, Britain or India, a testament to investor confidence that AI will spur a new era of robotics and automation, potentially boosting productivity while also challenging incumbent sectors and companies. The California chip company's latest surge is helping to drive a recovery in the broader stock market, even as Nvidia itself outperforms major indices. Part of this is due to relief that President Donald Trump has walked back his most draconian tariffs, which pummeled global markets in early April. Even as Trump has announced new tariff actions in recent days, the S&P 500 and Nasdaq have lingered near records. "You've seen the markets walk us back from a worst-case scenario in terms of tariffs," said Angelo Zino, technology analyst at CFRA Research. While Nvidia still faces US export controls to China as well as broader tariff uncertainty, the company's deal to build AI infrastructure in Saudi Arabia during a Trump state visit in May showed there was also potential upside in Trump's trade policy. "We've seen the administration using Nvidia chips as a bargaining chip," Zino said. Bullish on 2026 Nvidia's latest surge to $4 trillion marks a new threshold in a fairly consistent rise over the last two years as AI enthusiasm has built. In 2025 so far, the company's shares have risen 20 percent, whereas the Nasdaq has gained six percent. The Taiwan-born Huang has wowed investors with a series of advances, including its core product: graphics processing units (GPUs), which are foundational to many of the generative AI programs pursued throughout the technology sector, with applications in autonomous driving, robotics and other cutting-edge domains. The company has also unveiled new advances in recent months, highlighting its Blackwell system, which Huang said in March will soon enable virtually all productions to be "created and brought to life long before it is realized physically." However, Nvidia's winning streak was challenged early in 2025 following revelations about the Chinese DeepSeek venture, which prompted worries that AI investment growth would slow. The company lost some $600 billion in market valuation during this period. Nvidia's Huang has welcomed DeepSeek as a growing presence in technology, while arguing against US export constraints. In the most recent quarter, Nvidia reported earnings of nearly $19 billion despite a $4.5 billion hit from US export controls designed to limit sales of cutting-edge technology to China. The first-quarter earnings period also revealed that momentum for AI remained strong throughout the tech industry. Many of the biggest technology companies -- Microsoft, Google, Amazon and Meta -- are racing each other in the multi-billion-dollar race to win the AI race. A recent UBS survey of technology executives showed Nvidia widening its lead over rivals. Zino said Nvidia's latest surge reflected a fuller understanding of DeepSeek, which has acted as a stimulant to investment for complex reasoning models rather than a threat to Nvidia's business. Nvidia is at the forefront of "AI agents," the current focus in generative AI in which machines are able to reason and infer more than in the past, he said. "Overall the demand landscape has improved for 2026 for these more complex reasoning models," Zino said.

SambaNova launches first Turnkey AI inference solution for data centers, deployable in 90 days
SambaNova launches first Turnkey AI inference solution for data centers, deployable in 90 days

Zawya

time08-07-2025

  • Zawya

SambaNova launches first Turnkey AI inference solution for data centers, deployable in 90 days

PARIS --(BUSINESS WIRE/AETOSWire)-- SambaNova, a leader in next-generation AI infrastructure, today announced SambaManaged, the industry's first inference-optimized data center product offering, deployable in just 90 days — dramatically faster than the typical 18 to 24 months. Designed for rapid deployment, this modular product enables existing data centers to immediately stand up AI inference services with minimal infrastructure modification. As global AI inference demands soar, traditional data centers grapple with lengthy deployment timelines of 18–24 months, extensive power requirements, and costly facility upgrades. SambaManaged addresses these critical barriers, enabling organizations to quickly launch profitable AI inference services leveraging existing power and network infrastructure. 'Data centers are struggling with power, cooling, and expertise challenges as AI demand grows,' said Abhi Ingle, Chief Product and Strategy Officer at SambaNova. 'SambaManaged delivers high-performance AI with just 10kW of air-cooled power and minimal infrastructure changes — making rapid deployment simple for any data center.' Key Advantages for Data Centers and Cloud Providers: Unmatched Efficiency: Sets a new industry benchmark for performance per watt, maximizing return on investment and reducing total cost of ownership. Rapid Deployment: Launch a fully managed AI inference service in as little as 90 days, minimizing integration challenges and accelerating time to value. Open Model Flexibility: Achieve lightning-fast inference with leading open-source models, ensuring no vendor lock-in and future-proof operations. Modular, Scalable Design: Scale from small to large deployments with ease, including the capability to build a 1 MW 'Token Factory' (100 racks or 1,600 chips) or larger that scales with evolving business needs. Managed or Self-Service Options: Choose a fully managed service or take over operations as internal expertise grows, supported by a customizable developer/enterprise UI and flexible pricing models. SambaManaged is already being adopted by a major US public company with a large power footprint. The platform will deliver the highest throughput on DeepSeek and similar models, empowering them to maximize inference revenue while optimizing Power Usage Effectiveness (PUE). 'While others talk about the future of AI, we're delivering it — today,' said Rodrigo Liang, CEO and co-founder of SambaNova. 'SambaManaged is a game-changer for organizations that want to accelerate their AI initiatives without compromising on speed, scale, or efficiency. Anywhere you have power and networking, we can bring your AI infrastructure online in record time.' About SambaNova SambaNova enables enterprises to rapidly deploy state-of-the-art generative AI capabilities. Headquartered in Palo Alto, California, SambaNova was founded in 2017 by industry veterans from Sun/Oracle and Stanford University. The company is backed by top-tier investors including SoftBank Vision Fund 2, BlackRock, Intel Capital, GV, Walden International, Temasek, GIC, Redline Capital, Atlantic Bridge Ventures, and Celesta.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store