
How Small Language Models Deliver Big Business Benefits
There seems to be no limit to what artificial intelligence (AI) can help people do. But the tens of billions, even trillions of parameters used to train large language models (LLMs) can be overkill for many business scenarios.
Enter the small language model (SLM). SLMs are trained on relatively small amounts of specific data—fewer than 10 billion parameters or so. Because of their small size and fine-tuning, SLMs require less processing power and lower memory. This means they're faster, use less energy, can run on small devices, and may not require a public cloud connection.
Like LLMs, SLMs can understand natural language prompts and respond with natural language replies. They are built using streamlined versions of the artificial neural networks found in LLMs. But SLMs are trained on focused datasets, making them very efficient at tasks like analyzing customer feedback, generating product descriptions, or handling specialized industry jargon.
'LLMs are like a starship. It's very powerful and can go far, far away, but if you're doing something very tactical and specific, that starship is way too powerful,' says Neil Sahota, CEO of research firm ASCILabs and an AI advisor to the United Nations. 'If speed and costs are concerns, SLMs are the better way to go.'
The sweet spot for SLMs tends to be narrow tasks in high-volume niche applications or in low-power environments, such as on smartphones or Internet of Things (IoT) gadgets. They are also useful when data privacy is crucial, or internet access is sparse. For example:
Field service engineers don't always have high-bandwidth internet access. With an SLM on their device, they could use generative AI to query their field service manual. Low computational requirements and local processing make this possible.
Sales representatives might need to access a generative AI model containing sensitive data at a client site to provide tailored recommendations. An SLM could provide those results without the lag and potential privacy concerns that often come with using a mobile device.
Clinicians could use an SLM to analyze patient data, extract relevant information, and generate diagnoses and treatment options. The fact that data never leaves the device is a huge benefit for privacy.
But don't expect a significant shift from LLMs to SLMs. Organizations are more likely to implement a portfolio of models, each selected to suit a specific scenario.
AI developers, in fact, often work through a pipeline of models. A query might first go to an LLM, then to an SLM for classification, then back to the LLM to extract the information and generate a response.
At larger organizations, an LLM could be used for complex tasks—like developing a long-term business strategy that considers macroeconomic policies and global effects—while multiple SLMs handle dozens of business-unit-specific tasks such as analyzing consumer feedback and social media posts to guide new product development.
And while SLMs may be a cost-effective alternative to LLMs, they still have limitations. They don't understand complex language well, they lose accuracy when doing complex tasks, and they have a narrow scope of knowledge.
There are other trade-offs. While SLMs generally don't cost a lot to run, costs could add up if multiple SLMs are in use. 'If you have five models deployed and they're each using GPUs and occupying space and electricity in the data center, that costs more versus having one huge model,' says Sean Kask, AI chief strategy officer at SAP. 'Sure, the LLM uses a lot of electricity, but it's being used for a lot of different things, and you can refine data for smaller, more specific queries through prompt engineering.'
What's more, SLMs present many of the same challenges as LLMs when it comes to governance and security. 'You still need a risk and regulatory framework,' says Jim Rowan, head of AI at Deloitte Consulting LLP. 'You need an AI policy because you don't want business units using data and AI models without your knowledge. And you still have to set up guardrails because SLMs hallucinate too,' he adds.
SLMs also aren't necessarily easier to manage than LLMs. Even though the big AI players offer versions of SLMs through a service model where they provide the underlying engine, 'you still need people who know what the right data is. You need domain experts and a data scientist who can develop a good training strategy for the model,' Sahota says.
Companies will need to ask important questions before incorporating SLMs into their AI strategy:
What business case are you solving for? If the dataset is very small, controlled, and available, such as HR documents or product descriptions, it makes great sense to use an SLM. 'But if it's a large stack of constantly changing data or there's lots of variability in it, such as current mortgage rates or daily geopolitical events, you probably want to go the LLM route,' Sahota says.
What kind of performance and accuracy are needed? SLMs can be very accurate about straightforward questions, like an inquiry into current benefits. But if an employee says 'I would like to pay a third mortgage; can I draw off my 401(k)?' they may get a more generic answer. An LLM might be better at handling this type of question, as it could include information on HR and tax standards for 401(k) use.
What are your growth needs? Businesses need to anticipate how big the SLM might get over time. 'If you're a retailer and you're going to toss tens of thousands of products into the model over the next few years, that's certainly an LLM,' Sahota says.
As the number and type of available AI models continue to grow, businesses will need to understand the range of what's available to create their AI model portfolio.
'Choice is very important to your strategy,' Kask says. 'Pick the model that's right for you and for your embedded use case.'
This story also appears on SAP.com.
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
24 minutes ago
- Yahoo
Stock market today: Dow, S&P 500, Nasdaq futures climb ahead of week poised to shake markets
US stock futures made gains as Wall Street prepared for fresh earnings and economic data amid a blockbuster week poised to shake markets. Futures attached to the Dow Jones Industrial Average (YM=F) gained 0.1%. Futures attached to the benchmark S&P 500 (ES=F) and the tech-heavy Nasdaq 100 (NQ=F) ticked up 0.2%. On Monday, the S&P 500 and Nasdaq eked out record highs amid an otherwise subdued trading session as Wall Street digested a new trade deal between the US and EU. Read more: The latest on Trump's tariffs Wall Street heats up Tuesday. Boeing (BA) and Starbucks (SBUX) are set to report earnings with investors eager for signs of turnarounds underway, while Spotify (SPOT) is expected to issue results that feature cautious guidance. Fresh data on job openings from the Labor Department is also set to land, along with a new reading of the Conference Board's consumer-confidence index. Later in the week, investors are bracing for market-moving decisions and results, including the Federal Reserve's next move on interest rates, the July jobs report, and earnings from tech giants Apple (AAPL), Amazon (AMZN), Microsoft (MSFT), and Meta (META). Finally, President Trump's deadline for trading partners to strike deals or else face blanket tariff rates arrives Friday amid a new wave of talks between the US and China. Nvidia orders 300,000 H20 chips from TSMC to satiate Chinese demand Reuters reports: Nvidia placed orders for 300,000 H20 chipsets with contract manufacturer TSMC last week, two sources said, with one of them adding that strong Chinese demand had led the U.S. firm to change its mind about just relying on its existing stockpile. Read more here. Oil maintains gains with tariffs and OPEC+ supply in sight Oil maintained gains following Trump putting pressure on Russia over the war in Ukraine with economic sanctions against Putin's government on the table. Bloomberg reports: Read more here. Nvidia orders 300,000 H20 chips from TSMC to satiate Chinese demand Reuters reports: Nvidia placed orders for 300,000 H20 chipsets with contract manufacturer TSMC last week, two sources said, with one of them adding that strong Chinese demand had led the U.S. firm to change its mind about just relying on its existing stockpile. Read more here. Reuters reports: Nvidia placed orders for 300,000 H20 chipsets with contract manufacturer TSMC last week, two sources said, with one of them adding that strong Chinese demand had led the U.S. firm to change its mind about just relying on its existing stockpile. Read more here. Oil maintains gains with tariffs and OPEC+ supply in sight Oil maintained gains following Trump putting pressure on Russia over the war in Ukraine with economic sanctions against Putin's government on the table. Bloomberg reports: Read more here. Oil maintained gains following Trump putting pressure on Russia over the war in Ukraine with economic sanctions against Putin's government on the table. Bloomberg reports: Read more here.
Yahoo
24 minutes ago
- Yahoo
Brewing Innovation: Univers and Starbucks China Redefine Green Retail from Store to Supplier
SINGAPORE, July 29, 2025 /PRNewswire/ -- Univers, the global AI for Energy leader, and Starbucks China have unveiled a technological partnership to accelerate sustainability across Starbucks' China value chain. Through the deployment of Univers' advanced AI and Internet of Things (IoT) decarbonization solutions, the collaboration will enable Starbucks to digitally monitor, measure and actively reduce Scope 3 emissions across its supplier network. This visibility will allow Starbucks to drive actionable emissions reductions, support its suppliers in their own low-carbon transitions, and strengthen compliance with evolving climate regulations. Greener Store Starbucks is not only making their stores greener, but also more intelligent. More than 7,500 Starbucks stores are now connected to a new AI and IoT platform jointly developed by Univers and Starbucks. This will enable real-time and remote monitoring of over 8 types of equipment per store including HVAC, lighting, and water filtration, optimizing energy use with AI-driven insights and enhancing partner and customer experience. Greener Supply Chain Leveraging Univers' EnOSTM Ark Carbon Management System, Univers and Starbucks will develop a Supply Chain Carbon Management Platform used to track carbon emissions across core suppliers and products—including but not limited to milk, beverages, food, and packaging. Milk, the single largest carbon emitter in Starbucks value chain, is a major contributor to Scope 3 emissions. As a response, the companies developed a Sustainable Dairy Digital Management Tool to enable comprehensive carbon baseline tracking, decarbonization planning, and implementation of pilot farm solutions. Future-Proofing Starbucks With Univers' global innovative R&D capabilities in AI and IoT, Starbucks can now meet its future business expansion needs with the next-generation edge computing intelligent device One-Box, which integrates computing power and hardware management across five local application scenarios from point-of-sale systems to smart store control terminals. By embedding Univers' EnOSTM Ark Carbon Management platform into its broader sustainability strategy, Starbucks is taking a major step toward future proofing its energy transition journey – combining technology, data and cross-sector collaboration to set new standards for decarbonization in the food and beverage retail industry. About Univers Univers is a global leader in AI for Energy. Our EnOSTM platform enables enterprises to solve complex energy challenges through intelligent, data-driven insights. With 365 million connected devices and 845 GW of renewable energy managed, Univers is an AI-native company delivering end-to-end energy management solutions that support organizations across every stage of their energy transition journey For more information, please visit View original content: SOURCE Univers Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
24 minutes ago
- Yahoo
Highest Dividend Strategy: What Makes Horizon Technology Finance Corporation (HRZN) Stand Out
Horizon Technology Finance Corporation (NASDAQ:HRZN) is included among the 10 Stocks with Highest Dividend to Buy Right Now. A financial adviser looking over a portfolio of securities and stocks. Horizon Technology Finance Corporation (NASDAQ:HRZN) is a specialty finance firm that provides loans and makes investments in early-stage companies operating in sectors like technology, life sciences, healthcare information and services, and clean technology — collectively known as its Target Industries. In the first quarter of 2025, Horizon Technology Finance Corporation (NASDAQ:HRZN) reported net investment income of $0.27 per share, reflecting its ongoing commitment to sustaining shareholder distributions. Despite facing broader economic headwinds, it expanded its debt portfolio by $20 million during the quarter. Horizon Technology Finance Corporation (NASDAQ:HRZN) also boosted its committed and approved investment pipeline to $236 million, laying a solid foundation for continued portfolio growth. CFO Dan Trolio highlighted the company's strong financial position, noting $126 million in available liquidity, including $77 million in cash and $49 million accessible through credit lines. The company maintained a debt-to-equity ratio of 1.54:1, with net leverage at 1.29:1. Horizon Technology Finance Corporation (NASDAQ:HRZN) is among the best stocks with the highest dividend, maintaining its payouts for 16 consecutive years. The company currently offers a monthly dividend of $0.11 per share for a dividend yield of 15.94%, as of July 27. While we acknowledge the potential of HRZN as an investment, we believe certain AI stocks offer greater upside potential and carry less downside risk. If you're looking for an extremely undervalued AI stock that also stands to benefit significantly from Trump-era tariffs and the onshoring trend, see our free report on the best short-term AI stock. READ NEXT: and . Disclosure: None.