Small Language Models, Big Possibilities: The Future Of AI At The Edge
The AI landscape is taking a dramatic turn, as small language and multimodal models are approaching the capabilities of larger, cloud-based systems.
This acceleration reflects a broader shift toward on-device intelligence. As the industry races toward AI that is local, fast, secure and power-efficient, the future is increasingly unfolding on the smallest, most resource-constrained devices at the very edge of the network.
From wearables and smart speakers to industrial sensors and in-vehicle systems, the demand is growing for language-capable AI that can operate independently of the cloud. As small language models (SLMs) continue to improve, they are poised to play a key role in making language AI more accessible across a wide range of embedded applications.
The New Edge Imperative
Device makers are pushing to reduce latency, strengthen privacy, lower operational costs and design more sustainable products. All of these point to a shift away from cloud-reliant AI toward local processing.
However, delivering meaningful AI performance in devices with tight power and memory budgets isn't easy. Traditional approaches fall short, and hardware like the $95,000 "desktop supercomputer," capable of running full large language models (LLMs) offline, while impressive, is cost- and energy-prohibitive for mass deployment.
By contrast, SLMs running on ultra-efficient processors offer a practical and sustainable path forward. Breakthroughs like Microsoft's Phi, Google's Gemini Nano and open models like Mistral and Metalama are closing the performance gap rapidly. Some models—like Google's Gemma 3 and TinyLlama—are achieving remarkable results with only around one billion parameters, enabling summarization, translation and command interpretation directly on-device.
Optimizations such as pruning, quantization and distillation further shrink their size and energy draw. These models are already running on consumer-grade chipsets, proving that lean, localized intelligence is ready for prime time.
Bridging The Gap In Edge AI Deployment
As someone working closely with global chipmakers and system designers, I see this trend as a strategic inflection point. The industry is shifting toward AI that is leaner, faster and embedded where decisions happen—where milliseconds matter, and where compute resources are tightly bound.
As I attend events like Embedded World 2025, it has become clear that the appetite for intelligent edge solutions is growing faster than the infrastructure needed to support them. Device manufacturers want to bring AI to the edge—but face a fragmented ecosystem of silicon platforms, development tools and AI frameworks.
Recent research shows that edge AI adoption is rapidly growing across industries. The global edge AI in smart devices market is forecast to exceed $385 billion by 2034, according to Market.Us research.
The challenge is how to bridge the gap between today's state-of-the-art models and tomorrow's real-world deployment requirements. This means ensuring models not only fit into the tight power and memory budgets of edge devices—but that they can be deployed easily, updated efficiently and scaled cost-effectively.
Many device manufacturers are also struggling to bridge the 'last mile' of inference: ensuring models not only run locally but can be maintained, updated and scaled cost-effectively.
Building Blocks For The Smart Edge
To solve these challenges, organizations across the tech ecosystem—from global chipmakers and tool vendors to consumer device manufacturers—are coalescing around a shared vision: The smarter future of AI lies at the edge.
This shift is fueled by increasing demands for real-time responsiveness, privacy-preserving data handling, lower latency and more sustainable compute alternatives—particularly in scenarios like wearables, automotive systems and industrial IoT.
Recent surveys show that a majority of enterprises are either deploying edge AI or planning to do so imminently, reflecting how on-device inference has shifted from experimental to strategic realms.
This momentum is supported by advancements across multiple fronts: edge-ready NPUs and accelerators embedded into devices, lightweight model formats like TensorFlow Lite and ONNX Runtime and hybrid cloud—edge architectures that offer flexibility and scale.
As AI capabilities become leaner and more optimized, the value of real-time, intelligent inference at the device level is accelerating not just across verticals like automotive, consumer electronics and industrial systems, but as a foundational requirement for the next generation of smart, energy-efficient connectivity and interaction.
The Real-World Challenges Of Deploying SLMs At The Edge
Despite the excitement, several hurdles still need to be addressed before SLMs at the edge can reach mainstream adoption:
• Model Compatibility And Scaling: Not all models can be easily pruned or quantized for edge deployment. Choosing the right architecture—and understanding trade-offs between size, latency and accuracy—is critical.
• Ecosystem Fragmentation: Many edge hardware platforms are siloed with proprietary software development kits (SDKs). This lack of standardization increases complexity for developers and slows adoption.
• Security And Update Infrastructure: Deploying and managing models on edge devices over time—e.g., via over-the-air (OTA) updates—requires robust, secure infrastructure.
Democratizing Intelligence—And Sustainability—One Device At A Time
Perhaps the most exciting outcome of the SLM revolution is that it levels the playing field. By removing the infrastructure barriers traditionally associated with AI, it allows startups, original equipment manufacturers (OEMs) and makers to embed meaningful intelligence in nearly any device.
With tens of billions of connected devices already in use—spanning everything from thermostats to factory robots—the opportunity is vast. And local inference is more than just responsive—it's dramatically more energy efficient than cloud-based alternatives, supporting greener AI deployment strategies.
AI doesn't need to be massive to be meaningful. Sometimes the most powerful intelligence is also the most efficient.
As SLMs continue to evolve and hardware support becomes more ubiquitous, the smart edge will move from possibility to default. In the process, we'll unlock new classes of real-time, personalized and sustainable AI experiences—delivered not from distant data centers, but from the device in your hand, pocket or factory floor.
Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
26 minutes ago
- Yahoo
WTW Q2 2025 net income soars to $332m
WTW has reported net income of $332m for the second quarter of 2025, up by 134% compared to $142m in the same period last year. Adjusted net income also rose by 15% to $285m from $247m in the previous year's quarter. The insurer's diluted earnings per share reached $3.32, a 144% increase from the prior year. Despite this, revenue for the quarter remained steady at $2.26bn, a slight decrease from $2.27bn in the previous year, influenced by the sale of TRANZACT. The risk and broking segment saw a 7% revenue increase, totalling $1.05bn, up from $979m the year before. This growth was attributed to increased new business activity and strong client retention globally. In contrast, the insurance consulting and technology segment's revenue remained unchanged as clients were cautious with their spending due to ongoing economic uncertainties. The health, wealth and career segment reported a 6% decline in revenue to $1.18bn, down from $1.26bn in the prior year, also due to the TRANZACT sale. However, the health division achieved organic revenue growth, with increases outside North America and stable performance within the region. WTW CEO Carl Hess said: 'Our strong second-quarter results demonstrate the meaningful progress we have made towards advancing our strategy, helping deliver solid topline results, along with margin and earnings growth.' 'Building on our strong first-half performance and continued momentum, we enter the second half of 2025 on track to deliver on our financial framework, including mid-single digit organic revenue growth, operating margin expansion, adjusted earnings per share growth and free-cash-flow margin expansion.' For the first half of 2025 (H1 2025), WTW's net income was $566m, compared to $331m for the same period last year. The company reported half-year revenue of $4.48bn, a 2.7% drop from the $4.6bn recorded in the previous year. WTW has also outlined plans for share repurchases totalling approximately $1.5bn in 2025, contingent on market conditions and potential capital allocation. "WTW Q2 2025 net income soars to $332m " was originally created and published by Life Insurance International, a GlobalData owned brand. The information on this site has been included in good faith for general informational purposes only. It is not intended to amount to advice on which you should rely, and we give no representation, warranty or guarantee, whether express or implied as to its accuracy or completeness. You must obtain professional or specialist advice before taking, or refraining from, any action on the basis of the content on our site. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Android Authority
27 minutes ago
- Android Authority
People aren't happy with the leaked Pixel 10 prices, and for one key reason
🗣️ This is an open thread. We want to hear from you! Share your thoughts in the comments and vote in the poll below — your take might be featured in a future roundup. Google Pixel 10 leaks have been in full force over the last couple of weeks, and one of the latest leaks is one of the most important yet: Pixel 10 pricing. On the surface, the leaked prices look great. In a world where it seems like everything is getting more expensive, the fact that Pixel 10 prices (for the most part) aren't any higher than the Pixel 9 series is a breath of fresh air. The base Pixel 10 has the same $799 starting price as the Pixel 9, and the Pixel 10 Pro starts at the same $999 price that the Pixel 9 Pro had. The Pixel 9 Pro XL starts at a higher $1,199 price compared to the $1,099 Pixel 9 Pro XL, but that's because Google is reportedly killing the 128GB model and making 256GB the starting storage amount. Meanwhile, the Pixel 10 Pro Fold keeps the Pixel 9 Pro Fold's $1,799 price tag. Google Upon first seeing these prices, I was thrilled. However, reading through comments on r/Android, it's apparent that not everyone feels the same way. A lot of folks aren't happy with these Pixel 10 prices, and it's all thanks to how much storage you'll get for your money. For context, the Pixel 10 and Pixel 10 Pro both come with 128GB for the base model, and that's where a lot of the frustration stems from. 'Phones should start with 256GB as the lowest, default storage,' says one person, while someone else writes, 'Absolutely insane that the Pro line starts at 128[GB].' And as another commenter flatly complained, '128GB in 2025, what a joke.' In addition to the starting storage amounts, people are also unhappy with the maximum storage for the base Pixel 10. As one person writes, 'It kind of sucks that the Pixel 10 is limited to 256GB, and if you want 512GB, you have to go for the Pixel 10 Pro, which will be much more expensive.' Are you happy with the leaked Pixel 10 prices? 0 votes Yes, no price increase is always a good thing. NaN % They're fine, but I wish there were better storage options. NaN % No, they're too dang expensive. NaN % Other (let us know in the comments). NaN % While I'm still pleased that prices have stayed the same for another year, it is frustrating that Google continues to be so stingy on storage. The OnePlus 13, Galaxy S25 Plus, and Motorola Razr Plus (2025), for example, all start at $999 with 256GB of storage. I can understand Google's justification for keeping the base Pixel 10 at 128GB, but the Pixel 10 Pro should really have 256GB as the default. The folks on Reddit are pretty clearly unhappy, but I want to know what you think. Are you happy with these leaked Pixel 10 prices? Do you think 128GB is still an OK starting amount in 2025? Would you have preferred 256GB of base storage even if that meant a higher starting price? Wherever your head is at, cast your vote in the poll above and share any further thoughts in the comments below. Follow
Forbes
27 minutes ago
- Forbes
Why Smart Coaches Are Selling Access, Not More Offers
Andrew Dunn has scaled 450+ companies over 10 years and writes about marketing, systems and scaling small businesses into big ones. Let me tell you about the biggest mistake I see coaches and consultants making in 2025. They're building what I call "offer suites"—multiple different products, courses, masterminds and done-for-you services. On the surface, it seems smart. More products equals more revenue streams, right? Not always. The problem with offer suites is that when you improve one product, the others don't benefit. Your course gets better, but your mastermind stays the same. You refine your done-for-you service, but your group coaching remains unchanged. You're essentially running multiple businesses under one roof, each requiring separate marketing, delivery and optimization. I learned this the hard way. After helping drive trackable revenue for clients and building multiple successful companies, I discovered something counterintuitive: The most successful coaches aren't selling more offers—they're selling different levels of access to the same expertise. This proximity-based model is exactly how I scaled my last company. The Proximity-Based Model Here's how it works in practice, with some sample pricing: Start with a newsletter and free community. Beyond simple lead generation, this is how you build your foundation. Share your best insights, case studies and frameworks. Build trust at scale. Offer focused workshops that solve specific problems like video sales letter (VSL) scripts, ad funnels or funnel set-up. These aren't separate products—they're concentrated doses of your expertise. A business coach might turn a $100 VSL workshop into a $30,000 one-on-one client using the same frameworks. This is where the magic happens. Group coaching provides accountability, community and regular access to your expertise. Here's the key: Everyone in group coaching gets access to all the same workshops and content as higher tiers. The difference is the level of access to you, accountability and proximity. This level includes private access to your expertise with maximum accountability and personalized application. Customers get the same workshops and content as group coaching members, but with direct access to you—such as your DMs, private phone number, unlimited Zoom calls. You don't need to deliver different content here; you're just providing the highest level of proximity to your knowledge and experience with a completely tailored experience. Create equity deals and retainer arrangements where you're essentially becoming a strategic advisor. This represents the ultimate proximity—ongoing access to your expertise with aligned incentives. The beauty of this model? Every improvement you make benefits every layer. When you develop a new framework or workshop, it enhances your free content and gets added to group coaching and one-on-one consulting simultaneously. Compare this to traditional offer suites where improving your course doesn't help your mastermind or done-for-you service. A Self-Liquidating Marketing Model But here's the real game-changer: This model enables you to sell without sales calls (if you want to). When you're running weekly pricing models, the "buy now" number is small enough that people are willing to take action through a cart rather than jumping on a sales call. Monthly or annual pricing typically still requires calls. Traditional high-ticket coaching requires endless discovery calls. You may be constantly jumping on video calls, qualifying prospects and delivering sales presentations. It's exhausting and doesn't scale. With the proximity model, your lower tiers serve as natural qualification and trust-building mechanisms. Someone joins your newsletter, attends a workshop, experiences results, then naturally ascends to group coaching. By the time they're ready for private consulting, they already know your methodology works. The "sales call" becomes a strategy session about implementation, not convincing them you can deliver results. This creates what I call a self-liquidating marketing model. Your workshops and group coaching generate immediate revenue while funding the marketing that attracts higher-tier clients. The psychological advantage can be profound. Clients understand they're getting the same valuable knowledge—they're just choosing their level of access and accountability. This eliminates the confusion and decision paralysis that comes with multiple offers. Leveraging Proximity Complexity is often the enemy of scale. The most successful coaches I work with understand that people don't buy products—they buy outcomes. And outcomes come from expertise, not from having more stuff. When you sell proximity to your expertise instead of more offers, you can create a business that scales with your knowledge, not your time. Your expertise could be your most valuable asset. Stop diluting it across multiple offers, and start selling different levels of access to it. That's how to build a coaching business that actually gives you the freedom you may have started your business to achieve. The information provided here is not investment, tax or financial advice. You should consult with a licensed professional for advice concerning your specific situation. Forbes Business Council is the foremost growth and networking organization for business owners and leaders. Do I qualify?
