AI needs to be smaller, reduce energy footprint: Study
Empower your mind, elevate your skills
The potential of artificial intelligence is immense -- but its equally vast energy consumption needs curbing, with asking shorter questions one way to achieve, said a UNESCO study unveiled Tuesday.A combination of shorter queries and using more specific models and could cut AI energy consumption by up to 90% without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in Geneva.OpenAI CEO Sam Altman recently revealed that each request sent to its popular generative AI app ChatGPT consumes on average 0.34 Wh of electricity, which is between 10 and 70 times a Google search.With ChatGPT receiving around a billion requests per day that amounts to 310 GWh annually, equivalent to the annual electricity consumption of three million people in Ethiopia, for example.Moreover, UNESCO calculated that AI energy demand is doubling every 100 days as generative AI tools become embedded in everyday life."The exponential growth in computational power needed to run these models is placing increasing strain on global energy systems, water resources, and critical minerals, raising concerns about environmental sustainability, equitable access, and competition over limited resources," the UNESCO report warned.However, it was able to achieve a nearly 90 percent reduction in electricity usage by reducing the length of its query, or prompt, as well as by using a smaller AI, without a drop in performance.Many AI models like ChatGPT are general-purpose models designed to respond on a wide variety of topics, meaning that it must sift through an immense volume of information to formulate and evaluate responses.The use of smaller, specialised AI models offers major reductions in electricity needed to produce a response.So did cutting the cutting prompts from 300 to 150 words.Being already aware of the energy issue, tech giants all now offer miniature versions with fewer parameters of their respective large language models.For example, Google sells Gemma, Microsoft has Phi-3, and OpenAI has GPT-4o mini. French AI companies have done likewise, for instance, Mistral AI has introduced its model Ministral.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
an hour ago
- Time of India
Mark Zuckerberg now hires top Apple exec for the unit that made OpenAI 'shutdown' for one-full week
It seems Facebook-and Instagram parent Meta CEO Mark Zuckerberg is still not done shopping talent for his new AI superintelligence unit. According to a report in Bloomberg, Apple's head of AI models, Ruoming Pang , is leaving the iPhone maker to work at Meta. This marks the latest high-ranking AI executive that Mark Zuckerberg has poached to be part of his new AI superintelligence unit. With this, the Apple exec joins an array of talent Zuckerberg has poached in recent months, including leaders from Google DeepMind, OpenAI , and Safe Superintelligence. Pang is said to be a key part of Apple's in-house team that trained the AI foundation models that are said to underpin Apple Intelligence and other on-device AI features. Pang is reported to offer expertise in designing small, on-device AI models to Meta. Sources told Bloomberg that Ruoming Pang's departure might be the first of many in Apple's troubled AI unit. Meta's aggressive hiring drive for AI talent Meta Platforms is reported to be racing to secure top AI talent for its newly created Superintelligence Labs to better compete with rivals including OpenAI, Google and Anthropic. The Facebook and Instagram parent's aggressive hiring for its unified AI initiative has intensified the talent war in Silicon Valley. OpenAI Chief Research Officer warning to employees ChatGPT-maker OpenAI recently announced a rare company-wide shutdown to give employees time to recharge after months of grueling 80-hour workweeks. According to a report by Wired, the temporary closure comes as the ChatGPT maker fights to retain top talent amid Meta's aggressive $100 million recruitment offers. Chief Research Officer Mark Chen is said to have warned employees in an internal Slack memo that Meta would likely exploit the shutdown period to pressure OpenAI researchers into making quick decisions. "Meta knows we're taking this week to recharge and will take advantage of it to try and pressure you to make decisions fast and in isolation," Mark Chen wrote, in the memo as seen by Wired. Meta's superintelligence lab has hired Lucas Beyer, Alexander Kolesnikov, Xiaohua Zhai, and Trapit Bansal; a foundational contributor to OpenAI's o1 model. Who replaces Ruoming Pang at Apple With Pang's departure, the AFM team will now reportedly be headed by Zhifeng Chen. In a change from a structure under Pang where most of the engineers reported to him directly, the report said that there will be a new organizational layout that includes multiple managers reporting to Chen, who will then have engineers reporting to them. Apple's overall AI strategy is now run primarily by Craig Federighi, Apple's head of software engineering, and Mike Rockwell, who helped create the Apple Vision Pro headset and now leads engineering for Siri. AI Masterclass for Students. Upskill Young Ones Today!– Join Now
Time of India
2 hours ago
- Time of India
AI needs to be smaller, reduce energy footprint: Study
The potential of artificial intelligence is immense -- but its equally vast energy consumption needs curbing, with asking shorter questions one way to achieve, said a UNESCO study unveiled Tuesday.A combination of shorter queries and using more specific models and could cut AI energy consumption by up to 90% without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in CEO Sam Altman recently revealed that each request sent to its popular generative AI app ChatGPT consumes on average 0.34 Wh of electricity, which is between 10 and 70 times a Google search. With ChatGPT receiving around a billion requests per day that amounts to 310 GWh annually, equivalent to the annual electricity consumption of three million people in Ethiopia, for example. Moreover, UNESCO calculated that AI energy demand is doubling every 100 days as generative AI tools become embedded in everyday life. "The exponential growth in computational power needed to run these models is placing increasing strain on global energy systems, water resources, and critical minerals, raising concerns about environmental sustainability, equitable access, and competition over limited resources," the UNESCO report warned. However, it was able to achieve a nearly 90 percent reduction in electricity usage by reducing the length of its query, or prompt, as well as by using a smaller AI, without a drop in performance. Many AI models like ChatGPT are general-purpose models designed to respond on a wide variety of topics, meaning that it must sift through an immense volume of information to formulate and evaluate responses. The use of smaller, specialised AI models offers major reductions in electricity needed to produce a response. So did cutting the cutting prompts from 300 to 150 words. Being already aware of the energy issue, tech giants all now offer miniature versions with fewer parameters of their respective large language models. For example, Google sells Gemma, Microsoft has Phi-3, and OpenAI has GPT-4o mini. French AI companies have done likewise, for instance, Mistral AI has introduced its model Ministral.
Time of India
2 hours ago
- Time of India
What Microsoft said on shutting down its 25-year-old operations in Pakistan: We follow this ...
Microsoft recently shut down its operations in Pakistan after 25 years. The news of Microsoft closing down its operations in Pakistan was first revealed in a LinkedIn post by Jawwad Rehman, the founding head of Microsoft Pakistan. However, the move is said to be in the offing for sometime as only a liaison office with around five employees remained in Pakistan. Microsoft has now confirmed the complete closure of the company's operations in the country. The Redmond-based company told TechCrunch that it is changing its operational model in Pakistan. The report further added that Microsoft did not have any engineering resources in Pakistan. This is unlike Microsoft's operations in India and other growing markets. The closure comes amid broader company restructuring of Microsoft's operations globally. What Microsoft said on closing operations in Pakistan 'Our customer agreements and service will not be affected by this change,' a Microsoft spokesperson said in an emailed statement. It added that the company will now serve its customers through resellers and 'other closely located Microsoft offices.' the spokesperson added, 'We follow this model successfully in a number of other countries around the world. Our customers remain our top priority and can expect the same high level of service going forward.' by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like 5 Books Warren Buffett Wants You to Read In 2025 Blinkist: Warren Buffett's Reading List Undo The decision will reportedly impact the five Microsoft employees in Pakistan. These employees reportedly sold Azure and Office products in the country What Microsoft Pakistan country head said on the exit In a post titled 'End of an Era… Microsoft Pakistan', the company's first-ever country head in Pakistan Rehman wrote, "Today, I learned that Microsoft is officially closing its operations in Pakistan. The last few remaining employees were formally informed and just like that, an era ends... Exactly 25 years ago, in June 2000, I had the honor of launching and leading Microsoft Pakistan." He added, "Today's news forces reflection. This is more than a corporate exit. It's a sobering signal of the environment our country has created.. one where even global giants like Microsoft find it unsustainable to stay. It also reflects on what was done (or not done) with the strong foundation we left behind by the subsequent team and regional management of Microsoft." He further said that it is time for Pakistan to reflect on what has changed. "We must ask: What changed? What was lost? What happened to the values, leadership, and vision that once made it all possible?" he wrote. "Allah grants honor and opportunity to whom He wills.. and takes it away from those who lose sight of it. But if your work leaves behind impact, integrity & inspiration.. then know that Allah's favor was with you," the post added. AI Masterclass for Students. Upskill Young Ones Today!– Join Now
