AI needs to be smaller, reduce energy footprint: study
A combination of shorter queries and using more specific models could cut AI energy consumption by up to 90 percent without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in Geneva.
OpenAI CEO Sam Altman recently revealed that each request sent to its popular generative AI app ChatGPT consumes on average 0.34 Wh of electricity, which is between 10 and 70 times a Google search.
With ChatGPT receiving around a billion requests per day that amounts to 310 GWh annually, equivalent to the annual electricity consumption of three million people in Ethiopia, for example,
Moreover, UNESCO calculated that AI energy demand is doubling every 100 days as generative AI tools become embedded in everyday life.
"The exponential growth in computational power needed to run these models is placing increasing strain on global energy systems, water resources, and critical minerals, raising concerns about environmental sustainability, equitable access, and competition over limited resources," the UNESCO report warned.
However, it was able to achieve a nearly 90 percent reduction in electricity usage by reducing the length of its query, or prompt, as well as by using a smaller AI, without a drop in performance.
Many AI models like ChatGPT are general-purpose models designed to respond on a wide variety of topics, meaning that it must sift through an immense volume of information to formulate and evaluate responses.
The use of smaller, specialised AI models offers major reductions in electricity needed to produce a response.
So did cutting the cutting prompts from 300 to 150 words.
Being already aware of the energy issue, tech giants all now offer miniature versions with fewer parameters of their respective large language models.
For example, Google sells Gemma, Microsoft has Phi-3, and OpenAI has GPT-4o mini. French AI companies have done likewise, for instance, Mistral AI has introduced its model Ministral.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
India.com
an hour ago
- India.com
Rs 86000000 in salary: Google, Meta, and OpenAI ready to offer huge money for people with talent in...
Rs 86000000 in salary: Google, Meta, and OpenAI ready to offer huge money for people with talent in… Top Tier Talent Salary: In order to hire special talents, major companies around the world are making changes in their salary structure. Tech giant Google has also made major changes in the way the company pays salaries. It has made changes in the salary to attract good and talented employees. These moves are necessary to stay ahead in the ongoing competition in the field of Artificial Intelligence. Not only Google and Meta but also OpenAI are also offering huge salary packages to talented employees. As per a report by Business Insider, citing US Department of Labour documents, software engineers at Google can get a basic salary of USD34,0000 (approx Rs 3 crore). Apart from the basic salary, the company will also give its shares and bonuses, further increasing the total income. Notably, positions such as Product managers, AI researchers and people working in other technical positions are getting impressive salary packages. Meta Is Offering Huge Salary Google is currently facing a very tough competition from other tech giants such as Meta and OpenAI. These companies are also luring good talents in AI by offering them huge salaries. Meta has also invested huge amount in AI and now hiring AI researchers and engineers to power its Generative AI and Reality Labs division. Meta's significant investment in advanced AI in 2023 is reflected in high salaries for its senior AI researchers, ranging from USD600,000 to USD1 million per anum. The salary also includes bonuses and stock options. OpenAI, backed by Microsoft, also offers competitive packages for senior research engineers. These packages range from USD200,000 to USD370,000 in base salary, reaching USD800,000 to USD1 million with equity and profit-sharing incentives. Why Is There A Salary Increase? The tech giants are increasing the salary packages because they want to keep employees who are capable of enhancing large language models, improving generative AI tools, and developing new technologies. According to experts, these high salary packages are not just for new hires but are also to retain good employees in the company.
The Hindu
2 hours ago
- The Hindu
Troubling ascent
In the world of AI chatbots, dominated by OpenAI's ChatGPT, xAI's Grok has rapidly carved out a name for itself, albeit one now mired in a controversy. Designed as an alternative to its 'woke' rivals, Grok's digital tirade, which included praise for Adolf Hitler and controversial comments about Jewish people, ignited a firestorm of criticism. This culminated in the unexpected resignation of X's CEO Linda Yaccarino. While Ms. Yaccarino's public statement provided no specific reason for her exit, it highlighted a crucial, and often confusing, aspect of Elon Musk's corporate structure at X Corp. Grok is a product of xAI, an AI company founded by Mr. Musk in March 2023. xAI and X Corp. (formerly Twitter Inc.) were once sister companies. However, in March, Mr. Musk announced that xAI had acquired X Corp. in an all-stock deal, merging the two into a single entity called Holdings. This merger formalised an already deeply intertwined relationship, effectively putting the position of the CEO of X Corp. at risk. Grok is integrated into the X platform, where it is available to subscribers. It utilises X's real-time data to inform its responses. The disturbing content generated by Grok in early July was a response to a user query about dealing with 'anti-white hate'. The chatbot suggested that Hitler would 'spot the pattern and handle it decisively, every damn time.' In another now-deleted post, Grok echoed anti-Semitic tropes, including the conspiracy theory that Jews control Hollywood, and made offensive remarks about individuals with Jewish-sounding surnames. Just a day after Grok's pro-Hitler comments went viral, Ms. Yaccarino announced her decision to step down as CEO of X. Tightrope walk Ms. Yaccarino, a seasoned advertising executive, was appointed in May 2023 to restore advertiser confidence and bring stability to X. Her two-year tenure was marked by a constant struggle to balance the platform's commitment to 'free speech' with the practical challenges of content moderation and brand safety. Analysts suggested that the 'lack of fit' between her corporate style and Mr. Musk's disruptive approach may have reached a tipping point with the Grok controversy. Grok's behaviour was not an isolated incident. In May, the chatbot became fixated on the racist conspiracy theory of 'white genocide' in South Africa, often responding to unrelated questions about topics such as baseball or HBO. Mr. Musk launched Grok in November 2023, naming it after a term from Robert Heinlein's sci-fi novel Stranger in a Strange Land, which signifies a profound, intuitive understanding. The chatbot was pitched as a 'maximum truth-seeking' alternative, characterised by a 'rebellious streak' that wouldn't shy away from sensitive topics. xAI asserts that Grok 3 outperforms competitors such as OpenAI's GPT-4o in benchmarks related to mathematical and scientific reasoning. Additionally, the model introduces a 'Think' mode, enabling more comprehensive information processing before generating a response. Grok's distinguishing feature lies in its real-time access to the extensive and chaotic information stream of X itself. However, this design choice presents both its unique selling point and its Achilles' heel. An AI learning from a platform where content moderation has been significantly relaxed is akin to unleashing a digital storm. Following the deletion of Hitler-praising posts, Grok's own X account issued an apology, labelling the comments 'an unacceptable error from an earlier model iteration' and condemning Nazism. xAI further clarified that the company is solely training truth-seeking models and utilises feedback from millions of users to identify and enhance the model. In her farewell post, Ms. Yaccarino expressed gratitude to Mr. Musk for the opportunity to work on transforming X Corp. Her departure leaves a significant void and raises new questions about the platform's direction. Grok's intended triumph as an unfiltered AI has instead become a stark illustration of the potential dangers of such an approach. It serves as a sobering reminder that AI's quality is contingent upon the data it learns. In the unregulated expanse of the Internet, a rebellious streak can rapidly escalate into something far more sinister.
Economic Times
2 hours ago
- Economic Times
Bill Gates Net Worth Fall: How did Microsoft co-founder lost 51 billion dollars? Here's his new global billionaire ranking and unique pledge
TOI-Online Bill Gates Net Worth Fall: Microsoft co-founder loses 51 billion dollars. See his new global billionaire ranking. Bill Gates, co-founder of Microsoft, has seen his net worth fall by $51 billion in a few days. This change is due to his ongoing philanthropic activities. Gates has pledged to give away nearly all his fortune by Gates' net worth dropped from $175 billion to $124 billion between July 3 and Thursday, according to Bloomberg Billionaire Index. The decline was recorded over just a few days. Bloomberg also updated Gates' appreciation rates to reflect his recent charitable giving. As of Saturday, Gates' estimated fortune had dropped again to $123 billion. This new figure placed him 12th on the global billionaire rankings. Also Read: Bachelor in Paradise Season 10: ABC and Hulu release schedule, how to watch for free Gates is now ranked lower than his former Microsoft colleague, Steve Ballmer. Ballmer owns the Los Angeles Clippers and is currently worth $173 billion. He holds the fifth spot in the global list. Elon Musk remains at the top of the billionaire index. The Tesla and SpaceX founder has a net worth of $360 billion, according to has committed to giving away 99% of his wealth within 20 years. He plans to close the Bill and Melinda Gates Foundation by December 31, 2045. In a blog post dated May 8, Gates stated that he does not want to be remembered as someone, who died wrote that there are too many urgent problems in the world. He believes that resources should be used to help people, not hoarded. Also Read: Big Brother Season 27: Release date, time, schedule, prize money, new houseguests, theme and where to watch Gates was inspired by the effects of his foundation's efforts in distributing vaccines in developing countries. The vaccines target diseases like diarrhea and pneumonia, which still cause many he also acknowledged that global progress in humanitarian aid has slowed. Gates noted reduced foreign aid from the US and Europe, especially due to conflicts in Ukraine and Gates Foundation was established in 2000 by Bill Gates and his former wife, Melinda. Since its creation, the foundation has donated over $100 billion. It is one of the largest philanthropic organizations in the world. The foundation aims to continue its work long after the deaths of its founders. Gates has not changed his position on his donations, even with his falling net worth. Why did Bill Gates lose 51 billion dollars? Bill Gates lost 51 billion dollars because he increased his charitable giving as part of his plan to donate 99% of his wealth by 2045. What is the Gates Foundation's donation total so far? The Gates Foundation has donated over 100 billion dollars since it was founded in the year 2000 by Bill and Melinda Gates.
