AMD turns to AI startups to inform chip, software design
SAN JOSE (Reuters) -Advanced Micro Devices has forged close ties to a batch of artificial intelligence startups as part of the company's effort to bolster its software and forge superior chip designs.
As AI companies seek alternatives to Nvidia's chips, AMD has begun to expand its plans to build a viable competing line of hardware, acquiring companies such as server maker ZT Systems in its quest to achieve that goal.
But to build a successfulline of chips also requires a powerful set of software to efficiently run the programs built by AI developers. AMD has acquired several small software companies in recent weeks in a bid to boost its talent, and it has been working to beef up its set of software, broadly known as ROCm.
"This will be a very thoughtful, deliberate, multi-generational journey for us," said Vamsi Boppana, senior vice president of AI at AMD.
AMD has committed to improve its ROCm and other software, which is a boon to customers such as AI enterprise startup Cohere, as it results in speedy changes and the addition of new features.
Cohere is focused on building AI models that are tailored for large businesses versus the foundational AI models that companies like OpenAI and others target.
AMD has made important strides in improving its software, Cohere CEO Aidan Gomez said in an interview with Reuters. Changing Cohere's software to run on AMD chips was a process that previously took weeks and now happens in only "days," Gomez said.
Gomez declined to disclose exactly how much of Cohere's software relies on AMD chips but called it a "meaningful segment of our compute base" around the world.
OPENAI INFLUENCE
OpenAI has had significant influence on the design of the forthcoming MI450 series of AI chips, said Forrest Norrod, an executive vice president at AMD.
AMD's MI400 series of chips will be the basis for a new server called "Helios" that the company plans to release next year. Nvidia too has engineered whole servers in part because AI computations require hundreds or thousands of chips strung together.
OpenAI's Sam Altman appeared on stage at AMD's Thursday event in San Jose, and discussed the partnership between the two companies in broad terms.
Norrod said that OpenAI's requests had a big influence on how AMD designed the MI450 series memory architectureand how the hardware can scale up to thousands of chips necessary to build and run AI applications.
The ChatGPT creator also influenced what kinds of mathematical operations the chips are optimized for.
"(OpenAI) has given us a lot of feedback that, I think, heavily informed our design," Norrod said.
(Reporting by Max A. Cherney in San JoseEditing by Shri Navaratnam)
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Star
an hour ago
- The Star
Study: AI needs to be smaller, reduce energy footprint
A combination of shorter queries and using more specific models and could cut AI energy consumption by up to 90% without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in Geneva. — Pixabay PARIS: The potential of artificial intelligence is immense – but its equally vast energy consumption needs curbing, with asking shorter questions one way to achieve, said a UNESCO study unveiled on July 8. A combination of shorter queries and using more specific models and could cut AI energy consumption by up to 90% without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in Geneva. OpenAI CEO Sam Altman recently revealed that each request sent to its popular generative AI app ChatGPT consumes on average 0.34 Wh of electricity, which is between 10 and 70 times a Google search. With ChatGPT receiving around a billion requests per day that amounts to 310 GWh annually, equivalent to the annual electricity consumption of three million people in Ethiopia, for example, Moreover, UNESCO calculated that AI energy demand is doubling every 100 days as generative AI tools become embedded in everyday life. "The exponential growth in computational power needed to run these models is placing increasing strain on global energy systems, water resources, and critical minerals, raising concerns about environmental sustainability, equitable access, and competition over limited resources," the UNESCO report warned. However, it was able to achieve a nearly 90% reduction in electricity usage by reducing the length of its query, or prompt, as well as by using a smaller AI, without a drop in performance. Many AI models like ChatGPT are general-purpose models designed to respond on a wide variety of topics, meaning that it must sift through an immense volume of information to formulate and evaluate responses. The use of smaller, specialised AI models offers major reductions in electricity needed to produce a response. So did cutting the cutting prompts from 300 to 150 words. Being already aware of the energy issue, tech giants all now offer miniature versions with fewer parameters of their respective large language models. For example, Google sells Gemma, Microsoft has Phi-3, and OpenAI has GPT-4o mini. French AI companies have done likewise, for instance, Mistral AI has introduced its model Ministral. – AFP
The Sun
12 hours ago
- The Sun
AI needs to be smaller, reduce energy footprint: study
PARIS: The potential of artificial intelligence is immense -- but its equally vast energy consumption needs curbing, with asking shorter questions one way to achieve, said a UNESCO study unveiled Tuesday. A combination of shorter queries and using more specific models and could cut AI energy consumption by up to 90 percent without sacrificing performance, said UNESCO in a report published to mark the AI for Good global summit in Geneva. OpenAI CEO Sam Altman recently revealed that each request sent to its popular generative AI app ChatGPT consumes on average 0.34 Wh of electricity, which is between 10 and 70 times a Google search. With ChatGPT receiving around a billion requests per day that amounts to 310 GWh annually, equivalent to the annual electricity consumption of three million people in Ethiopia, for example, Moreover, UNESCO calculated that AI energy demand is doubling every 100 days as generative AI tools become embedded in everyday life. 'The exponential growth in computational power needed to run these models is placing increasing strain on global energy systems, water resources, and critical minerals, raising concerns about environmental sustainability, equitable access, and competition over limited resources,' the UNESCO report warned. However, it was able to achieve a nearly 90 percent reduction in electricity usage by reducing the length of its query, or prompt, as well as by using a smaller AI, without a drop in performance. Many AI models like ChatGPT are general-purpose models designed to respond on a wide variety of topics, meaning that it must sift through an immense volume of information to formulate and evaluate responses. The use of smaller, specialised AI models offers major reductions in electricity needed to produce a response. So did cutting the cutting prompts from 300 to 150 words. Being already aware of the energy issue, tech giants all now offer miniature versions with fewer parameters of their respective large language models. For example, Google sells Gemma, Microsoft has Phi-3, and OpenAI has GPT-4o mini. French AI companies have done likewise, for instance, Mistral AI has introduced its model Ministral. – AFP
The Sun
2 days ago
- The Sun
WTO reform crucial for developing nations policy space says PM Anwar
RIO DE JANEIRO: Malaysia has voiced strong support for reforming the World Trade Organisation (WTO) to ensure it remains relevant in tackling emerging global trade issues. Prime Minister Datuk Seri Anwar Ibrahim stressed the need for the WTO to adapt to modern challenges without limiting the policy flexibility of developing nations. Anwar shared these views during a meeting with WTO Director-General Dr Ngozi Okonjo-Iweala in Rio de Janeiro. The discussion focused on the organisation's role in addressing pressing trade concerns, including artificial intelligence, digital commerce, and climate policies. '(This should be done) without restricting the fair policy space of developing countries,' Anwar said. He reiterated Malaysia's commitment to multilateral cooperation, emphasising the WTO must stay inclusive and effective. Both Anwar and Okonjo-Iweala are attending the 17th BRICS Leaders' Summit, where global economic governance and trade reforms are key topics. Okonjo-Iweala, the first woman and African to lead the WTO, has been its Director-General since 2021. Anwar arrived in Brazil on Saturday at the invitation of President Luiz Inácio Lula da Silva. The summit runs from July 6 to 7, bringing together leaders to discuss economic and geopolitical strategies. - Bernama
