AI chip developed for decentralized use without the cloud
The professor of AI processor design at TUM has already had the first prototypes produced by semiconductor manufacturer Global Foundries in Dresden. Unlike conventional chips, the computing and memory units of the AI Pro are located together. This is possible because the chip applies the principle of 'hyperdimensional computing': This means that it recognizes similarities and patterns, but does not require millions of data records to learn.
Instead of being shown countless images of cars, as with the deep learning method used in conventional AI chips, this chip combines various pieces of information, such as the fact that a car has four wheels, usually drives on the road, and can have different shapes. Like the new chip, explains Prof. Amrouch, 'humans also draw inferences and learn through similarities.'
An important advantage of brain-like thinking: it saves energy. For the training of a sample task, the new chip consumed 24 microjoules, while comparable chips required ten to a hundred times more energy — 'a record value,' notes Prof. Amrouch. 'This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special.'
This also sets it apart from all-rounders like the chips from industry giant NVIDIA. 'While NVIDIA has built a platform that relies on cloud data and promises to solve every problem, we have developed an AI chip that enables customized solutions. There is a huge market there.' Read More Democrats and Republicans condemn espionage-driven Chinese hack
Neuromorphic chips: Modelled on the human brain
The one square millimeter chip currently costs 30,000 euros. With around 10 million transistors it is not quite as densely packed or as powerful as NVIDIA chips with 200 billion transistors. But that is not Prof. Amrouch's primary concern. His team specializes in AI chips that perform the processing directly on site instead of having to send the data to the cloud to be processed along with millions of other data sets before being sent back again. This saves time and server computing capacity and reduces the carbon footprint of AI.
The chips are also customized for specific applications. 'That makes them very efficient,' says chip expert Amrouch. For example, they focus on processing heartrate and other vital data collected via smartwatch or navigation data of a drone. Because this personal and sometimes sensitive data remains on board the device, issues with stable internet connections or cybersecurity do not even arise. The chip expert is convinced: 'The future belongs to the people who own the hardware.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Hill
6 minutes ago
- The Hill
Faced with geopolitics and trade war, US companies in China report record-low new investment plans
WASHINGTON (AP) — American companies in China are reporting record-low new investment plans for this year and declining confidence in profits, while uncertainty in U.S.-China relations and President Donald Trump's tariffs have become their top concerns, according to a business survey released Wednesday. The companies are also challenged by China's slowing economy, where weak domestic demand and overcapacity in local industries are eroding profitability for the Americans. 'Businesses in China are less profitable now than they were years ago, but risks, including reputational risk, regulatory risk, and political risk, are increasing,' said Sean Stein, the president of the U.S.-China Business Council, a Washington-based group that represents American companies doing business in China, including major multinationals. The survey, conducted between March and May and drawing from 130 member companies, came after the two countries clashed over tariffs and non-tariff measures, including export controls on critical products such as rare-earth magnets and advanced computer chips. Following high-level talks in Geneva and London, U.S. and Chinese officials agreed to pull back from sky-high tariffs and restrictions on exports, but uncertainty persists as the two sides are yet to hammer out a more permanent trade deal. Kyle Sullivan, vice president of business advisory services at the USCBC, said more than half of the companies in the survey indicated they do not have new investment plans in China 'at all' this year. 'That's a record high,' Sullivan said, noting that it is ''a new development that we have not observed in previous surveys.' Around 40% of companies reported negative effects from U.S. export control measures, with many experiencing lost sales, severed customer relationships, and reputational damage from being unreliable suppliers, according to the survey. Citing national security, the U.S. government has banned exports to China of high-tech products, such as the most advanced chips, which could help boost China's military capabilities. Stein argued that export controls must be very carefully targeted, because businesses from Europe or Japan, or local businesses in China would immediately fill the void left by American companies. Silicon Valley chipmaker Nvidia won approval from the Trump administration to resume sales to China of its advanced H20 chips used to develop artificial intelligence, its CEO Jensen Huang announced on Monday, though the company's most powerful chips remain under U.S. export control rules. While 82% of U.S. companies reported profits in 2024, fewer than half are optimistic about the future in China, reflecting concerns over tariffs, deflation, and policy uncertainty, according to the survey. Also, a record high number of American businesses plan to relocate their business operations outside of China, Sullivan said, as 27% of the members indicated so, up from 19% the year before. In a departure from past surveys, concerns over China's regulatory environment, including risks of intellectual property misuse and lack of market access, didn't make it to the top five concerns this year. That's likely a first, and not for a good reason, Stein said. 'It is not because things got dramatically better on the Chinese side, but the new challenges, often coming from the U.S., are now posing as much of a challenge,' Stein said. Almost all the American companies said they cannot remain globally competitive without their Chinese operations. A survey from the European Union Chamber of Commerce in China in May found that European companies were cutting costs and scaling back investment plans in China as its economy slows and fierce competition drives down prices.
Business Insider
8 minutes ago
- Business Insider
As AI surges, Schneider Electric is teaming up with Nvidia to help data centers manage their energy use. Here's how.
Schneider Electric is a global technology company specializing in energy management for software and services, including data centers and industrial automation. Founded in 1836, the company is headquartered in Paris and operates in more than 100 countries. Some of its customers include Microsoft, Google, and Amazon. Situation analysis The use of artificial intelligence continues to expand worldwide. Pankaj Sharma, the executive vice president of data centers and networks at Schneider Electric, said as a result, more data centers will be built, the demand for energy will increase, and the environmental impact will grow. The International Energy Agency estimates that by 2026, the AI industry will use about 10 times the electricity it consumed in 2023. Along with expanding energy, data centers also face the challenge of incorporating cooling systems that enhance energy efficiency and performance. In December 2024, Schneider Electric announced a partnership with Nvidia to develop tools to help data center operators address their energy and sustainability challenges related to increased AI use. This includes plans for developing AI-focused energy and cooling strategies and AI infrastructure, and consulting support to help data centers reach their sustainability goals. The partnership includes what Sharma calls "data center reference architectures," frameworks outlining the energy requirements and cooling systems needed to support data processing, business networks, data storage, and other technology. It also includes digital plans and real-time insights to help build new, energy-efficient data centers. Sharma said the goal is to help companies improve their digital infrastructure by establishing more sustainable, AI-ready data centers. Key staff and partners Sharma told Business Insider that Schneider Electric collaborated with Nvidia on the project. He said Schneider's technology teams and data center engineers and architects worked closely with Nvidia's technical teams on the latest partnership to develop and test solutions. The executive leadership and business development teams were also involved. AI in action Schneider Electric co-developed a new data-reference center design with Nvidia. This is a plan for building new data centers that support high-density AI clusters of up to 132 kilowatts per data-center server rack. A cluster is a network of servers that power AI, and a server rack is a structure that houses and organizes IT equipment. Sharma said the reference plan works with Nvidia's superchips, which are designed for large-scale AI and high-performance processing. The project is also built to support liquid cooling, a process of using water or a liquid coolant to absorb and remove heat from large-scale computers and processing units. Sharma said the new reference designs build on Schneider Electric's existing products, which help remove heat from data centers. He said the latest designs developed with Nvidia help Schneider Electric's customers organize the development and building of data centers that meet a company's energy and cooling challenges. Sharma added that the plans can be customized for individual companies' requirements for their AI workloads in a more energy-efficient, sustainable way for the future. He said that data centers are already being built using the design created with Nvidia. "The intent of the design is not to build a real-life, end-to-end replica of the design, but instead, to use various aspects of it to inform customers' initiatives, providing inspiration and guidance as needed," Sharma said. Did it work, and how did leaders know? Using virtual modeling and testing, Sharma said that the reference designs developed with Nvidia could help data centers reduce cooling energy usage by about 20%. The plan can also help shorten the time it takes to design and build new data center projects by about 30%, which also saves companies money and enhances sustainability, he added. "It's not just speed, it's cost and sustainability," Sharma said. "All of these pieces put together are an advantage for all our customers." Schneider Electric plans to continue working with Nvidia to develop more reference designs over the next few years, Sharma said. The company is also working to create data center designs and infrastructure that can accommodate even higher levels of energy use, as well as the cooling technology necessary to prevent overheating and manage energy consumption.
CNBC
8 minutes ago
- CNBC
Expect tariff 'cascade' effect across slowing global economy, top UN official warns
The leading arm of the United Nations focused on trade and development, UNCTAD, says President Trump's tariff policies are already creating new costs and disruptions in the global supply chain, and for less developed nations that trade with the U.S., the worst economic fallout hasn't hit yet. "We already see a disruption in the global supply chain," said Rebeca Grynspan, Secretary General of UNCTAD. "Many of the CEOs sit and wait, because if there is no predictability, and what you need for trade and investment is predictability and trust," she added. Earlier this year, UNCTAD released data showing global investment back at financial crisis era levels. The UN arm is also forecasting one-half a percentage point to be shaved off of global growth this year. "We are worried the high level of uncertainty is paralyzing business decisions, which is impacting trade, resulting in trade being revised downward," Grynspan said of the lowered global GDP forecast of 2.3%, down from 2.8%. "This is a lot," she said. "This is already much lower than the growth we experienced in the last decade," she added. U.S. consumer inflation increased in June, a spike attributed to higher prices on consumer goods imported from foreign countries, though the Trump administration says tariffs do not cause inflation. Vietnam, Cambodia, and Malaysia, three Asian countries that benefited from the "China Plus One" supply chain strategy that saw more manufacturing move to these countries, are seeing an impact as supply chains shift again, Grynspan said. Trump has threatened to add a 40% tariff onto any good that uses what is known as transshipment, with a product's journey starting in China but then moving to nations such as Vietnam to avoid Chinese tariffs. The layering of tariffs will cause the most economic pain for the least developed nations globally, according to the UN official, with a combination of existing tariffs and Trump tariff threats resulting in a stacking up of trade taxes that could lead to a reduction in exports of over 50%. "This is a cascade," she said. "It will affect jobs, and it will affect the stability in many countries, where even growth will be lower than the average in the world," Grynspan said. "If you take the least developed countries of the world, 46 countries that are the most vulnerable, we project that their exports could be impacted, as much as 54% down, if the tariffs are put on them," she added. Cambodia's exports to the U.S. represent more than 10% of its GDP, according to the Center for Global Development. Tariffs imposed by the Trump administration could erase over $4.5 billion in Cambodian exports over the next four years, with garments and travel goods suffering the largest blows, according to research firm Datawheel, with increasing risk to Cambodia's economic and social stability. Grynspan said while it is a good sign that the Trump administration wants to negotiate trade agreements, these deals are complex and take time to complete, and the current uncertainty is impacting economic growth and investment. At the same time, another inflationary challenge for the global supply chain has picked up again, with increasing aggression of Houthis towards freight vessels in the Red Sea. Two vessels were attacked in recent weeks, resulting in the sinking of one containership. "These choke points are very important (to trade)," Grynspan said. "When they are disrupted, the whole system suffers." She said the latest attack in the Red Sea raised the war premium in marine insurance by 1% above the value of the ship, or as much as $1 million. Added fuel costs as a result of ocean carriers traversing longer routes to avoid the Red Sea adds to inflationary pressures. She said the Red Sea situation alone could add 0.6% to global prices.
