Broadcom Chip to Help Power AI by Linking Up Smaller Data Centers
Broadcom Inc. is offering a possible answer, at least for operations located with some proximity. A new version of its Jericho networking chip announced Monday can transfer larger volumes of data at higher speeds. That means customers can link up several smaller data centers to create one big system for developing or running AI models, said Ram Velaga, senior vice president and general manager of the company's core switching group.
The Jericho4 product is capable of connecting more than 1 million processors across multiple data centers and can handle about four times more information than the previous version, Broadcom said.
Broadcom has been benefiting from demand for gear that can be used to build out AI systems. Its networking components, such as routers and switches, direct traffic between graphics processing units, or GPUs, the pricey chips used to create AI models.
While some of the Broadcom gear is used to move data within parts of the same rack or data center building, there is also a need for components that work across buildings or even greater distances. Moreover, the power consumption of giant GPU clusters is getting too large to keep them all in the same location, Velaga said.
'When they try to do a cluster of 200,000 GPUs or even 100,000 GPUs, you soon hit 300 megawatts, and 300 megawatts is not available inside one physical building today,' Velaga said. The Jericho family of networking chips will help that work, he said.
Companies also are trying to move data center capacity nearer to customers, helping speed up the answers users get from AI models. That means cloud and AI businesses will need to make use of data centers located in congested metropolitan areas, where it may be more practical to connect several smaller setups, Velaga said.
Broadcom's Tomahawk line can connect racks inside a data center, but those distances are usually under a kilometer (0.6 miles), Velaga said. The Jericho equipment can handle distances of more than 100 kilometers.
The Jericho4 will start shipping Monday to early customers such as cloud providers and network gear makers, which will build it into their products, Velaga said. It will take about nine months for it to be fully deployed, he said.
More stories like this are available on bloomberg.com
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Economic Times
27 minutes ago
- Economic Times
A second brain with AI
Winning with AI: A fortnightly column on the tips and tricks that will help propel you ahead in the AI race. Tired of too many ads? Remove Ads Tired of too many ads? Remove Ads Tired of too many ads? Remove Ads (Disclaimer: The opinions expressed in this column are that of the writer. The facts and opinions expressed here do not reflect the views of .) Like many of you, I juggle multiple roles and tasks daily. A few years ago, I discovered the PARA method - Projects, Areas, Resources, Archive - developed by Tiago Forte. It helped me bring structure to my notes and reduce the mental 'open tabs' in my even with a solid system, I hit a wall. Information was stored, but not quite working for me. Notes sat quietly in folders. Ideas got changed when I brought AI into the mix. Here's a primer on how you can use an AI supercharged PARA System . You create 4 Macro folders:Each active project will be a micro folder with a clear deadline - like a workshop or client proposal. Feed in notes, emails, and docs into your Ai tool.'Summarise key decisions from the last 3 meeting notes.''Draft an update email based on this week's notes.'This will help you turn passive notes to live are ongoing themse like 'Team Development' without a specific deadline. Each gets a separate micro-folder. You can use AI to review them fortnightly.'What themes are recurring in my one-on-ones?''How can I improve my proposals?This will help you build long term are articles, PDFs, and podcasts useful to you. But without summaries they are tough to navigate. Tools like ChatGPT, GoogleLM, and Notion AI help turn them into usable insights:'Summarise this report in 5 points.''What's the main takeaway from this article'This will help you turn information into actionable many current items in the above categories go into Archives. But they still might be needed someday. AI works like magic here.'Find my old notes on GenAI and change management.'It's like an AI powered time machine!PARA gives structure. AI makes it intelligent. The result? A second brain that helps you lead with less stress and more Singh is the cofounder of two AI ventures, ClayboxAI and Kampd, and has held APAC leadership roles at Google and Twitter previously. For feedback, please email to eteyeonai@
Time of India
an hour ago
- Time of India
Broadcom launches Jericho chip to advance AI data center networks
Academy Empower your mind, elevate your skills Broadcom's silicon division launched its next-generation Jericho networking chip on Monday, which is designed to connect data centers over 60 miles (96.5 km) apart and speed artificial intelligence computation The company's Jericho4 introduces and improves several features that increase the amount of networking traffic speeding across large networks that operate inside and between data and deploying artificial intelligence has become more computationally intensive and requires stringing together thousands of graphics processors (GPUs). Cloud computing companies such as Microsoft and Amazon require faster, more sophisticated networking chips to ensure data moves when transferring data beyond the physical walls of a data center is crucial for cloud companies because of the potential attacks that could intercept it ahead of reaching its engineers designed the Jericho chips to be deployed at a massive scale, and a single system can encompass roughly 4,500 chips, according to Ram Velaga, senior vice president and general manager of Broadcom's Core Switching help mitigate issues around network congestion, the Jericho4 chips use the same high-bandwidth memory (HBM) designers such as Nvidia and AMD use for their AI processors. It's necessary because of the volume of data that needs to be stuffed into memory at any given moment of operation."The switch is actually holding that traffic (in memory) till the congestion frees up," Velaga said. "It means you need to have a lot of memory on the chip."The longer the distance the data must travel from the chip to its destination, the more memory designers must include in the chip as addition to performance improvements, the Jericho4 also beefs up security by encrypting opted to use TSMC's three nanometer process for the Jericho4.
Time of India
an hour ago
- Time of India
Karnataka bus strike begins: Employees defy HC order as talks fail; thousands stranded across state
NEW DELHI: Public transport across Karnataka came to a grinding halt on Tuesday morning as employees of the state's road transport corporations launched an indefinite strike, leaving thousands of commuters stranded. The protest, sparked by long-pending demands for wage revision and salary arrears, continued despite an interim stay issued by the Karnataka high court. Passengers were left scrambling for alternatives, with bus services either suspended or severely limited in cities like Bengaluru, Mysuru, Hubballi, Dharwad, Kalaburagi, Raichur, Shivamogga, and Chikkamagaluru. Visuals from major bus stands show long queues and overcrowded platforms, while in districts like Gadag, not a single NWKRTC bus operated out of the daily fleet of over 500. You Can Also Check: Bengaluru AQI | Weather in Bengaluru | Bank Holidays in Bengaluru | Public Holidays in Bengaluru — ANI (@ANI) Private operators and cab aggregators saw a spike in demand, with many passengers alleging overcharging by autorickshaws in Bengaluru and other cities. Commuters also criticized the state government for not addressing the issue sooner, even as disruption intensified. The strike follows the breakdown of negotiations between the Joint Action Committee of trade unions and the government. Employees are demanding clearance of 38 months' salary arrears and a wage revision effective from January 1, 2024. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Is AI the secret to mastering a new language faster than ever? See why experts are buzzing. Talkpal AI Undo The government, however, has offered to settle only 14 months of dues, citing a one-man committee's recommendation. Despite the HC's interim order on Monday urging unions to defer the strike and avoid disrupting essential public services, the unions proceeded. KSRTC Staff and Workers' Federation president H V Anantha Subbarao said, "We are not satisfied. The strike will begin as planned. We want full 38 months' arrears." The government has warned of disciplinary action. KSRTC MD Akram Pasha said circulars enforcing a 'no work, no pay' policy have already been issued and that transport is an essential service under the Karnataka Essential Services Maintenance Act. BMTC MD R Ramachandran added, "Since BMTC provides essential services, employees are urged to not take part in the strike." The high court bench expressed concern over the prolonged delay in wage payments and questioned the state on its handling of the issue. Although the government had held two rounds of talks with union leaders, no breakthrough was reached. With over 1.1 crore people relying on Karnataka's state-run buses daily — including 40 lakh commuters in Bengaluru alone — the impact of the strike was widespread. The government has reportedly prepared contingency measures involving private operators to keep limited services running. The situation remains tense, with uncertainty over how long the strike will last and whether the state will step in with a revised offer or harsher action.
