Broadcom launches Jericho chip to advance AI data center networks
The company's Jericho4 introduces and improves several features that increase the amount of networking traffic speeding across large networks that operate inside and between data centers.
Building and deploying artificial intelligence has become more computationally intensive and requires stringing together thousands of graphics processors (GPUs). Cloud computing companies such as Microsoft and Amazon require faster, more sophisticated networking chips to ensure data moves efficiently.
Security when transferring data beyond the physical walls of a data center is crucial for cloud companies because of the potential attacks that could intercept it ahead of reaching its destination.
Broadcom's engineers designed the Jericho chips to be deployed at a massive scale, and a single system can encompass roughly 4,500 chips, according to Ram Velaga, senior vice president and general manager of Broadcom's Core Switching Group.
To help mitigate issues around network congestion, the Jericho4 chips use the same high-bandwidth memory (HBM) designers such as Nvidia and AMD use for their AI processors. It's necessary because of the volume of data that needs to be stuffed into memory at any given moment of operation.
'The switch is actually holding that traffic (in memory) till the congestion frees up,' Velaga said. 'It means you need to have a lot of memory on the chip.'
The longer the distance the data must travel from the chip to its destination, the more memory designers must include in the chip as well.
In addition to performance improvements, the Jericho4 also beefs up security by encrypting data.
Broadcom opted to use TSMC's three nanometer process for the Jericho4.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
15 minutes ago
- Time of India
Amazon will offer OpenAI models to customers for first time
Inc. plans to make OpenAI's new open artificial intelligence models available to customers, the first time the cloud computing giant has offered products from the leading AI models can mimic the human process of reasoning, months after China's DeepSeek gained global attention with its own open AI software. Amazon said it will offer the tools on its Bedrock and Sagemaker platforms, adding that their advanced reasoning capabilities make them suited for AI agents OpenAI announced the new 'open weight' models on Tuesday and said they can carry out complex tasks like writing code and looking up information online on a user's perceptions that Amazon is lagging behind its Big Tech peers in artificial intelligence, Chief Executive Officer Andy Jassy has positioned Amazon Web Services as a kind of supermarket that sells a range of AI tools to businesses. The company's Bedrock software platform was designed to make it easier to access other companies' large language models, as well as Amazon's company has partnered with Anthropic, investing $8 billion in the AI startup and using the relationship to bolster its credentials in AI services. AWS offers Anthropic's Claude models to clients on its AI marketplace. Anthropic plans to release a new version of its most powerful AI model on Tuesday that the company claims is more capable at coding, research and data shares rose 1.5% at 1:22 p.m. in New last week projected weaker-than-expected operating incoming for the current quarter and trailed the sales growth of its main cloud rivals, leaving investors looking for signs that the company's huge investments in AI are paying the second quarter, AWS revenue grew a little more than 17% to $30.9 billion, barely surpassing analysts' average estimate of $30.8 last year named Matt Garman the cloud division's CEO. A longtime AWS engineering leader who was previously sales chief, Garman succeeded Adam Selipsky.
Economic Times
29 minutes ago
- Economic Times
Amazon will offer OpenAI models to customers for first time
Inc. plans to make OpenAI's new open artificial intelligence models available to customers, the first time the cloud computing giant has offered products from the leading AI startup. The models can mimic the human process of reasoning, months after China's DeepSeek gained global attention with its own open AI software. Amazon said it will offer the tools on its Bedrock and Sagemaker platforms, adding that their advanced reasoning capabilities make them suited for AI agents. OpenAI announced the new 'open weight' models on Tuesday and said they can carry out complex tasks like writing code and looking up information online on a user's behalf. Amid perceptions that Amazon is lagging behind its Big Tech peers in artificial intelligence, Chief Executive Officer Andy Jassy has positioned Amazon Web Services as a kind of supermarket that sells a range of AI tools to businesses. The company's Bedrock software platform was designed to make it easier to access other companies' large language models, as well as Amazon's own. The company has partnered with Anthropic, investing $8 billion in the AI startup and using the relationship to bolster its credentials in AI services. AWS offers Anthropic's Claude models to clients on its AI marketplace. Anthropic plans to release a new version of its most powerful AI model on Tuesday that the company claims is more capable at coding, research and data shares rose 1.5% at 1:22 p.m. in New last week projected weaker-than-expected operating incoming for the current quarter and trailed the sales growth of its main cloud rivals, leaving investors looking for signs that the company's huge investments in AI are paying the second quarter, AWS revenue grew a little more than 17% to $30.9 billion, barely surpassing analysts' average estimate of $30.8 last year named Matt Garman the cloud division's CEO. A longtime AWS engineering leader who was previously sales chief, Garman succeeded Adam Selipsky.
Economic Times
an hour ago
- Economic Times
Indian cloud companies to storm local skies with low-cost advantage
Synopsis Indian companies are competing in the cloud market. They offer local data storage and infrastructure. These firms aim to undercut global giants on cost. Airtel, Jio, Tata Communications, and Yotta are key players. They target the public sector and regulated industries. Experts note challenges in technology and migration. Hyperscalers like Microsoft and Amazon are also expanding in India. Agencies Indian corporates are building muscle to challenge bigger global rivals in the fast-growing cloud market, with offerings that store data applications and related infrastructure within the country, referred to as sovereign cloud. These homegrown firms are underlining lower costs as their biggest advantage against the foreign competitors. Bharti Airtel's Xtelify, Reliance's JioCloud for SMEs, Tata Communications' Vayu, and Yotta's Shakti are tailored for local enterprises, especially in public sector and other regulated industries. And they are aiming to take on hyperscalers Microsoft Azure, Amazon Web Services (AWS) and Google Cloud Platform, positioning themselves as affordable and secure alternatives with cost savings of 30%-50% over the global giants. Hyperscalers are large cloud providers offering massive computing resources and infrastructure. However, factors such as limited technology depth, lack of ecosystem maturity, and high migration costs from the global cloud providers are limiting the ambitious growth plans of the Indian companies, say experts. They added that interoperability between cloud providers is almost non-existent, making migration costly and technically complex."The emergence of indigenous cloud platforms represents a market response to India's sovereign cloud policy framework, creating domestic alternatives for regulated sectors," said Jitesh Karlekar, director-research at real estate research and advisory firm JLL. "However, these nascent providers will need to rapidly build technical sophistication, security credentials, and operational scale to effectively compete with established global platforms." According to an IDC study, 15-20% of Indian companies are adopters of some sovereign cloud solution for ensuring compliance and security of their core applications and data. "Sovereign cloud is still in the early stages with little adoption in India," said Rajiv Ranjan, associate director, cloud and AI at research firm IDC India. "A key reason for not migrating to sovereign cloud could be higher costs and the risks associated with migrating applications which might be time consuming and cause business disruptions." He added that enterprises in the banking, financial services and insurance (BFSI) space need to be also fully confident with adequate security and compliance norms being met with the domestic offerings. Meanwhile, hyperscalers have rapidly grown their footprint in India through pacts with mobile phone operators. In 2019, Microsoft signed a 10-year deal with telecom market leader Reliance Jio for co-development of affordable cloud-based solutions, particularly targeted towards SMEs and startups. For its free consumer cloud storage, Jio has netted over 35 million active users. A year later, second-ranked telco Bharti Airtel signed a deal with AWS to develop differentiated Airtel Cloud products. It also tied up with Google Cloud the same year to offer G-Suite services such as Gmail, and Google Docs to to a study by policy body Centre for Internet and Digital Economy, India's $8.3 billion cloud market revenue is dominated by international vendors, with Microsoft (27%) and AWS (15%) together having a 42% share, with all other competitors, including Salesforce and SAP, having shares of less than 5% each. In the pure infrastructure space, Microsoft Azure, AWS and Google Cloud have a combined 87% market share. Bharti Airtel on Monday launched its sovereign cloud, with its vice chairman, Gopal Vittal, stressing that the telco's offering will lead to cost savings of 30-40% over rivals due to its mix of network and cloud the Centre for Internet and Digital Economy study on the competitive landscape in the Indian cloud market showed new entrants are struggling to match the free cloud credits and startup support offered by global global companies provide large sums in cloud credits and access to accelerator programs, giving them a strong edge in customer acquisition, said industry experts. In contrast, local firms often restrict credits to a small circle of existing clients and face difficulty competing for cloud-native startups. However, Indian providers are attracting small and mid-sized businesses by offering 30-70% cost savings and greater billing transparency, areas where hyperscalers fall short due to complex pricing and poor cost visibility, the study showed. The global rivals with technical strength though are better equipped to forecast and manage cloud costs, offering better expense visibility to their clients, compared with their smaller rivals.
