TSMC's next generation of system-on-wafer packaging will make today's CPUs and GPUs look pathetically feeble in comparison
From powering watches to phones, handheld consoles to desktop PCs, office servers to data centers, processors can be found everywhere and in every size possible. That last aspect is set to take a gargantuan leap forward thanks to the world's top chip manufacturer and its next generation of system-on-wafer packing.
As reported by PC Watch, TSMC has recently announced that it has commenced development of a new version of its SoW (System-on-Wafer) packaging technology. The computer you're using to read this on will have a range of different-sized processors inside it. If your device is a top-tier gaming PC with an RTX 5090, then the GPU will be the biggest single chip it has.
On the other hand, if the CPU is a Ryzen 9 9950X3D or a Core Ultra 9 285K, then your PC will also have lots of tiny chiplets, all packaged together to make one 'large' processor. This is essentially what TMSC's new SoW technology is, albeit on a much grander scale.
Rather than just taking three or four small dies and mounting them on a substrate that's around 7,000 square millimetres in area, SoW-X (X for eXtreme) covers an area 10 to 15 times larger. It's so big that an entire 300 mm silicon wafer is required.
TSMC's first generation of SoW packaging involved mounting just the processing dies to the wafer, whereas the new version will be able to include HBM (High Bandwidth Memory) chips, removing the need to have costly and complex interconnects linking the RAM to the processors.
The whole setup makes the system used to manufacture AMD's huge MI300X AI processors look decidedly tiny, and those things are hardly what you'd call small. Each one of those comprises 20 chips and chiplets (four big I/O base chiplets, eight CNDA 3 GPUs, and eight HBM modules)—TMSC's SoW-X could potentially multiply that by a factor of 10.
Naturally, a SoW-X creation isn't something that you can just drop into a socket. For a start, the wafer on which all the chiplets are mounted has to be layered with structures to remove heat, provide electricity, and transfer data to and from the system. Silicon wafers are slim, delicate things, but once packaged in a SoW-X device, they're all hulking, heavy, and massive.
These are going to be used for (no prizes for guessing) the very largest AI data centers, where having as much processing power in the smallest amount of space is crucial to maximising the available area within the center's buildings. SoW-X isn't just about making bigger and better processors, pushing the limits of Moore's Law to extreme lengths.
By keeping as many components as possible on the same substrate, power consumption can be greatly reduced. It's still huge, of course, as TSMC says that SoW-X will be reaching as high as 17,000 W, but it also says the relative performance-per-watt is 65% higher than a traditional data center cluster, where everything is externally connected via PCIe links.
Image 1 of 2
Image 2 of 2
None of this might seem relevant to gaming PCs and other household devices, but the knowledge and experiences that TSMC gains with shipping SoW-X systems to customers will filter down to its 'everyday' packaging technologies.
Phones, desktop CPUs, and graphics cards will all benefit at some point in the future, either because they're already using chiplets or chip-stacking, or they will once process nodes hit the practical limit to the number of transistors one can stuff into a single die. For now, though, TSMC says we won't see SoW-X out in the wild until 2027 and even then, the very high cost of doing it all means that only a select few customers will be able to afford it.
A more important question is what's next after SoW-X? Will the wafers just have to get bigger, or will we see system-on-wafer-on-wafer packaging being developed (I've decided that this should be called SoS, system-on-sandwich) to continue the drive to have ever more processing power?
While transistors might not get much smaller, I think we can safely bet that processors are just going to get a lot bigger.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
25 minutes ago
- Yahoo
Asian shares track Wall Street lower, dollar rangebound
By Stella Qiu SYDNEY (Reuters) -Asian shares slipped along with Wall Street on Wednesday, after weak U.S. data highlighted the damage tariffs were having on economic activity and earnings, while the dollar struggled with the drag from lower bond yields. U.S. services sector activity unexpectedly flatlined in July, data showed on Tuesday. Employment further weakened and input costs climbed by the most in nearly three years, underscoring the impact from President Donald Trump's tariff policy. Second-quarter earnings results also revealed pressure from Trump's tariff wars. Taco Bell parent Yum Brands missed expectations as steep trade duties dent consumer spending, while Caterpillar warned that U.S. tariffs would cost it up to $1.5 billion this year. "It paints a picture of a stagflationary dynamic, which although still far from truly coming to fruition, raises the risk of a toxic mix of rising joblessness and prices as tariffs filter through the U.S. economy," said Kyle Rodda, senior analyst at MSCI's broadest index of Asia-Pacific shares outside Japan slipped 0.2%, while Japan's Nikkei eked out a small 0.2% gain. Both Chinese blue chips and Hong Kong's Hang Seng index were flat. Nasdaq futures fell 0.3% and S&P 500 futures eased 0.1%. Trump on Tuesday said it would announce tariffs on semiconductors and chips in the next week or so, while the U.S. would initially impose a "small tariff" on pharmaceutical imports before increasing it substantially in a year or two. He also said the U.S. was close to a trade deal with China and that he would meet his Chinese counterpart Xi Jinping before the end of the year if an agreement was struck. However, he threatened to further raise tariffs on goods from India over its Russian oil purchases. In currency markets, the dollar consolidated after sliding from two-month highs last Friday on a weak jobs report that had markets price in a near-certain chance of a Federal Reserve interest rate cut in September. The dollar index, which measures the U.S. currency against six counterparts, was flat at 98.821 and was up 0.1% this week after Friday's 1.4% fall. Fed funds futures imply a 94% chance of a rate cut next month, with at least two cuts priced in for this year, according to the CME's FedWatch. Investors are waiting for Trump's pick to fill a coming vacancy on the Federal Reserve's Board of Governors. Trump said the decision will be made soon, while ruling out Treasury Secretary Scott Bessent as a contender to replace current chief Jerome Powell, whose term ends in May 2026. Treasury yields edged up overnight after a $58 billion auction of three-year notes went poorly, but still hovered near multi-month lows. More supply will hit the market this week with $42 billion in 10-year notes on Wednesday and $25 billion in 30-year bonds on Thursday. Two-year Treasury yields rose 1 basis point to 3.7284%, having risen 3.5 bps overnight, while benchmark 10-year yields ticked up 2 bps to 4.2198%, after holding steady overnight. In commodity markets, oil prices edged up after four straight sessions of declines. U.S. crude rose 0.2% to $65.3 per barrel, while Brent was at a one-month low of $67.78 per barrel, up 0.1%. Trump said on Tuesday he will decide on whether to sanction countries who purchase Russian oil after a meeting with Russian officials scheduled for Wednesday. Spot gold prices were flat at $3,381 an ounce. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
25 minutes ago
- Yahoo
Indian shares set to open flat ahead of RBI policy decision
(Reuters) -Indian shares are set to open little changed on Wednesday ahead of the Reserve Bank of India's (RBI) policy announcement, with investors anticipating a rate pause and dovish signals to offset rising external risks, particularly the proposed U.S. tariffs. Gift Nifty futures were trading at 24,670 points as of 7:04 a.m. IST, indicating that the Nifty 50 will open near Tuesday's close of 24,649.55. The RBI is widely expected to hold rates steady at its policy decision scheduled at 10:00 a.m. IST, following its surprise 50-basis-point cut in June, which was accompanied by a shift to a "neutral" stance. While the central bank had previously signalled limited room for further easing, expectations for the reassurance of growth and dovish commentary have intensified following the U.S.'s 25% tariffs on Indian goods. "In light of the proposed U.S. tariffs, markets will be looking for a dovish tone and clear reassurance on growth support," said Gaurav Garg, analyst at Lemonn Markets Desk. "The Governor's guidance on balancing domestic demand with external headwinds will be key." Since the June 6 policy, the Nifty 50 has slipped 1.41%, weighed down by muted earnings and global uncertainty. Foreign portfolio investors were net sellers for 12 straight sessions till Tuesday, reacting to trade concerns and earnings disappointment. Meanwhile, domestic institutional investors sold stocks in 22 sessions, providing some cushion to FPI outflows. "The sustained FPI selling was largely driven by a combination of subdued Q1 earnings, a strong U.S. dollar and uncertainty surrounding the U.S-India trade negotiations," said Manish Goel, founder and managing director at Equentis Wealth Advisory Services. FPI outflows may continue till there is greater clarity on trade policy and an improvement in corporate earnings, Goel added. Broader Asian markets opened lower, while Wall Street declined overnight as investors weighed tariff concerns and weaker than expected U.S. economic data. [MKTS/GLOB]
Bloomberg
27 minutes ago
- Bloomberg
Japanese Liquor Maker Yomeishu Is Said to Consider Going Private
Yomeishu Seizo Co., a Japanese medicinal liqueur manufacturer, is considering going private and has received acquisition proposals from several investment funds, according to people familiar with the matter. Yomeishu has appointed Mitsubishi UFJ Morgan Stanley Securities Co. as its financial advisor to explore capital strategies, including delisting, said the people, who asked not to be identified as the information isn't public. Yomeishu has reached out to potential buyers and investment funds for a possible sale and has recently conducted a first-round bidding process, according to the people.
