Amazon Web Services is building equipment to cool Nvidia GPUs as AI boom accelerates
Nvidia's GPUs, which have powered the generative AI boom, require massive amounts of energy. That means companies using the processors need additional equipment to cool them down.
Amazon considered erecting data centers that could accommodate widespread liquid cooling to make the most of these power-hungry Nvidia GPUs. But that process would have taken too long, and commercially available equipment wouldn't have worked, Dave Brown, vice president of compute and machine learning services at Amazon Web Services, said in a video posted to YouTube.
"They would take up too much data center floor space or increase water usage substantially," Brown said. "And while some of these solutions could work for lower volumes at other providers, they simply wouldn't be enough liquid-cooling capacity to support our scale."
Rather, Amazon engineers conceived of the In-Row Heat Exchanger, or IRHX, that can be plugged into existing and new data centers. More traditional air cooling was sufficient for previous generations of Nvidia chips.
Customers can now access the AWS service as computing instances that go by the name P6e, Brown wrote in a blog post. The new systems accompany Nvidia's design for dense computing power. Nvidia's GB200 NVL72 packs a single rack with 72 Nvidia Blackwell GPUs that are wired together to train and run large AI models.
Computing clusters based on Nvidia's GB200 NVL72 have previously been available through Microsoft or CoreWeave. AWS is the world's largest supplier of cloud infrastructure.
Amazon has rolled out its own infrastructure hardware in the past. The company has custom chips for general-purpose computing and for AI, and designed its own storage servers and networking routers. In running homegrown hardware, Amazon depends less on third-party suppliers, which can benefit the company's bottom line. In the first quarter, AWS delivered the widest operating margin since at least 2014, and the unit is responsible for most of Amazon's net income.
Microsoft, the second largest cloud provider, has followed Amazon's lead and made strides in chip development. In 2023, the company designed its own systems called Sidekicks to cool the Maia AI chips it developed.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Business Insider
16 minutes ago
- Business Insider
U.S. Senators Warn Nvidia CEO Jensen Huang about His Trip to China
Two U.S. senators—Republican Jim Banks and Democrat Elizabeth Warren—sent a letter to Nvidia (NVDA) CEO Jensen Huang on Friday, urging him to be cautious during his trip to China. They asked him not to meet with any companies that are believed to be helping China get around U.S. export restrictions, especially those connected to the Chinese military or intelligence agencies and that are listed on the U.S. export blacklist. The senators warned that even appearing to support these companies could weaken U.S. efforts to control advanced chip exports. Elevate Your Investing Strategy: Take advantage of TipRanks Premium at 50% off! Unlock powerful investing tools, advanced data, and expert analyst insights to help you invest with confidence. Make smarter investment decisions with TipRanks' Smart Investor Picks, delivered to your inbox every week. Huang's trip was scheduled for the same day the letter was sent. In response, an Nvidia spokesperson said that when American technology leads the global standard, 'America wins,' and noted that China has one of the world's largest groups of software developers. They added that AI systems should be designed to run best on U.S.-based hardware, which would encourage other countries to choose U.S. tech over alternatives. However, the concern from lawmakers is that Huang's meetings could expose weaknesses in current rules and send the wrong signal about America's stance on protecting its technology. This issue ties into recent tensions between Nvidia and U.S. regulators. At the Computex trade show in May, Huang praised President Donald Trump's decision to loosen some AI chip export rules and called the earlier restrictions ineffective. But newer limits put in place in April could still cost Nvidia up to $15 billion in lost revenue. Lawmakers are now considering laws that would require chipmakers to verify where their products end up. There are also growing fears that Chinese companies like DeepSeek are helping the military and using fake companies to dodge the rules. Despite all this, Nvidia is reportedly preparing a cheaper version of its Blackwell AI chips specifically for the Chinese market. What Is a Good Price for NVDA? Turning to Wall Street, analysts have a Strong Buy consensus rating on NVDA stock based on 37 Buys, four Holds, and one Sell assigned in the past three months, as indicated by the graphic below. Furthermore, the average NVDA price target of $176.29 per share implies 6.7% upside potential.
Yahoo
33 minutes ago
- Yahoo
Citi raises Super Micro target, but warns on margin pressures
-- Citi raised its price target on Super Micro Computer (NASDAQ:SMCI) to $52 from $37 a share in a note Friday, citing improving demand for AI servers and the ramp of Nvidia's GB200/300 platforms. However, the bank kept a Neutral rating on the stock, pointing to increasing competitive pressure from Dell (NYSE:DELL) and HPE. 'Management sounds constructive on materialization of current commitments over the next two quarters as Blackwell GPU supply constraints ease,' Citi analysts wrote. However, they added, 'We remain concerned on margins given increased momentum and competitive efforts by DELL and HPE, which we believe will temper margin expansion expectations.' Super Micro is expected to report fiscal fourth-quarter results in early August. Citi forecasts revenue of $6.07 billion, up 13.4% year over year and 32% quarter over quarter, and EPS of $0.45, roughly in line with consensus. For the first quarter of fiscal 2026, Citi estimates revenue of $7.02 billion and EPS of $0.65, both above the Street. Citi also highlighted several key focus areas for investors: '1) Global manufacturing footprint amidst tariff implications; 2) Hopper to Blackwell GPU platforms transition; 3) Ability (OTC:ABILF) to deliver on their first-to-market advantage for new GPU platforms amidst increased competitive environment; and 4) DCBBS and DLC 2 emergence and ramp into 2H.' While raising its price target on improved market multiples and peer valuation trends, Citi reiterated that 'we remain Neutral on the name amidst continued broader industry demand (albeit lumpy).' Related articles Citi raises Super Micro target, but warns on margin pressures Air India crash probe reveals pilot cut fuel flow to engines S&P 500 falls after Pulte claims Powell considering resignation
Yahoo
40 minutes ago
- Yahoo
These last-minute Prime Day deals are still expensive, but they're up to 53% off their regular prices: Apple AirPods, Dyson Airwrap & more
We're in the final hours of Amazon Prime Day 2025, and if you're looking to save on big-ticket items, you have until 11:59 p.m. PST tonight (Friday, July 11) to take advantage of the deals. Prime Day is a phenomenal opportunity to save on brand-name tech, home and kitchen appliances, beauty products and other goods that rarely go on sale. If you're working with a small budget, there are, of course, a ton of cheap deals available (these are all under $25, for example), but Prime Day is especially handy if you want to save $100s — or even $1,000s — on higher-priced items. Below, we've listed some of the sale's best deals on high-ticket items, including Apple AirPods and Apple Watches, Bose headphones, Oral-B electric toothbrushes and more. These items are unlikely to go on sale again anytime soon, so if you're not willing to wait until Black Friday or Boxing Day, now may be the time to take the plunge — just remember, Prime Day requires an Amazon Prime membership. Not yet a member? Save $82Apple AirPods Pro 2 Wireless Earbuds $175 off: Apple Watch Series 10 [GPS 46mm] Smartwatch Save $70: PlayStation 5 Digital Edition - Call of Duty Bundle $190 off: Apple AirPods Max $250 off: Amazon Fire TV 55" smart TV Save $215: Beats Studio Pro Save $250: Amazon Fire TV 55" Omni Mini-LED Series smart TV $200 off: Bose QuietComfort Ultra Noise-Cancelling Headphones Save $170: Ninja Foodi 10 QT 6-in-1 DualZone Smart XL Air Fryer $350 off: Philips 3200 Series Fully Automatic Espresso Machine Save $180: Ninja Luxe Café Essential Series $130 off: Ninja Foodi 8-in-1 Digital Air Fry Oven Save $240: Shark Vertex DuoClean PowerFin Upright Vacuum $82 off: YETI Hopper Flip 12 Portable Cooler Save $173: Dyson V8 Plus Cordless Vacuum $405 off: MOVA P10 Pro Ultra Robot Vacuum and Mop Save $170: Dyson Airwrap Multi-Styler and Dryer Save $119: Oral-B iO Series 7L Electric Toothbrush $86 off: Shark FlexStyle Air Styling & Drying System With six hours of listening time on a single charge and up to 30 hours when using the MagSafe Charging Case (included), the AirPods boast impressive battery life. It comes with four silicone tips that help you achieve a secure and comfortable fit, while also keeping sound in and external noise out. The AirPods resist dust, sweat and water, making them suitable for sweaty workouts or outdoor activities while also providing intelligent noise control. It also features an H2 chip, which provides deep, immersive sound with rich bass and overall improved definition. The Apple Watch Series 10 is an on-the-go command centre for calls and texts, Apple Pay and dozens of health and fitness metrics. The watch measures your blood oxygen levels, takes an ECG, tracks your sleep stages and offers the same spot-on calorie and heart rate monitoring that you've come to expect from Apple devices. One of the biggest draws of the updated PlayStation 5 Slim Console is that it offers all the same features, now in a slimmer system. What was once an arguably valid complaint of bulkiness has turned into a roughly 30 per cent cut in size for the disc version. For those who opt for the PlayStation 5 Slim Digital Edition Console, which lacks a disc drive and only lets users play digital games, that size difference is even larger. The Apple AirPods Max feature personalized Spatial Audio with dynamic head tracking for surround-like sound and pro-level noise-cancellation to remove unwanted noise, making them a fantastic option for air travel, commuting and office work. This smart TV features a stunning 4K Quantum Dot Display (QLED), Dolby Vision IQ and HDR10+, bringing brighter, richer and more lifelike visuals to your favourite TV shows, sports, games and movies. The Fire TV automatically optimizes the brightness of movies and shows using a built-in sensor that detects the lighting in your room, enhancing your TV-watching experience. With the Fire TV Ambient Experience, shoppers can display art, photos and more when not actively watching TV. When it's time to watch your favourite show, users can stream more than 700,000 movies and TV episodes with subscriptions to Netflix, Prime Video, Disney+ and more. The Beats Studio Pro over-ear headphones feature fully adaptive active noise cancelling (pure ANC) technology, which actively blocks unwanted external noises such as airplane sounds, noisy office neighbours and outside traffic. The headphones feature Class 1 Bluetooth for exceptional wireless connectivity. Their rechargeable battery offers up to 40 hours of battery life and up to 24 hours of listening time when ANC or Transparency Mode is enabled. Studio Pro headphones easily connect to Android and Apple devices right out of the box and are comfortable for all-day wear. Multifunction on-ear controls can take calls, control music and activate Siri when you need a hand. This top-rated QLED 4K UHD smart TV features Dolby Vision IQ, 144Hz gaming mode, Ambient Experience and is capable of hands-free functioning with Alexa. If you want headphones that look and feel luxe, you need Bose's QuietComfort Ultra wireless style in limited edition deep plum. They're functional, too, with a wide range of custom listening modes, touch controls and 24 hours of battery life. Immersive mode is "like being inside of your own little bubble," says one customer. Another perk? "Music or video instantly pauses" when you remove the Ninja Foodi 10 air fryer features two five-quart baskets that allow you to prepare your favourite foods at the same time. The air fryer's Smart Finish system allows you to prepare foods on different temperatures to finish at the same time or cook both baskets at the same settings using the Match Cook feature. This fully automatic espresso machine brews espresso, coffee, Americanos, cappuccinos and latte macchiatos, so take your pick for a fuss-free morning cup of Joe. Brew no-guesswork espresso and drip coffee with this popular 2-in-1 unit. The machine offers grind recommendations based on your beans and auto-calibrates with each brew, so you can enjoy your coffee without any of the fuss of high-end machines. Dubbed the "ultimate meal-making machine," this 8-in-1 device does it all: air fry, air roast, air broil, bake, bagel, toast, dehydrate and keep warm, all in one powerful, 1800-watt appliance. Dubbed Shark's "most powerful vacuum ever," this "Amazon's Choice" device offers incredible suction and innovative cleaning technologies. The YETI Hopper Flip 12 cooler features ColdCell Insulation, a closed-cell foam that provides superior cold-holding capabilities compared to ordinary soft coolers, with a capacity of up to 12 cans, plus ice. This popular Dyson vacuum offers up to 40 minutes of run time with an advanced, whole-machine filtration that traps 99.99 per cent of fine dust as small as 0.3 microns. With 13,000 Pa strong suction power, this 2-in-1 robot vacuum and mop can easily suck away dust from hard floors or carpets, pet hair, cat litter, snack crumbs and more. Style your hair without extreme heat with the cult-favourite Dyson Airwrap. Remove 100 per cent more plaque and achieve 2x healthier gums with Oral-B's most advanced technology in just one week, according to the brand. This popular multi-styler features attachments for auto-wrap curls, a paddle brush, an oval brush and a concentrator attachment.
