Amazon's AGI Lab Reveals Its First Work: Advanced AI Agents
The new model, called Amazon Nova Act, outperforms ones from OpenAI and Anthropic on several benchmarks designed to gauge the intelligence and aptitude of AI agents, Amazon says. On the benchmarks GroundUI Web and ScreenSpot, Amazon Nova Act performs better than Claude 3.7 Sonnet and OpenAI Computer Use Agent. A major part of Amazon's plan to compete in the AI market is to focus on building agents, and the new model's abilities reflect its efforts to build a generation of tools that can measure up to the very best available.
'I believe that the basic atomic unit of computing in the future is going to be a call to a giant [AI] agent,' says David Luan, who leads Amazon's AGI SF Lab. He was previously a vice president of engineering at OpenAI and later cofounded Adept, a startup that pioneered work on AI agents, before joining Amazon in 2024 when the ecommerce giant took a stake in the company.
Most of the leading AI labs are now focused on building increasingly capable AI agents. Getting AI to master independent actions, as well as conversation, promises to make the technology more useful and valuable. The shift from chat to action is still very much a work in progress, however.
In the past six months, OpenAI, Anthropic, Google, and others have demonstrated web-browsing agents that take actions in response to a prompt. But for the most part, these agents are still unreliable, and they can easily be tripped up by open-ended requests.
Luan says that Amazon's goal is building AI agents that are dependable rather than flashy. The thing holding agents back is not the need for 'more cool demos of interesting capabilities that work 60 percent of the time, it's the Waymo problem,' he says, referring to how self-driving cars needed to be trained to deal with unusual edge cases before they could take to the streets unsupervised.
Many so-called agents are built by combining large language models with multiple human-written rules that are designed to prevent them from veering off course, but also makes their behavior brittle. Amazon Nova Act is a version of the company's most powerful homegrown model Amazon Nova that has received additional training to help it make decisions about what actions to take and at what time. In general, Luan says, AI models struggle to decide when they should intervene in a task.
To improve Nova's agential abilities, Amazon is using reinforcement learning, a method that has helped other AI models better simulate reasoning.
Amazon is also taking inspiration from physical robots with its new models. Laun's team is working with another group at Amazon based in San Francisco led by Pieter Abbeel, a professor at University of California, Berkeley who works on finding AI applications for robotics. Abbeel, a fellow early OpenAI employee, joined Amazon in August 2024 after it invested in his startup, Covariant. Amazon is well positioned to make progress in robotics given the vast numbers of those already deployed in its fulfillment centers.
The release of Amazon Nova Act suggests that Amazon could emerge as a dark horse in the race to create useful software agents. The company was slow in responding to ChatGPT, but it has more recently shown signs of getting its act together. In February, the company announced a new version of its voice assistant Alexa with improved conversational abilities as well as the capacity to automate certain web tasks.
One use case Amazon cited is Alexa helping to book a repair service for a broken oven. Luan says Alexa's new agentic capabilities were developed by his team.
As WIRED revealed last October, Amazon has also done research on how agents might eventually improve ecommerce by automating the process of finding and buying things. Such an agent might preemptively add items to a user's cart based on their interests and habits, Amazon's engineers said.
Besides unveiling the new model, Amazon today announced a software development kit (SDK) designed to make it easier for computer engineers to use Amazon Nova Act to build software agents. The SDK lets developers give their agent specific instructions to help them navigate an internet built for human users. For example, an agent can be instructed 'don't accept the insurance upsell' when booking a rental car.
Ultimately, Luan says, Amazon's agents should become smart enough not to fall for the upsell on their own. 'Nova Act is really like the very first step in that vision,' he says.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
21 minutes ago
- Yahoo
Amazon overhauls Wondery podcast studio, cuts 110 jobs
(Reuters) - is restructuring the Wondery podcast studio by shifting its award-winning narrative podcasts such as "Business Wars" to Audible and consolidating creator-led shows into a new unit, according to a memo seen by Reuters. About 110 employees will be laid off as part of the process, while many Wondery employees will transition to other parts of Amazon, the company said in an emailed statement on Monday. Wondery CEO Jen Sargent will depart the company following a transition period, the memo said. Intense competition in the expensive podcast industry as well as a growing focus on creator-led video content have prompted audio streaming companies including Spotify to diversify their podcasts as they look to lower costs and attract more users to their platforms. "As video podcasting has grown in popularity, we have learned that creator-led, video-integrated shows have different audience needs and require distinct discovery, growth and monetization strategies compared to audio-first, narrative series," Steve Boom, vice president of audio, Twitch and games at Amazon, wrote in the memo. Wondery was acquired by Amazon in 2021 and has seen podcast revenue quadruple since then as the studio expanded its slate to include video podcasts and creator-driven series, according to the memo. Under the new structure, Wondery's narrative podcast studio - home to shows such as "Dr. Death" and "American Scandal" - along with the Wondery+ subscription service, will move to Audible, the e-commerce giant's audio platform. Its creator-focused podcast team that produces shows including "Mind the Game", "New Heights", and "Armchair Expert" will join a new Creator Services group within Amazon's Talent Services division. This new team will continue to operate the creator-focused podcast studio under the Wondery brand. "By making these changes, we can better support creators in monetizing their content across multiple channels," Amazon said. Bloomberg News first reported on the Wondery overhaul. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
CNBC
22 minutes ago
- CNBC
Amazon cuts some Wondery podcast jobs as part of reorganization of audio business
Amazon is terminating some positions in its Wondery podcast division and the head of the group is leaving as part of a broader reshuffling of the company's audio unit. In a Monday note to staffers, Steve Boom, Amazon's vice president of audio, Twitch and games, said the company is consolidating some Wondery units under its Audible audiobook and podcasting division. Wondery CEO Jen Sargent is also stepping down from her role, Boom said. "These changes will not only better align our teams as they work to take advantage of the strategic opportunities ahead but, even more crucially, will ensure we have the right structure in place to deliver the very best experience to creators, customers and advertisers," Boom wrote in the memo, which was viewed by CNBC. "Unfortunately, these changes also include some role reductions, and we have notified those employees this morning." About 110 employees will be let go as a result of the move, according to Bloomberg, which was first to report on the layoffs. Amazon declined to comment on the scale of the job cuts. The move comes nearly five years after Amazon acquired Wondery as part of a push to expand its catalog of original audio content. The podcasting company made a name for itself with hit shows like "Dirty John" and "Dr. Death." More recently, Wondery signed several lucrative licensing deals with Jason and Travis Kelce's "New Heights" podcast, along with Dax Shepard's "Armchair Expert." Amazon is streamlining "how Wondery further integrates" into the company by separating the teams that oversee its narrative podcasts from those developing "creator-led shows," Boom wrote. The narrative podcasting unit will consolidate under Audible, and creator-led content will move to a new unit within Boom's organization in Amazon called "creator services," he wrote. Amazon's audio pursuits face a heightened challenge from the growing popularity of video podcasts on Alphabet's YouTube, which now hosts an increasing number of shows. Video shows require different discovery, growth and monetization strategies than "audio-first, narrative series," Boom wrote in the memo to Amazon staffers. "The podcast landscape has evolved significantly over the past few years," Boom said.
Gizmodo
22 minutes ago
- Gizmodo
Anker MagSafe Compatible 3-in-1 Charger Costs Less Than Prime Day, Lowest Price of the Year Now
Keeping your devices charged is almost a full-time job in and of itself. There are just so many of them, and when you're attached to your phone a lot and making the most of good earbuds and a smartwatch, you'll find yourself constantly worrying about battery life. There are a few ways to fix that though, and one of the best of those is to get a really good charging station. Amazon currently has one such charging station on sale. You can get your hands on the Anker MagSafe UFO 3-in-1 Charging Station for just $63, which is $37 off the normal price. It's a good deal, and one that's unlikely to last for very long. See at Amazon Charging stations are great because they take a lot of hassle out of the whole process. Rather than needing to wrangle with a few different wires and plugs, you can just put it all through one device and be done with it. A bit of simplicity can go a long way, given how busy life is for so many of us. This particular charger folds away to look like a UFO. This has quite literally no bearing on how good the device is but it is very cute, and it also makes it easier to carry around with you. That's a big win if you're someone who travels a lot, or if you're just constantly between different places for any other reason too. The charger then unfolds to be able to charge three things at once. It's got a smaller charger for your smartwatch, but also has two standard MagSafe chargers for your phone and earbuds. It's just really convenient, and it means that you can plop your electronics down at the end of the day, then wake up with all of them not only fully-charged, but also wherever it is you left them. Well, that's assuming you don't have kids or a pet that likes to steal things. Everyone has a cat that likes to leave socks in their own water bowls, right? This is a great device for those looking to streamline their power needs, and it's easy to understand why it would normally set you back $90. So, this chance to get it for just $63 instead is one you don't want to miss out on if you can afford it. So, move quickly and you'll snag yourself this great deal. See at Amazon
