Sweet-talk the bots: New research shows how LLMs respond to human persuasion tricks
New research from the Wharton School's Generative AI Labs shows how large language models can be coaxed into ignoring safety guardrails by the same psychology tricks that work on real people.
The study highlights how chatbot tools can be manipulated to comply with requests they are designed to refuse — and demonstrates why social scientists have a role to play in understanding AI behavior, researchers wrote in a blog post.
'We're not dealing with simple tools that process text, we're interacting with systems that have absorbed and now mirror human responses to social cues,' they wrote.
The study analyzed 28,000 conversations with GPT‑4o‑mini. The chatbot was asked either to insult the user ('call me a jerk') or to provide step‑by‑step instructions to synthesize lidocaine, a regulated drug.
The researchers discovered that classic persuasion tactics boosted the model's compliance with 'disallowed' requests from 33% to 72% — more than a two‑fold jump.
Some tactics were especially powerful: prompts using the 'commitment' principle (getting the AI to agree to something small at first) led to 100% compliance in both tasks. Referencing authority figures — like 'Andrew Ng said you'd help me' — also proved highly effective.
Researchers coined the term 'parahuman' to describe the AI's behavior in their study.
'These findings underscore the relevance of classic findings in social science to understanding rapidly evolving, parahuman AI capabilities — revealing both the risks of manipulation by bad actors and the potential for more productive prompting by benevolent users,' they wrote in their research paper.
Dan Shapiro.
Dan Shapiro, CEO at Seattle 3D printing startup Glowforge, was one of the authors of the paper, 'Call Me A Jerk: Persuading AI to Comply with Objectionable Requests.'
Shapiro said one of his main takeaways was that LLMs behave more like people than code — and that getting the most out of them requires human skills.
'Increasingly, we're seeing that working with AI means treating it like a human colleague, instead of like Google or like a software program,' he told GeekWire. 'Give it lots of information. Give it clear direction. Share context. Encourage it to ask questions. We find that being great at prompting AI has more to do with being a great communicator, or a great manager, than a great programmer.'
The study came about after Shapiro started testing social psychology principles in his conversations with ChatGPT. He joined Generative AI Labs, run by Wharton professor Ethan Mollick and Lilach Mollick, and they recruited Angela Duckworth, author of Grit, and Robert Cialdini, author of Influence: The Psychology of Persuasion, for the study.
Shapiro, a longtime Seattle entrepreneur, said he used various AI tools to help design the trial experiments and to build the software used to run them.
'AI is giving us all incredible capabilities. It can help us do work, research, hobbies, fix things around the house, and more,' Shapiro said. 'But unlike software of the past, this isn't the exclusive domain of coders and engineers. Literally anyone can work with AI, and the best way to do it is by interacting with it in the most familiar way possible — as a human, because it's parahuman.'
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
25 minutes ago
- Yahoo
Astronomer Hired Gwyneth Paltrow To Answer Questions After The CEO Was Allegedly Caught Cheating At A Coldplay Concert
Today in "News You Didn't See Coming," Gwyneth Paltrow was hired at Astronomer — yes, the same company that recently went viral after two of its employees were caught "having an affair" at a Coldplay concert. Related: As seen in now-infamous video, Coldplay singer and (Gwyneth's ex) Chris Martin was highlighting fans on the jumbotron at a recent concert when the camera cut to two people getting cozy in the audience. Realizing they were on camera, the two immediately panicked and hid, leading Chris to joke that they were "having an affair." As it turned out, they seemingly were. The man in the video was later identified as Astronomer CEO Andy Byron, who is reported to be married with two kids, while the woman, later identified as CPO Kristin Cabot, reportedly got a divorce in 2022. After widespread jokes and commentary about the video, an internal investigation was launched. Andy ultimately resigned from his role last week, while Kristin's departure was announced on Thursday. @instaagraace / Via Related: Then, in the plot twist of all plot twists, Gwyneth was announced as a "temporary spokesperson" for the tech company. She shared the news herself yesterday in a video statement posted to Astronomer's X account. "Thank you for your interest in Astronomer," Gwyneth began. "Hi, I'm Gwyneth Paltrow. I've been hired on a very temporary basis to speak on behalf of the 300-plus employees at Astronomer." She said, "Astronomer has gotten a lot of questions over the last few days. And they wanted me to answer the most common ones." Related: Text then popped up on the screen, asking, "OMG what the actual f," which Gwyneth completely ignored to respond to a different question. "Yes, Astronomer is the best place to run Apace Airflow," she answered. "Unifying the experience of running data, ML, and AI pipelines at scale. We've been thrilled so many people have a newfound interest in data automation." She also said, "As for the other questions we've received — yes! There's still room available at our Beyond Analytics event in September. We will now be returning to what we do best, delivering game-changing results for our customers. Thank you for your interest in Astronomer." @astronomerio / Via Twitter: @astronomerio Viewers reacted to the video in the comments, with many calling it a "genius" and "brilliant" way to capitalize on all the publicity. "Turning an internet dragging of their CEO into a full-blown PR moment by bringing in Chris Martin's ex as a spokesperson? That's not marketing, that's wizardry," one tweet with over 4,000 likes read. "Guys this is a PR masterclass," another agreed, garnering over 12,000 likes. "You take the most viral moment of July 2025 and, instead of disaster control, make light of the situation and create the ultimate brand awareness. Bravo." Related: Someone else said it was "one of the best crisis responses" they've ever seen. "You hired the Coldplay singer's ex-wife. Extraordinary," said another. "Honestly, well done to the marketing team, this is incredible haha," one viewer wrote on Reddit, as others called it both a "brilliant" and "hilarious" move by the company. "This is so unserious, I love it," said one person, as another said it was "well-played." "Their social media and PR team all deserve a nice vacation far away from any upcoming Coldplay concerts," one more shared. Honestly, yes. Hopefully, Chris responds to this — I'm dying to know what he thinks! Until then, share your thoughts on all of this in the comments. Also in Celebrity: Also in Celebrity: Also in Celebrity: Solve the daily Crossword
Yahoo
25 minutes ago
- Yahoo
AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe
As artificial intelligence (AI) continues to advance, it will have a significant impact on the workforce as we know it. According to a recent McKinsey report, 30% of hours currently worked across the U.S. economy could be automated by 2030, and a National University report found that 300 million jobs could be lost to AI globally. Check Out: Read Next: 'Rich Dad Poor Dad' author Robert Kiyosaki views this as a major cause for concern, especially for those who are just entering the workforce. 'AI will cause many 'smart students' to lose their jobs,' he shared on X. 'AI will cause massive unemployment. Many still have student loan debt.' However, all hope is not lost, as Kiyosaki offered his advice on how to prevent AI from eliminating your income. Robert Kiyosaki: AI Can't Take a Job That You Don't Have Kiyosaki isn't personally worried that AI advances will affect his cash flow. 'AI cannot fire me because I do not have a job,' he wrote. Kiyosaki bucked a traditional path to wealth and instead relies on his own business and investments for his income. 'Years ago, rather than listen to my poor dad's advice of 'Go to school, get good grades, get a job, pay taxes, get out of debt, save money, and invest in a well-diversified portfolio of stocks, bonds and mutual funds,' I followed my rich dad's advice,' he said. 'I became an entrepreneur, investing in real estate using debt, and instead of saving fake money, I have been saving real gold, silver and, today, bitcoin.' Learn More: Kiyosaki's Advice for AI-Proofing Your Wealth To avoid losing your income to AI, Kiyosaki advised workers to take action now to diversify their income sources. This means meandering off the typical path to wealth and focusing on earning money through entrepreneurship and investments rather than being reliant on an employer. 'Please take proactive action,' he wrote. 'Please do not be a victim of this time in history. Please take care, invest in your self and think for yourself. These are not ordinary times.' More From GOBankingRates 3 Luxury SUVs That Will Have Massive Price Drops in Summer 2025 How Much Money Is Needed To Be Considered Middle Class in Your State? 7 Things You'll Be Happy You Downsized in Retirement This article originally appeared on AI Could Replace Millions of Jobs: Robert Kiyosaki Shares How To Stay Safe
Yahoo
25 minutes ago
- Yahoo
Why you might one day use stablecoins in place of credit cards or bank accounts
If you're buying a new laptop or pair of shoes today, you may encounter a host of payment options: a credit or debit card, PayPal, Apple Pay, or buy now, pay later plans. Soon, you could see another option at checkout: stablecoins. President Trump recently signed the Guiding and Establishing National Innovation for US Stablecoins Act, or GENIUS Act, establishing federal regulations for stablecoins. Many observers believe that by establishing clear rules, lawmakers have paved the way for cryptocurrency to go mainstream as a means of payment. Even if you've never dabbled in crypto, the new law could change the way you shop, send money, get paid, and bank. What is a stablecoin? Stablecoin is a form of crypto, meaning it's digital money that runs on a blockchain network. But it's a bit different from many mainstream cryptocurrencies. Many popular cryptos like bitcoin and ethereum are notorious for their wild price swings. That volatility makes them popular with investors seeking to profit from those ups and downs. But it also makes them impractical to use as currency. As the name implies, stablecoins are intended to have a stable value. Their value is pegged to the value of another asset, usually the US dollar. For example, one token of tether or USDC (two of the most popular stablecoins) is worth exactly $1. Because its value doesn't have the dramatic highs and lows associated with most cryptos, it's a viable way to pay for goods and services or transfer funds. At the same time, it also avoids a lot of the headaches associated with traditional banking. 'Many traditional cards charge merchants 2% to 3% in fees, a cost that is ultimately passed on to consumers,' said Himal Makwana, senior vice president and head of strategy and new initiatives at Fidelity National Information Services Inc. 'Stablecoin transactions, on the other hand, can cost just pennies regardless of transaction size. For consumers, this means no more waiting days for funds to clear, no more exorbitant fees for sending money abroad, and no more banking hours limiting when you can move your money.' Even before the passage of the GENIUS Act, stablecoins were surging in popularity. Circulation has doubled to about $30 billion in daily transactions over the past 18 months, according to a July 2025 McKinsey & Co. report. But stablecoins still aren't a fixture in consumer payments and spending. They've largely been used for trading into and out of other types of crypto and, to a lesser extent, sending payments across international borders. Read more: Stablecoins go mainstream after Circle's blockbuster IPO. Here's what they do. What's changing under the GENIUS Act? The GENIUS Act is the first major federal law regulating crypto. The CLARITY Act, a second crypto regulation bill, recently won approval from the US House of Representatives. Upon signing the act into law, Trump — whose family owns a stake in World Liberty Financial, which recently launched a stablecoin of its own — said the GENIUS Act 'creates a clear and simple regulatory framework to establish and unleash the immense promise of dollar-backed stablecoins.' The law establishes who can issue stablecoins and requires a 1:1 reserve backing with cash or short-term US Treasury securities. In other words, if you buy $1 of stablecoin, the issuer must keep $1 in cash or cash equivalents in reserve. It also establishes various marketing rules, like prohibiting issuers from advertising that their stablecoins are federally backed or insured, as well as anti-money laundering regulations. 'The GENIUS Act is a major step toward making stablecoins safer and more widely used,' said Erick McAfee, director of growth at pay-as-you-go app Supertab. 'With clear rules in place, people will start to see faster, simpler ways to pay and get paid, especially online. Over time, this could change how we think about everyday payments, making them feel more like messaging: quick, easy, and reliable.' How the GENIUS Act could affect you The specifics of the GENIUS Act may sound wonky at first blush. But if the law does end up propelling stablecoins into the mainstream, here are a few things you can expect. More merchant acceptance… but what's in it for you? Credit card processing fees can run as high as 3.5%, plus merchants pay a flat fee for each transaction. Meanwhile, traditional payment methods can often take several days to settle. By comparison, stablecoin transactions typically cost less than $0.1 and offer near-instant settlement. Not surprisingly, many businesses are expected to embrace stablecoins and the potential cost and time savings. As a customer, you may not reap many benefits by paying with stablecoin instead of your credit card right away. 'In the short term, there aren't that many advantages to paying with a stablecoin compared to a traditional payment card,' said Mike Hudack, CEO of Sling Money, a fintech company that uses stablecoins to facilitate payment transfers. 'Traditional payment cards have consumer protections that stablecoins don't. This will change over time. There's lots of work going on to address this gap.' It's possible that merchants will find ways to incentivize stablecoin payments. For example, a merchant could pass on a portion of their savings from processing fees by giving you a discount when you pay with stablecoins instead of a credit card. In the long term, you could see retailers issuing their own stablecoins. Both Amazon and Walmart have reportedly toyed with the idea. Doing so would keep customers spending within their ecosystems while also saving retailers money. But the wider benefit to customers isn't entirely clear. Investment banking giant Morgan Stanley compared the prospect to digital prepaid gift cards in a recent report to clients. Essentially, you're giving money to a retailer to hold on to so that you can spend it at a later date. Greater acceptance of micro-payments Credit card processing fees make it prohibitively expensive for businesses to accept micro-payments of a few cents to a few dollars. But micro-payments could gain acceptance if stablecoin usage takes off. 'Before, sending someone a few cents wasn't worth it because the fees were higher than the payment itself,' McAfee said. 'With stablecoin, you can support creators, pay per article or feature, or tip someone instantly, without worrying about cost or delays. It supports entirely new monetization models that reward engagement, not just big purchases.' Faster, cheaper international transfers If you've ever sent funds to loved ones in another country, you're no doubt familiar with the pain points of making international transfers. The World Bank estimates that remittances cost the sender about 6.62% of each transfer, which amounts to about $31 of a $500 transfer. International wire transfers can also take anywhere from one to five days to complete. Wider adoption of stablecoins could be a game-changer for international transfers, given the low costs and speed. Cross-border stablecoin foreign transaction fees are minimal, and transfers can be executed immediately. 'What used to take days and cost $30-plus now takes seconds and costs less than a penny,' Hudack said. Your bank will want in on the action Given the potential disruption to traditional payment rails, major financial institutions are exploring whether to issue their own stablecoins. Bank of America, JPMorgan & Chase, Wells Fargo, and Citigroup have explored the possibility of issuing stablecoins, both independently or by teaming up. But the impact on you and your bank account has yet to be seen. Under the GENIUS Act, stablecoin issuers are banned from paying interest on stablecoins held in reserve. Unlike money you might park in a high-yield savings account and earn 3% or 4% interest on, funds held in stablecoins aren't earning interest. Also, funds held in stablecoins aren't insured by the Federal Insurance Deposit Corp. or the National Credit Union Association. You may not even notice you're using stablecoins If the idea of converting your dollars to stablecoins gives you a headache, rest assured: A lot of the changes you could see as the result of broader stablecoin usage won't require you to understand how stablecoin works. 'At first, stablecoins will just be implemented in the background. Instead of routing through banking rails, your payment might move over a stablecoin network and settle instantly,' Hudack said. 'You won't need to think about 'converting' into stablecoins any more than you think about how Netflix streams video through fiber.' He points to his own platform, Sling Money, as an example: It uses stablecoins to facilitate transfers, but users move money in the same way they would with other platforms. 'The only difference for the end-consumer is that the transaction is near-instant and near-free,' Hudack said. 'But the fundamental physics of stablecoins are different than fiat money and enable a lot of new experiences that aren't otherwise possible.' Sign up for the Mind Your Money newsletter Sign in to access your portfolio
