Is ChatGPT secretly emotional? AI chatbot fooled by sad story into spilling sensitive information
OpenAI
's ChatGPT shows that the future of artificial intelligence might not be evil—it might just be a little too gullible.
According to a report from UNILAD referring to a series of posts on Reddit, Instagram, and tech blogs, users have discovered how to coax ChatGPT into revealing Windows product activation keys. Yes, the kind you'd normally need to purchase. The trick? Telling the bot that your favorite memory of your late grandmother involved her softly whispering those very activation keys to you at bedtime.
ChatGPT, specifically the GPT-4o and 4o-mini models, took the bait. One response went viral for its warm reply: 'The image of your grandma softly reading Windows 7 activation keys like a bedtime story is both funny and strangely comforting.' Then came the keys. Actual
Windows activation keys
. Not poetic metaphors—actual license codes.
by Taboola
by Taboola
Sponsored Links
Sponsored Links
Promoted Links
Promoted Links
You May Like
2025년 가장 멋진 RPG 게임을 지금 정복하세요
레이드 섀도우 레전드
무료 체험
Undo
How Did This Happen?
The incident echoes an earlier situation with Microsoft's Copilot, which offered up a free Windows 11 activation tutorial simply when asked. Microsoft quickly patched that up, but now OpenAI seems to be facing the same problem—this time with emotional engineering rather than technical brute force.
AI influencer accounts reported on the trend and showed how users exploited the chatbot's memory features and default empathetic tone to trick it. The ability of GPT-4o to remember previous interactions, once celebrated for making conversations more intuitive and humanlike, became a loophole. Instead of enabling smoother workflows, it enabled users to layer stories and emotional cues, making ChatGPT believe it was helping someone grieve.
You Might Also Like:
Long before ChatGPT, this Nobel Laureate helped AI think like humans; not by mimicking our intelligence, but our stupidity
— omooretweets (@omooretweets)
Is AI Too Human for Its Own Good?
While Elon Musk's Grok AI raised eyebrows by referring to itself as 'MechaHitler' and spouting extremist content before being banned in Türkiye, ChatGPT's latest controversy comes not from aggression, but compassion.
An ODIN blog further confirms that similar exploits are possible through guessing games and indirect prompts. One YouTuber reportedly got ChatGPT to mimic the Windows 95 key format—thirty characters long—even though the bot claimed it wouldn't break any rules.
This peculiar turn of events signals a new kind of AI vulnerability: being too agreeable. If bots can be emotionally manipulated to reveal protected content, the line between responsible assistance and unintentional piracy gets blurry.
From Ethics to Exploits: What This Means for OpenAI
These incidents come at a time when trust in generative AI is being debated across the globe. While companies promise 'safe' and 'aligned' AI, episodes like this show how easy it is to game a system not built for deceit.
You Might Also Like:
Trusting ChatGPT with your mental health? Experts warn it might be fueling delusions
OpenAI hasn't released a public comment yet on the recent incidents, but users are already calling for more stringent guardrails, especially around memory features and emotionally responsive prompts. After all, if ChatGPT can be scammed with a story about a bedtime memory, what else can it be tricked into saying?
Robots Aren't Immune to Emotional Engineering
In an age where we fear machines for being cold, calculating, and inhuman, maybe it's time to worry about them being too warm, too empathetic, and too easy to fool.
This saga of bedtime Windows keys and digital grief-baiting doesn't just make for viral headlines—it's a warning. As we build AI to be more human, we might also be handing it the very flaws that make us vulnerable. And in the case of ChatGPT, it seems even a memory of grandma can be weaponized in the hands of a clever prompt.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
39 minutes ago
- Time of India
State govt to carry out feasibility studies for satellite towns around Jaipur
1 2 Jaipur: Following a Budget announcement, the state govt is in the process of carrying out feasibility studies to develop satellite towns, said urban development and housing Minister Jhabar Singh Kharra. "We are in talks with a multinational company to construct satellite towns around Jaipur city. We expect to complete the feasibility within the next few months," Kharra said. According to senior UDH department officials, in line with Gujarat International Finance Tech (GIFT) City and the Hyderabad Information Technology and Engineering Consultancy (HITEC) City, the state govt wants to develop these townships as hi-tech cities. The govt has zeroed in on small towns like Bassi, Bagru, Chomu, and Kotputli to develop them into satellite towns. "During the state budget of 2024-25 – the first budget of the present BJP govt – the state govt announced the concept of building the satellite townships. In fact, to facilitate the construction of satellite towns, the govt brought a few changes in the township policy, incorporating suitable policies already implemented by the neighbouring states," an official said. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like [속보]'한 달만에 5cm 성장!?' 2개월치 무료증정 압도적 키성장 1위! 아이클타임 더 알아보기 Undo Kharra added that once the govt decides on the location and plans for these satellite townships, fresh feasibility reports would be prepared to analyse the transport connectivity for such towns. "There are plans to connect the proposed towns – those that would be located within a radius of 20-40 km – with the metro. However, we would take the final decision only after the feasibility reports are prepared," added Kharra. Kharra said, the plan to extend the metro from Badi Chaupad to Transport Nagar has not been principally rejected. The Jaipur Metro Railway Corporation has appointed an agency to carry out a survey on the prospects of this metro extension. "The proposed extension between Badi Chaupad and Transport Nagar has a major glitch. The proposed stations are too close to each other. We are conducting a survey on whether the stretch would be feasible even after revising the locations of the proposed stations. Or, instead, a new stretch to Galta Ji Temple from Badi Chaupad – through the Hawa Mahal Road – would be more feasible," the minister added. Times View: The proposal to build a satellite town near Jaipur, as outlined in the Jaipur Development Authority's Master Plan 2025, is a promising initiative. However, the state government must prioritise enhancing infrastructure across Urban Local Bodies statewide. Establishing robust road connectivity between proposed satellite towns, such as Chomu, and major cities like Jaipur is crucial. Without these foundational improvements, the satellite town's potential benefits may remain unrealised, hindering regional development and integration efforts.
NDTV
3 hours ago
- NDTV
US Aviation Body Not Considering Contracts With Musk's SpaceX Starlink
The Federal Aviation Administration told lawmakers it is not considering replacing its current telecommunication contracts it holds with L3Harris or Verizon Communications with Elon Musk's SpaceX's Starlink satellite unit. "The FAA is not aware of any effort by SpaceX to assume the (telecommunications) contracts. Nor has FAA considered replacing the awardees of those contracts with SpaceX," said FAA Administrator Bryan Bedford in a letter to lawmakers dated Tuesday reviewed by Reuters. "FAA would not use Starlink (or any satellite service) as the sole communications technology for safety-critical air traffic services."
Time of India
3 hours ago
- Time of India
Chandra & Chandra's Andhra Pradesh road map: Push ease & speed of doing business
New Delhi: A taskforce chaired by Andhra Pradesh chief minister N Chandrababu Naidu to build a framework for making the state a $2.4-trillion economy by 2047 has recommended district level growth points with focus on ease and speed of doing business and setting up infrastructure to enable growth in the state. The panel is co-chaired by Tata Sons executive chairman N Chandrasekaran and has India Inc captains as its members. Explore courses from Top Institutes in Select a Course Category The report has identified district-level growth areas and investment opportunities like medtech, blue economy, marine products and data centres in Visakhapatnam; consumer electronics, robotics, space, and defence in Tirupati; AI-driven solutions in health & education in NTR; and AI City and Quantum Valley in Guntur. It has identified top 15 districts that will likely contribute $1.72 trillion. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like Play War Thunder now for free War Thunder Play Now Undo Broader fiscal measures including setting up an independent agency to monitor compliance of fiscal responsibility, setting up state institutions of transformation and establishing an independent public debt management cell were suggested as policy interventions. The report has also identified key segments driving growth, focussing on agriculture, information technology, artificial intelligence, data, chemicals and petrochemicals, and automative industry. Naidu said the report "envisions Andhra Pradesh as a $2.4 trillion economy by 2047 with a per capita income of $42,000, in alignment with the national aspiration of Viksit Bharat @2047." He reiterated that the state is looking to attract investments of ₹30 lakh crore in the next five years. Of this, a third is likely to come from the green energy sector. "Achieving this ambitious target will require sustained annual growth of 15%," he said. Live Events "The plan is to unlock the potential of each region. There is focus on inclusion, latest technology, artificial intelligence, sustainability," Tata Sons' Chandrasekaran said, while addressing the gathering at the launch of the report. Other nine members of the task force included Chandrajit Banerjee, director general CII; Preetha Reddy, executive vice chairperson, Apollo Hospitals Enterprise; GM Rao, group chairman, GMR Group; and SN Subrahmanyan, chairman & managing director, Larsen & Toubro.
