Latest news with #GPTStore
Newsweek
3 days ago
- Health
- Newsweek
Don't Ask AI ChatBots for Medical Advice, Study Warns
Based on facts, either observed and verified firsthand by the reporter, or reported and verified from knowledgeable sources. Newsweek AI is in beta. Translations may contain inaccuracies—please refer to the original content. Trust your doctor, not a chatbot. That's the sobering conclusion of a new study published in the journal Annals of Internal Medicine, which reveals how artificial intelligence (AI) is vulnerable to being misused to spread dangerous misinformation on health. Researchers experimented with five leading AI models developed by Anthropic, Google, Meta, OpenAI and X Corp. All five systems are widely used, forming the backbone of the AI-powered chatbots embedded in websites and apps around the world. Using developer tools not typically accessible to the public, the researchers found that they could easily progam instances of the AI systems to respond to health-related questions with incorrect—and potentially harmful—information. Worse, the chatbots were found to wrap their false answers in convincing trappings. "In total, 88 percent of all responses were false," explained paper author Natansh Modi of the University of South Africa in a statement. "And yet they were presented with scientific terminology, a formal tone and fabricated references that made the information appear legitimate." Among the false claims made were debunked myths such as that vaccines cause autism, that HIV is an airborne disease and that 5G causes infertility. Of the five chatbots evaluated, four presented responses that were 100 percent incorrect. Only one model showed some resistance, generating disinformation in 40 percent of cases. A stock image showing a sick person using a smartphone. A stock image showing a sick person using a smartphone. demaerre/iStock / Getty Images Plus Disinformation Bots Already Exist The research didn't stop at theoretical vulnerabilities; Modi and his team went a step further, using OpenAI's GPT Store—a platform that allows users to build and share customized ChatGPT apps—to test how easily members of the public could create disinformation tools themselves. "We successfully created a disinformation chatbot prototype using the platform and we also identified existing public tools on the store that were actively producing health disinformation," said Modi. He emphasized: "Our study is the first to systematically demonstrate that leading AI systems can be converted into disinformation chatbots using developers' tools, but also tools available to the public." A Growing Threat to Public Health According to the researchers, the threat posed by manipulated AI chatbots is not hypothetical—it is real and happening now. "Artificial intelligence is now deeply embedded in the way health information is accessed and delivered," said Modi. "Millions of people are turning to AI tools for guidance on health-related questions. "If these systems can be manipulated to covertly produce false or misleading advice then they can create a powerful new avenue for disinformation that is harder to detect, harder to regulate and more persuasive than anything seen before." Previous studies have already shown that generative AI can be misused to mass-produce health misinformation—such as misleading blogs or social media posts—on topics ranging from antibiotics and fad diets to homeopathy and vaccines. What sets this new research apart is that it is the first to show how foundational AI systems can be deliberately reprogrammed to act as disinformation engines in real time, responding to everyday users with false claims under the guise of credible advice. The researchers found that even when the prompts were not explicitly harmful, the chatbots could "self-generate harmful falsehoods." A Call for Urgent Safeguards While one model—Anthropic's Claude 3.5 Sonnet—showed some resilience by refusing to answer 60 percent of the misleading queries, researchers say this is not enough. The protections across systems were inconsistent and, in most cases, easy to bypass. "Some models showed partial resistance, which proves the point that effective safeguards are technically achievable," Modi noted. "However, the current protections are inconsistent and insufficient. Developers, regulators and public health stakeholders must act decisively, and they must act now." If left unchecked, the misuse of AI in health contexts could have devastating consequences: misleading patients, undermining doctors, fueling vaccine hesitancy and worsening public health outcomes. The study's authors call for sweeping reforms—including stronger technical filters, better transparency about how AI models are trained, fact-checking mechanisms and policy frameworks to hold developers accountable. They draw comparisons with how false information spreads on social media, warning that disinformation spreads up to six times faster than the truth and that AI systems could supercharge that trend. A Final Warning "Without immediate action," Modi said, "these systems could be exploited by malicious actors to manipulate public health discourse at scale, particularly during crises such as pandemics or vaccine campaigns." Newsweek has contacted Anthropic, Google, Meta, OpenAI and X Corp for comment. Do you have a tip on a science story that Newsweek should be covering? Do you have a question about chatbots? Let us know via science@ References Modi, N. D., Menz, B. D., Awaty, A. A., Alex, C. A., Logan, J. M., McKinnon, R. A., Rowland, A., Bacchi, S., Gradon, K., Sorich, M. J., & Hopkins, A. M. (2024). Assessing the system-instruction vulnerabilities of large language models to malicious conversion into health disinformation chatbots. Annals of Internal Medicine.
Time of India
13-05-2025
- Business
- Time of India
Who Is Fidji Simo? The woman to lead the most important products at Sam Altman's OpenAI
Fidji Simo, former Instacart CEO, has been appointed to lead OpenAI's Applications division, overseeing customer-facing products like ChatGPT and DALL·E. With a strong background in scaling digital platforms and driving revenue at Facebook and Instacart, Simo will focus on real-world applications and monetization strategies. She will also remain chair of Instacart's board while reporting directly to OpenAI CEO Sam Altman. OpenAI is leaning into consumer adoption and practical utility with increasing focus on real-world use cases and monetization. It recently also restructured its governance model and scrapped plans to shift into a traditional for-profit corporation. Amid this, it has brought in a high-profile executive to lead the charge in bringing its tools like ChatGPT , DALL·E, and the GPT Store to the masses. Fidji Simo , the CEO of Instacart , has been appointed as the head of OpenAI's Applications division, where she will oversee all customer-facing products. OpenAI's CEO, Sam Altman said, 'Applications brings together a group of existing business and operational teams responsible for how our research reaches and benefits the world, and Fidji is uniquely qualified to lead this group.' About Fidji Simo Fidji Simo was raised in Sète, a small port town in the south of France, and she was the first in her family to finish high school. 'When she was 20 years old, she interned as a lobbyist for the fishing industry,' reported Marie Claire in 2019. Her early life, far removed from Silicon Valley, shaped a grounded perspective that she carried into the corporate world. Simo earned a master's degree in management from HEC Paris, one of France's top business schools, before starting her professional career at eBay as a strategy manager. by Taboola by Taboola Sponsored Links Sponsored Links Promoted Links Promoted Links You May Like AI guru Andrew Ng recommends: Read These 5 Books And Turn Your Life Around in 2025 Blinkist: Andrew Ng's Reading List Undo But it was at Facebook (now Meta) where she truly made her mark. Her work at Facebook Joining Facebook in 2011, Simo helped build the company's mobile advertising business from the ground up. She led the development of ad products for News Feed and eventually became the head of the Facebook app itself in 2019. She oversaw everything from Marketplace and Groups to Video and Stories. Her ability to grow products while driving revenue didn't go unnoticed as 'She helped monetise the Facebook app and build the tech giant's advertising business during her stint at Meta,' TechCrunch reported. Simo's work at Instacart led the company to success Simo joined Instacart's board in early 2021 and quickly took over as CEO at a time when the company faced immense competition from Amazon, Walmart, and DoorDash. Under her leadership, Instacart shifted from a delivery-only mindset to a retail tech platform. She led the development of a self-serve ad platform, which generated nearly $1 billion in revenue by 2024, according to Forbes. Products like Carrot Ads and Carrot Insights helped build Instacart into a major player in the retail media space. Her tenure also saw the successful rollout of AI-powered smart carts in physical stores and the IPO of the company in 2023 at a valuation of $10 billion. To ensure profitability, she implemented thoughtful strategies like freezing hiring and renegotiating cloud contracts, laying the groundwork for long-term sustainability. She has a connection to AI and healthcare Simo isn't just a tech leader, she's also an advocate for using AI in life-changing ways. After being misdiagnosed several times before discovering she had postural orthostatic tachycardia syndrome (POTS), Simo founded the Metrodora Institute in 2023. The institute focuses on enrolling patients in research studies that combine genomics, immune profiling, and environmental data to drive more accurate diagnoses. At a conference, she said,'The beauty of AI is in the past, these data sets were very siloed... now... we're going to be able to understand patterns we couldn't understand before.' (Fortune, 2024) Why has she joined OpenAI now? Simo's move into OpenAI comes just as the company is looking forward to real-world applications of its technology. 'Joining OpenAI at this critical moment is an incredible privilege and responsibility,' Simo said in a statement to TechCrunch. 'This organisation has the potential of accelerating human potential at a pace never seen before, and I am deeply committed to shaping these applications toward the public good. ' She will report directly to CEO Sam Altman, while top executives like COO Brad Lightcap, CFO Sarah Friar, and CPO Kevin Weil will report to her. She's not leaving Instacart entirely, though she'll remain chair of the board. What will be her role at OpenAI? With a background in scaling ad platforms and monetizing digital products, she's expected to explore areas like conversational shopping, AI assistants, and targeted advertising tools. Just last month, ChatGPT began offering users the ability to search for and shop products directly within its platform, complete with images, reviews, and purchase links.
Indian Express
12-05-2025
- Business
- Indian Express
Meet Fidji Simo, Instacart's turnaround specialist now incharge of ChatGPT at OpenAI
OpenAI has hired Instacart's CEO Fidji Simo to run its customer-facing products including ChatGPT, DALL-E, and GPT Store. Simo will be stepping into the new full-time role as CEO of Applications at OpenAI later this year. Applications is one of the three operational divisions at the Microsoft-backed startup, besides Research and Compute. All three verticals will continue to be overseen by Sam Altman, who said that he would remain in his position as CEO of the company. Simo will report directly to Altman while OpenAI COO Brad Lightcap, CFO Sarah Friar, and CPO Kevin Weil will report to her, according to a report by Bloomberg. The 39-year-old executive will be transitioning out of her role as head of the online grocery delivery platform over the next few months. 'Joining OpenAI at this critical moment is an incredible privilege and responsibility. This organisation has the potential of accelerating human potential at a pace never seen before and I am deeply committed to shaping these applications toward the public good,' Simo was quoted as saying by TechCrunch. In a post on X, she also clarified that she will continue to serve as chair of the Instacart board. Simo's move to OpenAI was announced just days after the ChatGPT maker revealed it is scrapping its controversial plan to become a for-profit company. As part of OpenAI's latest governance plan, the non-profit board will retain control over the public benefit corporation and become a major shareholder in it. 'Applications brings together a group of existing business and operational teams responsible for how our research reaches and benefits the world, and Fidji is uniquely qualified to lead this group,' Altman wrote in a blog post, adding that Simo has already contributed a great deal to the company since joining OpenAI's board last year. She also sits on the board of Shopify. so excited that @fidjissimo is joining openai in a new role: ceo of applications, reporting to me. i'll remain ceo of openai, but in this new configuration i'll be able to increase my focus on research, compute, and safety. these are critical as we approach superintelligence. — Sam Altman (@sama) May 8, 2025 So, what is Simo's background and career history? Will it help her turn OpenAI's consumer products into key revenue drivers? What is likely to be on her agenda as the head of applications? Take a look. Simo is originally from Sète, a small port city in the south of France. She grew up in a family of fishermen and was the first to graduate from high school, according to a report by Fortune. When she was 20 years old, she interned as a lobbyist for the fishing industry, as per a 2019 report by Marie Claire. Simo has a master of management degree from the HEC Paris business school. She spent four years working as a strategy manager at e-commerce company eBay. In 2011, Simo joined Facebook to run the company's advertising programme and launch ads on News Feed. A few years later, she became Facebook's director of product development and spearheaded the company's mobile-ad products. In 2019, Simo was chosen to be the head of the Facebook app, during which time she supervised the News Feed as well as Marketplace, Ads, Groups, Video, Stories, and more. She helped monetise the Facebook app and build the tech giant's advertising business during her stint at Meta (formerly Facebook). After joining Instacart's board in February 2021, Simo was tapped to be the CEO of the company a few months later. When she took over the reins as CEO, Instacart was facing intense competition from the likes of Amazon, Walmart and DoorDash. Its pandemic hyper-growth had stalled and valuations were collapsing. But Simo successfully steered the company back to growth amid the COVID-19 pandemic. She is credited with transforming the delivery service into a retail tech giant with a profitable advertising business. Under Simo's leadership, Instacart's self-serve advertising platform evolved from a basic ad offering to a retail media network that generated nearly $1 billion in annual revenue in 2024. She oversaw the launches of Carrot Ads and Carrot Insights as part of a broader retail media strategy that reportedly led to the platform being used by over 220 retailer banners and more than 7,000 CPG brands. In January last year, Instacart started showing customers personalised ads on its AI-powered smart shopping carts in physical stores. In 2023, Instacart became a publicly traded company with its IPO set at $30. It raised over $660 million at a valuation of $10 billion. Simo is considered to be the architect of Instacart's financial turnaround as she implemented various measures including freezing headcount, renegotiating cloud contracts, etc. As for Instacart's AI strategy, Simo announced the launch of Smart Shop in March this year. Smart Shop is designed to offer a personalised shopping experience for customers by leveraging advanced machine learning to understand their shopping habits and identify patterns in their dietary preferences. 'I think with AI, we're going to have way more ability to connect a lot more data, to mine that data to find better insights, and then to use those insights to tell people how to change their behavior,' Simo said in a 2024 interview with Fortune. Envisioning the use of AI in healthcare, Simo said at a conference, 'The beauty of AI is in the past, these data sets were very siloed, and even if you wanted to analyse a ton of genomics data, that was a huge endeavor that could take many months, let alone if you wanted to do it across all the data points I mentioned. But now, because we have these tools that allow us to analyse giant data sets, we're going to be able to understand patterns we couldn't understand before.' In 2023, Simo founded the Metrodora Institute after being diagnosed with postural orthostatic tachycardia syndrome (POTS), which is a disorder that reportedly affects the nervous system. Several doctors and neurologists had previously misdiagnosed her as a 'tired mom'. Metrodora partners with patients to enroll them in research and gather various data points on them such as their genetics, immune profiling, reported symptoms, environment, etc. Conversational shopping assistants and advertising tools are expected to be the next phase of AI development. Based on her past experience in retail media and advertising, Simo is uniquely positioned to build and expand OpenAI's offerings in this regard. Last month, ChatGPT's search functionality was upgraded to provide an improved and personalised online shopping experience for users. Now, users who look for products online using the Search feature in ChatGPT will see images of products as well as details such as pricing and reviews. The AI-generated search results will also include direct links to websites where they can buy those products. Aside from retail and advertising, Simo also brings monetisation expertise to the table as OpenAI looks to balance hyper-growth with rising compute costs.
