Grok shows 'flaws' in fact-checking Israel-Iran war: study
Elon Musk's AI chatbot Grok produced inaccurate and contradictory responses when users sought to fact-check the Israel-Iran conflict, a study said Tuesday, raising fresh doubts about its reliability as a debunking tool.
With tech platforms reducing their reliance on human fact-checkers, users are increasingly utilizing AI-powered chatbots — including xAI's Grok — in search of reliable information, but their responses are often themselves prone to misinformation.
"The investigation into Grok's performance during the first days of the Israel-Iran conflict exposes significant flaws and limitations in the AI chatbot's ability to provide accurate, reliable, and consistent information during times of crisis," said the study from the Digital Forensic Research Lab (DFRLab) of the Atlantic Council, an American think tank.
"Grok demonstrated that it struggles with verifying already-confirmed facts, analyzing fake visuals, and avoiding unsubstantiated claims."
The DFRLab analyzed around 130,000 posts in various languages on the platform X, where the AI assistant is built in, to find that Grok was "struggling to authenticate AI-generated media."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Express Tribune
2 days ago
- Express Tribune
Grok churns out fake facts about Israel-Iran war
Elon Musk's AI chatbot Grok produced inaccurate and contradictory responses when users sought to fact-check the Israel-Iran conflict, a study said on Tuesday, raising fresh doubts about its reliability as a debunking tool. With tech platforms reducing their reliance on human fact-checkers, users are increasingly utilising AI-powered chatbots – including xAI's Grok – in search of reliable information, but their responses are often themselves prone to misinformation. "The investigation into Grok's performance during the first days of the Israel-Iran conflict exposes significant flaws and limitations in the AI chatbot's ability to provide accurate, reliable, and consistent information during times of crisis," said the study from the Digital Forensic Research Lab (DFRLab) of the Atlantic Council, an American think tank. "Grok demonstrated that it struggles with verifying already-confirmed facts, analysing fake visuals, and avoiding unsubstantiated claims." The DFRLab analysed around 130,000 posts in various languages on the platform X, where the AI assistant is built in, to find that Grok was "struggling to authenticate AI-generated media." Following Iran's retaliatory strikes on Israel, Grok offered vastly different responses to similar prompts about an AI-generated video of a destroyed airport that amassed millions of views on X, the study found. It oscillated – sometimes within the same minute – between denying the airport's destruction and confirming it had been damaged by strikes, the study said. In some responses, Grok cited a missile launched by Yemeni rebels as the source of the damage. In others, it wrongly identified the AI-generated airport as one in Beirut, Gaza, or Tehran. When users shared another AI-generated video depicting buildings collapsing after an alleged Iranian strike on Tel Aviv, Grok responded that it appeared to be real, the study said. The Israel-Iran conflict, which led to US airstrikes against Tehran's nuclear program over the weekend, has churned out an avalanche of online misinformation including AI-generated videos and war visuals recycled from other conflicts. AI chatbots also amplified falsehoods. As the Israel-Iran war intensified, false claims spread across social media that China had dispatched military cargo planes to Tehran to offer its support. When users asked the AI-operated X accounts of AI companies Perplexity and Grok about its validity, both wrongly responded that the claims were true, according to disinformation watchdog NewsGuard. Researchers say Grok has previously made errors verifying information related to crises such as the recent India-Pakistan conflict and anti-immigration protests in Los Angeles. Last month, Grok was under renewed scrutiny for inserting "white genocide" in South Africa, a far-right conspiracy theory, into unrelated queries.
Express Tribune
3 days ago
- Express Tribune
Grok shows 'flaws' in fact-checking Israel-Iran war: study
Elon Musk's AI chatbot Grok produced inaccurate and contradictory responses when users sought to fact-check the Israel-Iran conflict, a study said Tuesday, raising fresh doubts about its reliability as a debunking tool. With tech platforms reducing their reliance on human fact-checkers, users are increasingly utilizing AI-powered chatbots — including xAI's Grok — in search of reliable information, but their responses are often themselves prone to misinformation. "The investigation into Grok's performance during the first days of the Israel-Iran conflict exposes significant flaws and limitations in the AI chatbot's ability to provide accurate, reliable, and consistent information during times of crisis," said the study from the Digital Forensic Research Lab (DFRLab) of the Atlantic Council, an American think tank. "Grok demonstrated that it struggles with verifying already-confirmed facts, analyzing fake visuals, and avoiding unsubstantiated claims." The DFRLab analyzed around 130,000 posts in various languages on the platform X, where the AI assistant is built in, to find that Grok was "struggling to authenticate AI-generated media."
Business Recorder
4 days ago
- Business Recorder
OpenAI says China's Zhipu AI gaining ground amid Beijing's global AI push
OpenAI said on Wednesday its analysts have seen notable progress by Chinese start-up Zhipu AI in securing government contracts across several regions, signaling China's growing momentum in pursuing global AI leadership. Zhipu AI, which is backed by the Chinese Communist Party, aims to 'lock Chinese systems and standards into emerging markets before U.S. or European rivals can, while showcasing a 'responsible, transparent and audit-ready' Chinese AI alternative,' the ChatGPT maker said in its post. The company provides AI solutions — including sovereign large language model infrastructure and private hardware in partnership with Huawei — to governments and state-owned enterprises in Malaysia, Singapore, the UAE, Saudi Arabia and Kenya. The initiative forms part of China's broader effort to build a self-sufficient, globally competitive AI ecosystem that rivals the United States while reducing reliance on American technology. China's DeepSeek releases an update to its R1 reasoning model Zhipu AI, which did not immediately respond to a request for comment, is supported by more than $1.4 billion in state investment and maintains strong ties with the Chinese government and state-owned entities, according to OpenAI. In January, the company was added to the U.S. Commerce Department's export control entity list, barring it from procuring U.S. components. Zhipu AI has been positioning itself among China's leading AI firms alongside DeepSeek, Moonshot AI, and Minimax, as well as tech giants ByteDance and Alibaba. OpenAI has also built partnerships and attracted investment across the Middle East and Asia. Its 'OpenAI for Countries' initiative helps interested governments develop 'sovereign AI capability' in coordination with the U.S. government. The report comes as the U.S. and China engage in intense competition in the rapidly evolving AI landscape, with both nations vying for technological dominance.
