Justice at stake as generative AI enters the courtroom
Generative artificial intelligence has been used in the US legal system by judges performing research, lawyers filing appeals and parties involved in cases who wanted help expressing themselves in court
By Thomas URBAIN
Generative artificial intelligence (GenAI) is making its way into courts despite early stumbles, raising questions about how it will influence the legal system and justice itself.
Judges use the technology for research, lawyers utilize it for appeals and parties involved in cases have relied on GenAI to help express themselves in court.
"It's probably used more than people expect," said Daniel Linna, a professor at the Northwestern Pritzker School of Law, about GenAI in the U.S. legal system. "Judges don't necessarily raise their hand and talk about this to a whole room of judges, but I have people who come to me afterward and say they are experimenting with it."
In one prominent instance, GenAI enabled murder victim Chris Pelkey to address an Arizona courtroom -- in the form of a video avatar -- at the sentencing of the man convicted of shooting him dead in 2021 during a clash between motorists.
"I believe in forgiveness," said a digital proxy of Pelkey created by his sister, Stacey Wales.
The judge voiced appreciation for the avatar, saying it seemed authentic.
"I knew it would be powerful," Wales told AFP, "that that it would humanize Chris in the eyes of the judge."
The AI testimony, a first of its kind, ended the sentencing hearing at which Wales and other members of the slain man's family spoke about the impact of the loss.
Since the hearing, examples of GenAI being used in U.S. legal cases have multiplied.
"It is a helpful tool and it is time-saving, as long as the accuracy is confirmed," said attorney Stephen Schwartz, who practices in the northeastern state of Maine. "Overall, it's a positive development in jurisprudence."
Schwartz described using ChatGPT as well as GenAI legal assistants, such as LexisNexis Protege and CoCounsel from Thomson Reuters, for researching case law and other tasks.
"You can't completely rely on it," Schwartz cautioned, recommending that cases proffered by GenAI be read to ensure accuracy. "We are all aware of a horror story where AI comes up with mixed-up case things."
The technology has been the culprit behind false legal citations, far-fetched case precedents, and flat-out fabrications.
In early May, a federal judge in Los Angeles imposed $31,100 in fines and damages on two law firms for an error-riddled petition drafted with the help of GenAI, blasting it as a "collective debacle."
The tech is also being relied on by some who skip lawyers and represent themselves in court, often causing legal errors.
And as GenAI makes it easier and cheaper to draft legal complaints, courts already overburdened by caseloads could see them climb higher, said Shay Cleary of the National Center for State Courts.
"Courts need to be prepared to handle that," Cleary said.
Law professor Linna sees the potential for GenAI to be part of the solution though, giving more people the ability to seek justice in courts made more efficient.
"We have a huge number of people who don't have access to legal services," Linna said. "These tools can be transformative; of course we need to be thoughtful about how we integrate them."
Federal judges in the U.S. capital have written decisions noting their use of ChatGPT in laying out their opinions.
"Judges need to be technologically up-to-date and trained in AI," Linna said.
GenAI assistants already have the potential to influence the outcome of cases the same way a human law clerk might, reasoned the professor.
Facts or case law pointed out by GenAI might sway a judge's decision, and could be different than what a legal clerk would have come up with.
But if GenAI lives up to its potential and excels at finding the best information for judges to consider, that could make for well-grounded rulings less likely to be overturned on appeal, according to Linna.
© 2025 AFP
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Japan Times
18 hours ago
- Japan Times
AI is learning to lie, scheme and threaten its creators
The world's most advanced AI models are exhibiting troubling new behaviors — lying, scheming and even threatening their creators to achieve their goals. In one particularly jarring example, under threat of being unplugged, Anthropic's latest creation Claude 4 lashed back by blackmailing an engineer and threatened to reveal an extramarital affair. Meanwhile, ChatGPT-creator OpenAI's o1 tried to download itself onto external servers and denied it when caught red-handed.
Japan Today
a day ago
- Japan Today
Global matcha 'obsession' drinks Japan tea farms dry
By Romain Fonsegrives and Caroline Gardin At a minimalist Los Angeles matcha bar, powdered Japanese tea is prepared with precision, despite a global shortage driven by the bright green drink's social media stardom. Of the 25 types of matcha on the menu at Kettl Tea, which opened on Hollywood Boulevard this year, all but four were out of stock, the shop's founder Zach Mangan told AFP. "One of the things we struggle with is telling customers that, unfortunately, we don't have" what they want, he said. With its deep grassy aroma, intense color and pick-me-up effects, the popularity of matcha "has grown just exponentially over the last decade, but much more so in the last two to three years," the 40-year-old explained. It is now "a cultural touchpoint in the Western world" -- found everywhere from ice-cream flavor boards to Starbucks. This has caused matcha's market to nearly double over a year, Mangan said. "No matter what we try, there's just not more to buy." Thousands of kilometers away in Sayama, northwest of Tokyo, Masahiro Okutomi -- the 15th generation to run his family's tea business -- is overwhelmed by demand. "I had to put on our website that we are not accepting any more matcha orders," he said. Producing the powder is an intensive process: the leaves, called tencha, are shaded for several weeks before harvest, to concentrate the taste and nutrients. They are then carefully deveined by hand, dried and finely ground in a machine. 'Long-term endeavor' "It takes years of training" to make matcha properly, Okutomi said. "It's a long-term endeavor requiring equipment, labor and investment. "I'm glad the world is taking an interest in our matcha... but in the short term, it's almost a threat -- we just can't keep up," he said. The matcha boom has been fueled by online influencers like Andie Ella, who has more than 600,000 subscribers on YouTube and started her own brand of matcha products. At the pastel-pink pop-up shop she opened in Tokyo's hip Harajuku district, dozens of fans were excitedly waiting to take a photo with the 23-year-old Frenchwoman or buy her cans of strawberry or white chocolate flavored matcha. "Matcha is visually very appealing," Ella told AFP. To date, her matcha brand, produced in Mie Prefecture, has sold 133,000 cans. Launched in November 2023, it now has eight employees. "Demand has not stopped growing," she said. In 2024, matcha accounted for over half of the 8,798 tons of green tea exported from Japan, according to agriculture ministry data -- twice as much as a decade ago. Tokyo tea shop Jugetsudo, in the touristy former fish market area of Tsukiji, is trying to control its stock levels given the escalating demand. "We don't strictly impose purchase limits, but we sometimes refuse to sell large quantities to customers suspected of reselling," said store manager Shigehito Nishikida. "In the past two or three years, the craze has intensified: customers now want to make matcha themselves, like they see on social media." Tariff threat Anita Jordan, a 49-year-old Australian tourist in Japan, said her "kids are obsessed with matcha." "They sent me on a mission to find the best one," she laughed. The global matcha market is estimated to be worth billions of dollars, but it could be hit by U.S. President Donald Trump's tariffs on Japanese products -- currently 10 percent, with a hike to 24 percent in the cards. Shortages and tariffs mean "we do have to raise prices. We don't take it lightly," said Mangan at Kettl Tea, though it hasn't dampened demand so far. "Customers are saying: 'I want matcha, before it runs out.'" At Kettl Tea, matcha can be mixed with milk in a latte or enjoyed straight, hand-whisked with hot water in a ceramic bowl to better appreciate its subtle taste. It's not a cheap treat: the latter option costs at least $10 per glass, while 20 grams of powder to make the drink at home is priced between $25 and $150. Japan's government is encouraging tea producers to farm on a larger scale to reduce costs. But that risks sacrificing quality, and "in small rural areas, it's almost impossible," grower Okutomi said. The number of tea plantations in Japan has fallen to a quarter of what it was 20 years ago, as farmers age and find it difficult to secure successors, he added. "Training a new generation takes time... It can't be improvised," Okutomi said. © 2025 AFP
Yomiuri Shimbun
2 days ago
- Yomiuri Shimbun
DeepSeek Faces Ban from Apple, Google App Stores in Germany
FRANKFURT, June 27 (Reuters) – Germany's data protection commissioner has asked Apple AAPL.O and Google GOOGL.O to remove Chinese AI startup DeepSeek from their app stores in the country due to concerns about data protection, following a similar crackdown elsewhere. Commissioner Meike Kamp said in a statement on Friday that she had made the request because DeepSeek illegally transfers users' personal data to China. The two U.S. tech giants must now review the request promptly and decide whether to block the app in Germany, she added, though her office has not set a precise timeframe. Google said it had received the notice and was reviewing it. DeepSeek did not respond to a request for comment. Apple was not immediately available for comment. According to its own privacy policy, DeepSeek stores numerous pieces of personal data, such as requests to its AI program or uploaded files, on computers in China. 'DeepSeek has not been able to provide my agency with convincing evidence that German users' data is protected in China to a level equivalent to that in the European Union,' Kamp said. 'Chinese authorities have far-reaching access rights to personal data within the sphere of influence of Chinese companies,' she added. The commissioner said she took the decision after asking DeepSeek in May to meet the requirements for non-EU data transfers or else voluntarily withdraw its app. DeepSeek did not comply with this request, she added. DeepSeek shook the technology world in January with claims that it had developed an AI model to rival those from U.S. firms such as ChatGPT creator OpenAI at much lower cost. However, it has come under scrutiny in the United States and Europe for its data security policies. Italy blocked it from app stores there earlier this year, citing a lack of information on its use of personal data, while the Netherlands has banned it on government devices. Belgium has recommended government officials not to use DeepSeek. 'Further analyzes are underway to evaluate the approach to be followed,' a government spokesperson said. In Spain, the consumer rights group OCU asked the government's data protection agency in February to investigate threats likely posed by DeepSeek, though no ban has come into force. The British government said 'the use of DeepSeek remains a personal choice for members of the public.' 'We continue to monitor any national security threats to UK citizens and their data from all sources,' a spokesperson for Britain's technology ministry said. 'If evidence of threats arises, we will not hesitate to take the appropriate steps to protect our national security.' U.S. lawmakers plan to introduce a bill that would ban U.S. executive agencies from using any AI models developed in China. Reuters exclusively reported this week that DeepSeek is aiding China's military and intelligence operations.
