California Senate passes bill that aims to make AI chatbots safer
The Senate passed a bill that aims to make chatbots used for companionship safer after parents raised concerns that virtual characters harmed their childrens' mental health.
The legislation, which now heads to the California State Assembly, shows how state lawmakers are tackling safety concerns surrounding AI as tech companies release more AI-powered tools.
'The country is watching again for California to lead,' said Sen. Steve Padilla (D-Chula Vista), one of the lawmakers who introduced the bill, on the Senate floor.
At the same time, lawmakers are trying to balance concerns that they could be hindering innovation. Groups opposed to the bill such as the Electronic Frontier Foundation say the legislation is too broad and would run into free speech issues, according to a Senate floor analysis of the bill.
Under Senate Bill 243, operators of companion chatbot platforms would remind users at least every three hours that the virtual characters aren't human. They would also disclose that companion chatbots might not be suitable for some minors.
Platforms would also need to take other steps such as implementing a protocol for addressing suicidal ideation, suicide or self-harm expressed by users. That includes showing users suicide prevention resources.
The operator of these platforms would also report the number of times a companion chatbot brought up suicide ideation or actions with a user, along with other requirements.
Dr. Akilah Weber Pierson, one of the bill's co-authors, said she supports innovation but it also must come with 'ethical responsibility.' Chatbots, the senator said, are engineered to hold people's attention including children.
'When a child begins to prefer interacting with AI over real human relationships, that is very concerning,' said Sen. Weber Pierson (D-La Mesa).
The bill defines companion chatbots as AI systems capable of meeting the social needs of users. It excludes chatbots that businesses use for customer service.
The legislation garnered support from parents who lost their children after they started chatting with chatbots. One of those parents is Megan Garcia, a Florida mom who sued Google and Character.AI after her son Sewell Setzer III died by suicide last year.
In the lawsuit, she alleges the platform's chatbots harmed her son's mental health and failed to notify her or offer help when he expressed suicidal thoughts to these virtual characters.
Character.AI, based in Menlo Park, Calif., is a platform where people can create and interact with digital characters that mimic real and fictional people. The company has said that it takes teen safety seriously and rolled out a feature that gives parents more information about the amount of time their children are spending with chatbots on the platform.
Character.AI asked a federal court to dismiss the lawsuit, but a federal judge in May allowed the case to proceed.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
New York Post
11 minutes ago
- New York Post
RNC chair Michael Whatley launches NC Senate bid, opening door to new leadership
WASHINGTON — Republican National Committee Chair Michael Whatley has formally kicked off his bid for the hotly-contested North Carolina Senate seat, opening the door for new leadership at the top of the official GOP. Whatley can remain RNC chair up until the vote for his replacement, which has yet to be officially scheduled. His departure will mark yet another change in leadership, as Lara Trump stepped down as RNC co-chair in December in favor of a weekend hosting gig on Fox News. Democrats have not won a Senate seat in North Carolina since 2008, but have high hopes of replacing retiring GOP Sen. Thom Tillis with former Gov. Roy Cooper. An initial poll by Emerson College released Friday showed Cooper leading Whatley by six percentage points among all voters (47%-41%) with 12% undecided. 3 President Donald Trump, left, takes the stage with NCGOP Chairman Michael Whatley after being announced at the NCGOP state convention on June 5, 2021 in Greenville, North Carolina. Getty Images To replace Whatley, President Trump has backed Florida state Sen. Joe Gruters, the current RNC treasurer. Gruters, 48, has made headlines in the Sunshine State for his tense relationship with Gov. Ron DeSantis, who called him out July 16 by saying: 'Gruters has taken major positions contrary to what our voter base wants to do.' The governor specifically criticized Gruters for opposing legislation to reduce the power of teachers' unions in the state and campaigning for a constitutional amendment that would have largely decriminalized marijuana in Florida. Gruters also was at the center of a fight between DeSantis and the Republican-controlled Florida legislature over illegal immigration after lawmakers initially rejected an enforcement proposal by the governor in favor of legislation that would have weakened DeSantis' power. 'He was the author and architect of this terrible amnesty bill, which would have made everything I've done — including Alligator Alcatraz — to help President Trump's illegal immigration removal agenda illegal in the state of Florida,' DeSantis said July 16. On Friday, however, Trump praised Gruters on Truth Social as a 'MAGA Warrior … who has been with us from the very beginning.' 3 Florida state Sen. Joe Gruters, of Sarasota, was reelected in August 2022, with the help of an endorsement from Donald Trump. THOMAS BENDER/HERALD-TRIBUNE / USA TODAY NETWORK / USA TODAY NETWORK via Imagn Images 'As State Senator and Chairman of the Republican Party of Florida, Joe helped us deliver massive and historic Victories across the State, including my three BIG WINS in 2016, 2020, and 2024!' Trump wrote. 'As RNC Treasurer, Joe has been a Fierce Advocate for our Movement, and fought tirelessly to ensure a highly functioning, fiscally responsible, and financially successful RNC. He will be a wonderful Chairman!' The new chair will lead the party into the 2026 midterms, with Trump saying he has high hopes for Republicans to 'increase their margins' in both the House and Senate. The new chair will be aided by Trump's $1.4 billion war chest that will be used to back some of his 'friends' running across the country. 3 People wave their signs during Republican National Committee Chairman Michael Whatley's campaign launch event for North Carolina's open US Senate seat, Thursday, July 31, 2025, in Gastonia, N.C. AP To replace Gruters as RNC Treasurer, Trump endorsed Jennifer Saul-Rich, who has served as a national committee woman from New York since 2004. 'Joe Gruters and Jennifer Saul-Rich are 100% America First, and I know they will do an incredible job, and secure Great Success for Republicans all across our Country,' Trump wrote. 'Joe and Jennifer have my Complete and Total Endorsement — THEY WILL NEVER LET YOU DOWN!'.
Yahoo
29 minutes ago
- Yahoo
GOP senators reject Trump's pitch to use tariff revenue for ‘rebates'
President Donald Trump has discussed using revenue from new tariffs to send 'rebates' to Americans - but Republicans in the Senate aren't leaping at the idea. The U.S. government has taken in more than $93 billion from tariffs through mid-July, and most GOP lawmakers want to put all of that toward reducing the national debt, which is over $36 trillion. The debt is expected to grow by an additional $3.4 trillion over the next decade because of Republicans' sweeping tax and immigration bill, enacted this month. Subscribe to The Post Most newsletter for the most important and interesting stories from The Washington Post. 'The big thing we want to do is pay down debt, but we're thinking about a rebate,' Trump told reporters last week. 'We have so much money coming in from tariffs that a little rebate for people of a certain income level might be really nice.' Congress would need to pass legislation to make the proposal a reality, though, as it did in response to the coronavirus pandemic. In 2020, during Trump's first term, and in 2021, under President Joe Biden, Congress approved three 'economic impact payments' to Americans. Sen. Josh Hawley (R-Missouri) introduced a bill Monday modeled after those payments to give taxpayers a $600 tax rebate using tariff revenue, including $600 for each dependent child. Under the proposal, a family of four would receive $2,400. 'Why not reward the working people who have taken it in the shins for the last four years and give them something out of this? I think they need it and deserve it,' Hawley said Tuesday. But most Republican senators said the first priority should be digging out of debt. 'We're $37 trillion in debt. We're running deficits close to $2 trillion. I wouldn't support it,' Sen. Ron Johnson (R-Wisconsin) said. 'At some point in time, this madness has to end.' A White House spokesman did not immediately return a request for comment on the GOP reticence. In general, American companies that import goods from other countries pay for tariffs. They usually pass along the increased cost to consumers. Sometimes, overseas manufacturers also absorb some of the costs. Both the U.S. and global economies have been resilient to the administration's tariffs so far, in part because companies stockpiled goods earlier this year to stave off expected import tax increases. Experts say prices could rise soon as those supplies dwindle. Consumer prices rose by 2.7 percent in June over the previous year, up from a 2.4 percent annualized increase in May, according to the Labor Department. Some senators said tariff rebates aren't yet needed, because consumer confidence has recently rebounded. 'I just don't know that they're necessary. The folks back home don't feel like they're being hurt by tariffs, just the opposite. Prices have stabilized,' Sen. Roger Marshall (R-Kansas) said. The best use of the tariff funds, he said: 'Pay down the debt.' Sen. James Lankford (R-Oklahoma) said there's no way to equally divide revenue to help those who have been hit by higher prices from tariffs while bypassing those who haven't. 'I think it's a bad idea,' he said. Not all senators were against the idea: Sen. Eric Schmitt (R-Missouri), a close Trump ally, said he agrees with sending tariff proceeds back to voters. 'I think it's also an acknowledgment that all the experts have been totally wrong about this, that the tariffs were going to be a disaster,' he said. And Sen. Jeanne Shaheen (New Hampshire), the top Democrat on the Senate Foreign Relations Committee, said tariff revenue should 'go back to the people who are paying the tariffs, the United States, all of those consumers who are going to get hit.' However, most Democrats were quick to call Republicans hypocritical for backing Trump's tax legislation, which is expected to hurt low-income households' finances more than it helps them. 'I would support a bill that lowers costs for American families paid for by rolling back those trillions of dollars of tax cuts for billionaires and billionaire corporations,' said Sen. Elizabeth Warren (D-Massachusetts). 'If the Republicans have in mind some way to help families lower costs, I'd like to see it.' Related Content Diplomas, proud parents: High school graduation in the D.C. jail Kamala Harris will not run for California governor, opening door for 2028 run The U.S. military is investing in this Pacific island. So is China.
USA Today
42 minutes ago
- USA Today
'DO YOUR JOB': Trump urges senators to skip summer break
Senate Republicans have a major backlog of nominations as Democrats drag their feet, frustrating the president. WASHINGTON − President Donald Trump again called for senators to stay in town and bypass their usual, month-long summer break to push through a backlog of judicial confirmations. "The Senate must stay in Session, taking no recess, until the entire Executive Calendar is CLEAR!!!" Trump wrote in a Truth Social post July 31. "Republicans, for the health and safety of the USA, DO YOUR JOB, and confirm All Nominees," he added. "They should NOT BE FORCED TO WAIT." As August approached, Republicans had a logjam of at least 130 nominees, according to Politico. Normally, the process of confirming most lower-level judicial nominees would move at a faster pace with some bipartisan agreement moving things along. But this year, Democrats are dragging their feet, frustrated by Republicans advancing Trump's agenda items like a sweeping tax bill and $9 billion in spending cuts. The delays have frustrated Trump, who called earlier in July for Senate Majority Leader John Thune, R-South Dakota, to cancel the chamber's August recess. The president also lashed out on social media against Republican Sen. Chuck Grassley of Iowa, urging the Senate Judiciary Committee chair to ditch a longstanding confirmation practice to expedite the process. "Senator Grassley must step up," Trump wrote in a July 29 post. "He should do this, IMMEDIATELY, and not let the Democrats laugh at him and the Republican Party for being weak and ineffective." Grassley said the next day during a committee hearing he was "offended by what the president said" and "disappointed that it would result in personal insults." To progress through Trump's list of nominees, Thune has left the door open to cutting into senators' break, along with other options such as changing Senate rules. 'I think everything is on the table,' Thune told reporters July 31. Lawmakers often use their beloved summer breaks to return home and reconnect with constituents in person. The prospect of staying extra days or weeks in Washington would likely be met with resistance from members on both sides of the aisle. However, some senators say they would be willing to stick around as needed. 'I'm for staying and doing what we need to do,' Sen. Tommy Tuberville, R-Alabama, told USA TODAY. 'They pay us to work. They don't pay us to go home and sit for a month.'
