Read my lips: AI-dubbed films are debuting in cinemas
Dubbing critics have long grumbled about the pitfalls of mismatched audio and awkward lip-syncing, but new technology is quietly changing the face (and mouths) of international cinema.
Last week, Swedish sci-fi film Watch The Skies opened in US theatres – marketed as the world's first full-length theatrical feature to use AI for an immersive dubbing – a process that makes the characters look as though they are speaking English.
XYZ Films partnered with AI start-up Flawless, which uses TrueSync, a visual tool which alters the character's mouth movements and speech to appear perfectly synced for an English-speaking audience.
'For the movie industry, this is a game changer,' producer Albin Pettersson declared in a behind-the-scenes trailer for the film.
'The Swedish language is a barrier when you want to reach out around the world.'
It's important to note the AI tool has not replaced the actors – the original cast of Watch The Skies, having shot the film in Swedish, then recorded their English lines in a studio. This kept them compliant with SAG-AFTRA guidelines.
'I think a lot of filmmakers and a lot of actors will be afraid of this new technology at first,' added writer and director Victor Danell. 'But we have creative control and to act out the film in English was a real exciting experience.'
Watch The Skies is the start of a long list of AI-dubbed international film collaborations between XYZ Films and Flawless set to be released in the US. They include French film The Book of Solutions, Korean flick Smugglers, Persian-language film Tatami, and German film The Light.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
News.com.au
an hour ago
- News.com.au
Aussie turns down billion-dollar offer from Mark Zuckerberg
An Australian artificial intelligence 'genius' reportedly knocked back a billion-dollar package to defect to Mark Zuckerberg's Meta as part of its aggressive recruitment drive. Perth-raised Andrew Tulloch has established himself as a leader in the AI industry after more than a decade at Facebook's parent company and more recently its competitor OpenAI. In February the University of Sydney graduate co-founded start-up Thinking Machines Lab, alongside former OpenAI chief technology officer Mira Murati, which has a reported value of US$12 billion ($18.5 billion). The Wall Street Journal reports that Mr Zuckerberg this year approached Ms Murati to buy Thinking Machines Lab, and when she refused he attempted to poach its star workers. Sources told the Journal he offered Mr Tulloch a package of US$1 billion ($1.55 billion), which could have been worth even more after bonuses and stocks performance, over six years. Mr Tulloch refused the offer, according to the report, although Meta told the newspaper the figures it cited were 'inaccurate and ridiculous'. The Australian spent 11 years at Facebook's AI arm specialising in machine learning technology after moving to the US in 2012, rising to the role of distinguished engineer. 'He was definitely known as an extreme genius,' Mike Vernal, a former Facebook executive who worked with Mr Tulloch, told the Journal. He then moved to rival OpenAI, the company behind ChatGPT, in 2023 before branching out with former colleagues to form their start-up in January of this year. Thinkin Machines Lab has a stated mission of making 'AI systems more widely understood, customizable and generally capable'. Ms Murati recently said it was 'building multimodal AI that works with how you naturally interact with the world', but has not yet released its first product. Mr Tulloch was a vice capatain at Christ Church Grammar in Claremont, Western Australia, achieving an ATAR of 99.95 in 2007. In his university days he graduated with first class honours and the university medal in mathematics at Sydney uni in 2011, with the highest GPA in the Faculty of Science. He worked at Goldman Sachs as a quant while studying before completing a masters in mathematical statistics and machine learning at the University of Cambridge. In June, OpenAI boss Sam Altman revealed Meta had offered US$100 million bonuses ($155 million) to his employees in an unsuccessful bid to poach talent for its generative AI teams. Mr Altman also said Mr Zuckerberg's company offered 'giant' annual salaries exceeding US$100 million to OpenAI staffers. 'I'm really happy that at least so far none of our best people have decided to take them up on that,' he said. Meta chief executive Mr Zuckerberg said in January that the firm planned to invest at least US$60 billion ($92 billion) in AI this year, with ambitions to lead in the technology. Its revenue jumped 22 per cent year-on-year to US$47.5 billion ($76.73 billion) in figures released last week, attributed to its AI developments. 'We've had a strong quarter both in terms of our business and community,' Mr Zuckerberg said. 'I'm excited to build personal superintelligence for everyone in the world.'
ABC News
a day ago
- ABC News
Unions push for AI protections
Rachel Mealey: As the Commonwealth Bank becomes the first in its industry to publicly attribute job cuts to AI, unions are urgently renewing their push for worker protections. That's prompted a sharp rebuke from industry, saying more regulations will restrict productivity and the goal of AI is efficiency, not job cuts. Isabel Moussalli reports. Isabel Moussalli: The Commonwealth Bank isn't the first company to cut jobs in favour of AI, but the Finance Sector Union says it's the first in its industry to acknowledge it. Joseph Mitchell: Well, it's frankly unjust. Commonwealth Bank has made billions of dollars of profit every year for however many years. Isabel Moussalli: Joseph Mitchell is with the Australian Council of Trade Unions. He's angry that 45 roles will be replaced by a customer service chatbot. Joseph Mitchell: And making them redundant by bringing in AI to replace their jobs is just not fair. Isabel Moussalli: A Commonwealth Bank spokesperson says its investment in technology, including AI, is making it easier and faster for customers to get help, and its priority is to explore opportunities for redeployment and to support affected employees. But Joseph Mitchell says unions will fight mass redundancies from AI. Joseph Mitchell: So we know the most productive way to implement AI in a workplace is through the skilled application of workers. Workers are trained in how to use it. They can make decisions with employers about how it gets used. Isabel Moussalli: The ACTU will call for AI regulations at the Federal Government's Economic Reform Roundtable next month. Joseph Mitchell: We want to see employers required to enter into AI implementation agreements with their staff. That means that employers need to come to their staff with a plan, negotiate with employees and come to a joint agreement about how they're going to implement AI and what are the consequences going to be, with things like guarantees around job security, training and skills development. Isabel Moussalli: But the Australian Industry Group has hit back. Innes Willox: Well, it's kind of ironic because we go into a productivity summit that we have some proposals here that will restrict further productivity growth. Isabel Moussalli: That's Chief Executive Innes Willocks. Innes Willox: There are going to be times where there has to be significant consultation with the workforce and there's going to be other times when they just can't be in business, just has to get on with it. But all the information that we're getting, everything we're seeing and hearing from business is that they're not setting out to use it as a means to cut jobs on the whole. It's really about how to make their business better. Isabel Moussalli: RMIT's Dr. Emmanuelle Walkowiak is an innovation and labour economist specialising in generative AI. She explains the impact on the workforce can't be precisely forecast, but says right now we're in the middle of a massive disruption to the labour market. Emmanuelle Walkowiak: The major impact is through the transformation of jobs themselves. So what we need is really to upskill people. Isabel Moussalli: In a statement, Employment and Workplace Relations Minister Amanda Rishworth acknowledged AI offers significant opportunities to drive economic growth, but also presents challenges, and says the government's been consulting on introducing safeguards for AI. Rachel Mealey: Isabel Moussalli reporting.
ABC News
a day ago
- ABC News
Did Donald Trump just give China a major advantage on AI?
Last month, the Trump administration quietly reversed one of its own policies by lifting a ban on US tech giant Nvidia's H20 microchip exports to China. For anyone who has followed Donald Trump's erratic record on trade, another U-turn might not sound like a notable development. But this time, the stakes are much higher because these microchips are critical to powering the next generation of artificial intelligence. Whichever country dominates microchip production will likely lead the global AI race, with massive implications for military strategy and economic output. For nearly three years, the US has tried to keep these powerful chips out of China's hands. Now, by reopening the door, has Mr Trump handed Beijing a major advantage on AI? We spoke to three experts to explain how we got here. Back in April, the Trump administration banned H20 microchip exports to China, toughening restrictions put in place by the Biden administration. It has since reversed that decision. According to Jason Van Der Schyff, a fellow at Australian Strategic Policy Institute's technology and security program, this backflip may be in response to the booming black market demand for high-powered US chips in China. "Over a billion dollars worth of restricted chips were smuggled into China in just a few months," he said. "The reversal may be a pivot by the administration, recognising if you don't offer a legal channel for the slightly degraded chips, buyers will simply go around you." Professor Shahriar Akter, who specialises in the study of advanced analytics and AI at the University of Wollongong said this move seems to follow "a philosophy in Silicon Valley that if you sell more" it will pour more back into "your research and development". Associate Professor in Information Systems at Curtin University, Mohammad Hossain, suggested the Trump administration is trying to kill two birds with one stone. The US is trying to maintain leverage in a broader geopolitical trade-off involving China's critical exports, rare earth elements, while "keeping China dependent on US technology", he said. Nvidia is the tech giant behind these highly sought after microchips and it is led by CEO Jensen Huang who is the ninth-richest man in the world. The H20 is a step-down from Nvidia's top-tier chips (H100 and B200) and was specifically designed to comply with US export restrictions while catering to the Chinese market. "Basically, [H100 and B200 chips] can do things much faster than the H20," Mr Van Der Schyff said. "If we consider how quickly AI is moving any impediment that could be brought to time more than anything is going to maintain that US strategic advantage." While the H20 is less powerful, Mr Van Der Schyff warns that "these aren't toys … even slightly downgraded chips still enable model training at scale". "If you're concerned about national security, letting an adversary access chips that are only one rung down the ladder still poses a strategic risk." While the US hopes to stall China's progress in artificial intelligence, experts warn this strategy may have the opposite effect. China's push to dominate AI is already underway and restricting exports to only H20 chips incentivises them to accelerate domestic developments. "At present in the world, 50 per cent of AI researchers are being produced by China alone," Dr Akter said. Chinese tech giants like Huawei and Biren Technology have been ramping up their own AI accelerators. "Huawei's chips are already being deployed in major training clusters," Mr Van Der Schyff said. Still, China's domestic developments trail behind industry leaders like Taiwan's TSMC and South Korea's Samsung when it comes to cutting-edge manufacturing. "There isn't necessarily a danger that China catches up overnight but these restrictions do however give Beijing a clear incentive to sort of go all in on industrial policy for their own semiconductors to accelerate domestic progress," Mr Van Der Schyff said. "We've seen this play out previously with 5G and also with aviation." All three experts cautioned that it's difficult to gauge China's true AI capabilities. "Given the closed nature of China's systems and their propensity to not always tell us the truth", it's unclear how much China's artificial intelligence has developed, Mr Van Der Schyff said. Dr Akter used an analogy to explain the uncertainty: "There are two types of AI technologies", one is called glass box and the other is called black box. "Glass box technology is basically explainable AI, which is open source and we can explain where data is coming from and how it is being used to develop AI models and what would be the outcome." Whereas, black box technology is the opposite, we cannot trace back to the source of the data and we cannot tell what models have been used. That opacity makes it difficult for the rest of the world to assess whether Beijing is playing catch-up or quietly pulling ahead. The country that has the upper hand in microchip production will likely lead the global AI race and that has significant repercussions, experts said. "The country that dominates compute will dominate AI, and AI will shape everything from military planning to economic productivity."
