For prominent Hollywood figures, possessing a cloned voice double might soon be as routine as having a stunt double, according to an AI specialist speaking with Sky News.
While both the BAFTAs and Oscars annually recognize artistry and expertise, behind the scenes this award season has witnessed a contentious struggle for support, with several voices from the industry voicing their concerns over the clandestine manner in which this technology is being utilized.
Brady Corbet, the director behind the 10-time Oscar-nominated film The Brutalist, has had to clarify to Deadline that actors Adrien Brody and Felicity Jones “dedicated months” alongside a dialect coach to “refine their accents” – but that artificial intelligence was also employed in post-production to assure an improved edit of certain Hungarian vowel sounds.
Emilia Perez, A Complete Unknown and Dune: Part Two have also become part of the discussion for incorporating AI in some manner.
Conversely, Hugh Grant‘s horror film Heretic audaciously proclaimed in its end credits: “No generative AI was utilized in the production of this film.”
‘Horrendous’ dubbing may be a thing of the past
Ausrine Skarnulyte, the CEO of an AI firm named Voice-Swap, stated that the film industry must acknowledge that “the genie is out of the bottle”.
“We’re witnessing greater adoption across the film and television sector, even if currently no one is really discussing it, at least not as vocally as they might prefer,” she remarked.
“Voice doubles is fundamentally the direction in which technology is heading,” she asserted.
Not only could permitting their voice to be officially cloned for a production potentially streamline the workload for actors, but it could also significantly reduce costs for studios.
Skarnulyte explained: “Any sound engineer equipped with access to authorized AI voice models can then execute post-production adjustments when the actor is absent from the studio, eliminating the need for them to return and re-record lines.”
As per Skarnulyte, who hails from Lithuania, another advantage is the transformation it brings to the process of dubbing films into different languages.
“I grew up watching 80s action films by Steven Spielberg, Jean-Claude Van Damme, and Arnold Schwarzenegger, and the narration… the dubbing was atrocious.
“With this technology, we could replicate Antonio Banderas’ voice to communicate in any language… it facilitates the ability to emulate someone’s natural voice with ease.”
Sky correspondent’s AI voice experience
How swiftly can it be accomplished? In under a day, utilizing a 45-minute recording of my speech, the team at Voice-Swap managed to produce a foundational AI version of me.
It is quite disconcerting to hear myself suddenly articulate fluently in Lithuanian. The quality and tone of what they demonstrated sounds just like me, even possessing, as I’ve been told, a subtle British lilt to maintain authenticity.
For an actor, mastering even the basics of a foreign language would typically require months – this process necessitated absolutely no learning on my end.
While it might be perceived as something that could immediately displace those who have established careers in redubbing for various regions, this is not entirely accurate.
Skarnulyte clarified that she utilized recordings of her own Lithuanian speech, followed by a voice-to-voice AI transformation, successfully merging my voice with hers.
Defining the parameters, she emphasized, is crucial.
“It is essential to ensure that it is utilized within a professional framework, with clear attribution, and a transparent dataset.”
Resistance Against the Rising AI Impact
However, not everyone is persuaded that the advantages surpass the disadvantages.
Actor John Magaro, who features in the Munich Olympics thriller “September 5,” expressed that the encroaching presence of AI is “a daunting prospect.”
Earlier this year, he mentioned to Sky News: “I would not recommend anyone to pursue an acting career these days. It’s intimidating, and the future is uncertain.”
As reported by the industry magazine Variety, it will be mandatory to declare the use of AI in films at the upcoming Oscars.
“There is discussion about implementing a requirement to disclose your utilization of AI, which could be a beneficial idea,” deputy awards and features editor Jenelle Riley stated to Sky News.
She further elaborated: “We disclose everything: no animals were harmed during production, and we list all the artists involved in a movie…as long as all parties are forthcoming, AI can serve as an invaluable asset.”
Explore more from Sky News:
Bridget Jones makes a return – but is she still relevant?
AI is already being integrated into various aspects of filmmaking, from visual effects to script evaluation.
Though this may unnerve some, professionals leveraging AI advocate for its role as a collaborator instead of a rival within the creative process.
As Skarnulyte pointed out: “This is the juncture where we must delineate the interplay between technology and the creative sectors.”
“AI is already manifesting, and it’s only a matter of time – we can either harness it and shape its direction, or it will dictate our course.”