The AI wave: How Tamil cinema is embracing artificial intelligence tools

Senthil Nayagam has been besotted with actor Suriya for weeks. He has downloaded interviews and speeches of the actor, and has been feeding them to his many AI (artificial intelligence) tools in an attempt to “master Suriya’s voice”.

“Let’s try running it now,” says Senthil, rubbing his hands in glee as he quickly taps his laptop. He selects one of his favourite Ilaiyaraaja songs – ‘Nilave Vaa’, sung by SP Balasubrahmanyam, in the 1986 Tamil film Mouna Raagam – and presses some more keys.

Within a few seconds, the familiar strains of ‘Nilave Vaa’ play out, sung in Suriya’s distinct voice!

An AI-generated image of what could be the ultimate blockbuster: a film starring Rajinikanth and Kamal Haasan 
| Photo Credit:
Special Arrangement

All this stemmed from when Senthil asked himself a question a few months ago: Can I replace one person with another? Following that train of thought, he made the late SP Balasubramanyam sing the ‘Rathamaarey’ song, originally sung by Vishal Mishra, from Rajinikanth’s recent hit Jailer.

Senthil then went one step further; he used a face-swapping technique to replace Tamannaah with Simran for the foot-tapping ‘Kaavala’, Anirudh’s hit song from Jailer, a short video that generated more than 2 million views, especially after the two actresses also shared it.

For Senthil, who currently runs a generative AI company called Muonium Inc, AI is “a toy he is experimenting with”. Currently, he is making use of the technology to create a voice similar to AR Rahman’s to sing all the songs that he has composed, like ‘Usurey Poguthey’ from Raavanan, which was performed by singer Karthik. “This is actual work,” he admits, “We need to separate the instruments and the voice, clean any noise and then mix it back. I’ve got mixed feedback for my content, because some fans aren’t happy with the videos featuring people who have passed on. But audiences should understand that the possibilities with AI are exciting.”

It is. AI is slowly creeping into various facets of Tamil cinema, changing the way filmmakers vision and execute their projects. Like Senthil, there are many others dabbling in AI. Like Teejay-Sajanth Sritharan, for instance. A Srilankan Tamil living in the UK, he has also created voice models for many leading Tamil actors.

Using AI tools like Midjourney, Stable Diffusion, Chat GPT or a combination of Python and GPU, these AI creators are not just putting their work out there for audiences, but also collaborating with producers and directors.

Lyricist-dialogue writer Madhan Karky used multiple AI tools for his upcoming Suriya-starrer Kanguvafor concept designs and world building. “I also use AI as my writing assistant when I write stories or scenes. It saves a lot of time, because we have tools like Kaiber and Gen-2 that can create animation and lyric videos,” says the lyricist.

Suriya in a still from ‘Kanguva’

Suriya in a still from ‘Kanguva’
| Photo Credit:
Special Arrangement

Using a tool called SongR, Madhan created ‘En Mele’, the world’s first AI-composed Tamil song, now available on leading music streaming platforms. “I had to make it learn Tamil, which was very challenging,” he says, adding “In a few years, most AI tools will become well-versed in all languages in the world.”

Karky has another prediction: that, within a year, a movie completely generated using AI will release in theatres.

While that may take a while, in November, audiences will be able to watch about four minutes of AI-generated content in Tamil film Weapon, starring Sathyaraj. The makers decided to opt for this during the post-production stage, when they felt that a flashback portion would add value to the film. Using a software developed by the team, director Guhan Senniappan and team fed photos of the leads (Sathyaraj and Vasanth Ravi) to generate the sequences.

“It saves a lot of time,” says Guhan, who has previously worked on Sawaari (2016) and Vella Raja (2018), “Earlier, we would need a few days to create one frame, but with AI, we can experiment with four-five frames in a single day and get instant output. When you are working with strict deadlines, this is a boon. But, you need to input strong, accurate keywords for AI tools to generate the visuals you have in mind.”

Sathyaraj and director Guhan on the sets of Tamil film ‘Weapon’, which will feature an AI-generated portion

Sathyaraj and director Guhan on the sets of Tamil film ‘Weapon’, which will feature an AI-generated portion
| Photo Credit:
Special Arrangement

Expect AI to alter every stage of film making, including costumes. Mohamed Akram A of OrDrobe Apparels says that the Indian film industry will soon embrace AI to transform fashion in their projects and promotional activities. “Algorithms can be used to generate costume ideas that are not only visually stunning but also relevant to the storyline and character development,” he says. “Each character’s attire can be uniquely designed to reflect their personality, era, and storyline, enhancing the overall cinematic experience.”

OrDrobe, which debuts in film merchandising with their association with the makers of the upcoming Tamil film Nanban Oruvan Vandha Piragu, is keen to actively participate in the film space. “AI can also be used in fashion trend analysis and maintaining a digital wardrobe for characters, making it easier to recreate costumes for reshoots and to ensure character continuity throughout a film,” adds Mohamed.

The cost and time saved thanks to these processes might benefit producers in the long run.

While cash-rich producers can still opt for a big VFX team to do the job, that might not be a viable option for all, especially medium and small-scale film units. Using AI tools could help them achieve 80% of the desired output at one-third the cost spent on VFX, experts say.

But it does trigger a debate on ethics: English actor-comedian Stephen Fry recently lashed out at the makers of a historical documentary for faking his voice using AI.

Does this all mean that AI will someday substitute human intelligence and labour, even in the movies? No, feels Karky. “Human creativity does have an upper edge. Our experiences and the emotions we undergo are what makes us different.”

“AI empowers creators, if used properly. But human creativity does have an upper edge. Our experiences and the emotions we undergo make us different.  ”Madhan KarkyLyricist, Dialogue-Writer

“Using AI tools, you can achieve 80 percent of the same output at one-third the cost that you would spend on VFX.”Senthil NayagamAI creator

Source link

#wave #Tamil #cinema #embracing #artificial #intelligence #tools

Explained | Why are Hollywood writers and actors on strike?

More than 11,000 film and television writers fear their profession is being turned into a “gig economy” of temporary workers and that artificial intelligence could endanger their jobs

The story so far: The first episode of season six of Black Mirror, the fictional anthology show on Netflix bringing to the screen scenes from a dystopian future seems to have made a correct prediction. This particular episode involves a streaming service using an AI-created version of actor Salma Hayek without her consent in a show. Reality doesn’t seem very different today when Hollywood’s actors fear artificial intelligence might be used to create their onscreen likenesses which could then speak, look, and most importantly, act like them, endangering the profession.

Putting guardrails on the use of AI in the industry, however, is just one of the many demands that have made Hollywood’s actors and writers come out in large numbers on the streets to strike.

While production companies and studios in Los Angeles and New York were witnessing hundreds of film and television screenwriters of the Writers Guild of America (WGA) standing in picket lines outside their doors since early May, Hollywood actors on July 14 joined the strike after their contract negotiations with studios broke down. This is Hollywood’s biggest labour fight in six decades and marks the first dual strike of both writers and actors since 1960.

Why did the writers go on strike?

The WGA is the union of almost all screenwriters behind Hollywood shows, films, and other television dramas. The board of the union, on behalf of its 11,500 writers negotiates a contract every three years with the Alliance of Motion Picture and Television Producers (AMPTP), comprising all big Hollywood studios including Warner Bros. Discovery, NBC Universal, Paramount Pictures and all streaming services from Netflix to Peacock.

Also read | Hollywood Strike: ‘Mission: Impossible 8’, ‘Gladiator 2’ and other tentpoles halt production

The contract negotiations cover issues like deciding base pay for writers, pension benefits, residual payments, and so on. This time around, the WGA’s contract with the AMPTP expired on May 1, and six weeks of negotiations leading up to the deadline did not see a consensus over the writers’ demands and what studios were willing to offer. Therefore, the WGA announced on May 2 that its members would go on strike.

According to WGA rules, while the strike continues, writers cannot make new deals, new pitches, or turn in new scripts. They are allowed to accept payment for any writing that’s already been done.

What are writers demanding?

Much like how the 2007 Hollywood writers’ strike, which lasted 100 days, was about the way “new media” or the use of content on the internet had changed the industry, the current strike is largely about the era of streaming and its ripple effects on the profession. 

Decreasing pay: One would imagine that the boom of content on OTT platforms and large investments in streaming content would bring more jobs and more money to be made for writers. But the WGA argues that with streaming services cutting corners and attempting to maximise profits for their investors, writers are being left behind and their compensation has not kept up with the rising inflation.

The Writers Guild of America (WGA) points out that while the operating profits of productions and streaming platforms have surged over time, the compensation given to writers has declined.
| Photo Credit:
Source: WGA

According to the WGA, while the profits of the entertainment industry have ballooned from $5 billion (combined entertainment operating profits of Disney, Fox, Paramount, NBC, Universal) in 2000 to a whopping $30 billion in 2019 with the addition of Netflix, what writers earn has actually shrunk.

The Guild notes that the average pay of the writer-producer position has gone down by 4% over the past decade. Adjusted for inflation, it says, this is a 23% decline. Moreover, the share of writers earning just the minimum wage level called the Minimum Basic Agreement (MBA) by the Guild has gone from two-thirds in 2013-14 to half of them at present, meaning more writers are not getting paid above minimum levels. This is also because streaming has meant fewer guaranteed weeks of paid work for writers. A traditional network television season calendar would give writers about 42 weeks of work in 2000, but as seasons of shows get shorter, an average writer has just about 20 weeks of work for streaming shows, The Washington Post points out.

Median weekly writer-producer pay has declined by 4% over the last decade. Adjusting for inflation, the decline amounts to 23%. 

Median weekly writer-producer pay has declined by 4% over the last decade. Adjusting for inflation, the decline amounts to 23%. 

‘Mini rooms’: Another major issue highlighted by the WGA is the concept of downsizing known as “mini rooms”, that has come about in recent years, increasingly replacing traditional writers’ rooms. Traditionally, multiple writers with different levels of experience would form a writer’s room that would be involved throughout the process of a show or film’s production. However now, studios and streaming platforms are creating mini rooms where writers first work on writing the whole show and once it is approved and production begins, only a few of them are retained through production.

Also read | Hollywood Strike: Netflix shielded by global crew, strong pipeline

Residual payments: Another sticking issue in the negotiations is that of shrinking residuals- additional payments writers get each time a show or film is aired again or licensed. However, platforms like Netflix offer smaller residuals and do not disclose internal data about the viewership of a show with writers but give fixed residuals. For network shows and feature films, residuals were also tied to how the content performed, which meant more residual payments for writers. 

The AMPTP, meanwhile, has said it presented a generous deal that included the biggest bump in minimum pay in 35 years, higher caps on pension and health contributions, and “a groundbreaking AI proposal that protects actors’ digital likenesses.”

“A strike is certainly not the outcome we hoped for as studios cannot operate without the performers that bring our TV shows and films to life,” the group of production houses said in an earlier statement. “The Union has regrettably chosen a path that will lead to financial hardship for countless thousands of people who depend on the industry.”

Why have actors joined the strike?

Talks between the Screen Actors Guild – American Federation of Television and Radio Artists (SAG-AFTRA) and the AMPTP also broke down on Thursday. The issues remain more or less the same — shorter seasons, lesser work and lower base pay, as well as residuals.

Actor Matt Damon, who has supported the strikes, pointed out at the London premier of the upcoming release Oppenheimer, how many people exist on the margins. “We got to protect the people who are kind of on the margins. 26,000 bucks a year is what you have to make to get your health insurance, Damon told the Associated Press. “And there are a lot of people who ― residual payments are what carry them across that threshold. If those residual payments dry up, so does their healthcare, and that’s absolutely unacceptable.”

Why is artificial intelligence a concern for the writers and actors?

Notably, AI has emerged as a crucial area where actors and writers want production houses to put guardrails so their professions are not endangered in the near future. Those on strike see unchecked AI as an “existential threat”. While the two guilds wanted productions to set ground rules for the future and current use of AI in production, the latter has proposed meeting once a year to discuss this as AI is a developing technology. Writers are demanding that AI not be used to create new and unpaid content from their original work and their scripts not be used to train AI like language learning models. As for the actors, they do not want studios to use their AI-created likeness or performances without their consent or without compensation.

Also Read | ‘Plagiarism machines’: Hollywood writers and studios battle over the future of AI

Notably, Duncan Crabtree-Ireland, SAG-AFTRA chief negotiator, told the BBC about an already proposed AI use by studios. He pointed out that studios had asked to scan the faces of background artists, paying them for a day’s work. Crabtree-Ireland criticised how the studios would then be able to possess and use the actors’ likeness “for the rest of eternity, in any project they want, with no consent and no compensation”.

What is the current and potential impact of the strike on films and television releases?

Since WGA and SAG-AFTRA strike rules prevent members from participating in any new or pending work, including promotions and festivals, some productions have already come to a standstill while many others are expected to be impacted in the near future or the end of the year.

When the writers’ strike began in May, late-night talk shows in the U.S., which depend heavily on same-day, current-events-based comedy writing soon went into hiatus. These include popular shows like NBC’s “The Tonight Show Starring Jimmy Fallon,” ABC’s “ Jimmy Kimmel Live!” and CBS’s “The Late Show With Stephen Colbert”. If the strike goes on for some more weeks, and now with the joining of actors, the fall TV season starting September, which sees fresh seasons of comedies and dramas that will likely be delayed.

Films to be released in theatres are protected from an immediate hit because movies take two to three years to produce. But future releases, such as Marvel’s Blade and Thunderbolts, have been delayed, and films in production such as the Avatar and Gladiator sequels look likely to be hit by actors’ strike. The production of Ryan Reynolds and Hugh Jackman’s much-awaited film Deadpool 3, Tom Cruise’s eighth Mission: Impossible movie, Disney’s Lilo & Stitch remake, Brad Pitt’s Formula One movie, and Tom Hardy’s Venom 3 are a few of the many projects that might have to wait until the Hollywood studios and the striking actors and screenwriters come to an amicable agreement. Award shows like Emmys too might have to be rescheduled. 

How big is the economic impact?

It is patent to note that the dual strike does not just affect its participants but a large number of those employed in production related jobs and tertiary industries such as costume, catering, lighting, for hire location providers, and so on. The last writers’ strike in 2007 which lasted 100 days cost $2.1 billion to California’s economy alone.

  • Hollywood’s actors fear artificial intelligence might be used to create their onscreen likenesses which could then speak, look, and most importantly, act like them, endangering the profession.
  • Much like how the 2007 Hollywood writers’ strike, which lasted 100 days, was about the way “new media” or the use of content on the internet had changed the industry, the current strike is largely about the era of streaming and its ripple effects on the profession. 
  • Writers are demanding that AI not be used to create new and unpaid content from their original work and their scripts not be used to train AI like language learning models.

(with inputs from Associated Press)

Source link

#Explained #Hollywood #writers #actors #strike