Mumbai: In a landmark moment, NeuralGarage’s ‘VisualDub’, a generative AI technology, has made history by becoming the first-ever implementation of generative AI for multilingual lip sync of dialogues in advertising. With its language-agnostic lipsync capabilities, NeuralGarage helped Amazon create native, authentic visual dubbing for their Amazon Daily and Amazon Fresh advertising creatives that recently went live on TV and digital platforms.
NeuralGarage, a deep tech startup from Bengaluru, has managed to break new ground in the advertising and marketing domain with its generative AI technology, VisualDub, that helps with multilingual lipsync in content & media. Advertising creatives and other marketing content in India are usually produced and shot in one language (usually Hindi) and then dubbed into several different languages, making them look inauthentic to regional viewers. NeuralGarage helps repurpose those creatives by making them look native and local for regional consumers through its proprietary technology, VisualDub.
The NeuralGarage team has collaborated with Amazon India for their Amazon Daily (agency: Ogilvy) and Amazon Fresh (agency: Media.Monks) ad campaigns that went live across TV and digital platforms. Its collaboration with the e-commerce giant represents a global first-use case of integrating generative AI technology in multilingual lipsync. VisualDub, being language agnostic, makes dubbed content look natural and syncs the lips and jaw movements of the actors within the video to make it more visually authentic. It helped Amazon India with visually dubbing its ad creatives into seven different regional languages.
NeuralGarage co-founder and CEO Mandar Natekar said, “There is a lot of news around what is possible with generative AI technology, but it takes a client like Amazon to back new tech into its business, actually walk the talk, and show the world what is possible. We are thrilled to collaborate with Amazon on these campaigns and showcase the power of our tech. It has always been our vision at NeuralGarage to harness the true potential of generative AI to make communication seamless & make dubbed content look visually authentic. I am thankful to Amazon India who gave a budding Indian startup like ours a chance to demonstrate the scope of ‘VisualDub’. We are committed to pushing the boundaries in advertising and marketing further with our proprietary tech and this is just the start!”
The news of their current collaboration is particularly remarkable since a generative AI solution like this has not been executed at this scale across multiple languages on longer dialogues & scenes globally. For an India-based startup to deliver this complex solution is great news and bodes well for the Indian startup ecosystem. In a country with over 22 primary languages, there is an urgent need to personalise content on digital platforms, OTTs, theatrical releases & broadcast networks and NeuralGarage is looking to play an essential role in that. Through a global lens, the market and scope will be substantially greater.
With cultural sensitivity gaining increasing focus, a country like India with such a rich cultural heritage and diverse languages, generative AI certainly holds the promise for advertisers, content creators, and filmmakers to synchronise lip movements with the dialogue enabling a stronger connection with the consumers. This story is also likely to play out similarly across the world.
With AI language models, tools, and software dominating the news cycles worldwide, competition is heating up within the space regarding who can come up with the next revolutionary innovation. Such a success story for a generative AI startup would only serve as an inspiration to similar startups.
NeuralGarage co-founder and CTO Subhabrata Debnath stated, “The aim behind ‘VisualDub’ has been to minimise visual dissonance in content and media. We are committed to fostering innovation in this space to amplify its capabilities and extend its reach into several other industries. We believe that our work will allow the seamless creation of multilingual lip-synced content that will build a stronger and closer bond between content creators and consumers.”
With AI poised to influence most businesses & industries, NeuralGarage is well-placed to aggressively sustain its momentum into tech development and elevate VisualDub to revolutionise content creation and the last-mile consumer experience.
