Tavus taps generative AI to power personalized videos with voice and face cloning
Generative AI already looks like a major technology trend of 2023.
The ability to generate new content using algorithms has been thrust into the public consciousness by the likes of ChatGPT.
A chatbot-style technology trained on large language models (LLM) capable of producing essays, poems, song lyrics, news articles and even computer programs.
Then there’s DALL-E from the same Microsoft-backed OpenAI that spawned ChatGPT, which serves a similar purpose but for visual creations instead.
While some have argued that ChatGPT signals the arrival of artificial intelligence into the mainstream.
The truth is that we are just at the beginning of a new era of AI-powered applications that will change almost every aspect of the industry, from consumer search to stock photography to real estate and content marketing.
It is against this background that a fledgling startup called Tavus is trying to make its mark by allowing companies to create “one-of-a-kind” videos tailored to a specific individual, but entirely based on a single initial footage.
The idea is that a sales and marketing team, for example, can issue an endless stream of video presentations to potential customers, perhaps based on the text data the prospect has submitted via an online form.
Or maybe a headhunter will use the platform to send a few personalized videos to potential candidates using data gleaned from their LinkedIn profiles.
Founded in 2020 in San Francisco by CEO Hassaan Raza and Quinn Favret, Y Combinator (YC) alum Tavus announced today that it has raised $6.1 million in a seed round led by Silicon Valley investor Sequoia.
Participation from many high-profile backers including Accel Partners, Index Ventures, Lightspeed Ventures and YC Continuity.
Any company looking to create more personalized videos knows it’s an incredibly time-consuming, repetitive process: uploading the same message with essentially the same content, but tweaked for different clients or candidates.
That’s what Tavus is trying to solve: allow users to create their own AI video templates in minutes, and then generate an unlimited number of video versions from that original source.
The initial sign-up process requires a user—such as a recruiter or sales executive—to upload a 15-minute video based on a script provided by Tavus that is used to train the AI.
Then the user records a template for each campaign they want to create. Using the web editor, users can then choose which elements of the video they want to personalize, specifying each variable (eg company, manager name or location).
Adding calls to action and so on. Generative AI already looks like a major technology trend of 2023. The ability to generate new content using algorithms has been thrust into the public consciousness by the likes of ChatGPT, a chatbot-style technology trained on large language models (LLMs) capable of producing . essays, poems, songs, news articles and even computer programs. And then there’s DALL-E from the same Microsoft-backed OpenAI that spawned ChatGPT, which serves a similar purpose but for visual creation instead.