YouTube Brings AI-Powered Video Generation Capabilities to Shorts, AI Reply Suggestions in Comments

YouTube will let users generate AI videos using Google DeepMind’s AI model Veo.

Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 19 September 2024 12:51 IST

YouTube Brings AI-Powered Video Generation Capabilities to Shorts, AI Reply Suggestions in Comments

Photo Credit: YouTube

The Veo AI model will also improve YouTube’s Dream Screen feature

Highlights

YouTube is also testing an automatic dubbing feature
The Inspiration Tab in YouTube Studio is getting an AI feature
These features were announced at the Made on YouTube event

YouTube is introducing several new features to its video streaming platform, and a few of them will be powered by artificial intelligence (AI). On Wednesday, the platform held its Made on YouTube event and the biggest announcement was the integration of a new AI Video model to let creators generate backgrounds and six-second-long videos for Shorts. The AI model being used for this is Veo, which was unveiled earlier by Google DeepMind. Additionally, YouTube is also introducing new ways for creators to use AI to generate video ideas and titles.

YouTube's New AI Features

In a blog post, the company highlighted that it is integrating the AI video generation model Veo into YouTube Shorts later this year. This tool will build on top of Dream Screens, the experimental feature released in June. The video-streaming giant claims it will allow users to create live video backgrounds.

Highlighting an example of what the tool is capable of, YouTube stated, “Imagine a BookTuber stepping into the pages of the classic novel, The Secret Garden, or a fashion designer instantly visualising fun and imaginative design concepts to share with their audience.” But background generation is just a part of what Veo will do for Shorts creators.

Samsung Wins Patent for a Tri-Fold Smartphone With Specialised Barrier Layer for Improved Durability

The tool will also allow creators to generate six-second-long vertical videos for Shorts. The way the company looks at the use case is if a creator is missing some footage to make the perfect short-format video, they can use AI to generate it and add it to their Shorts video. Notably, videos generated using the tool will be watermarked by Google's in-house AI labelling tool SynthID.

YouTube is also introducing automatic dubbing, a feature that will automatically dub the voices in the videos in different languages. It is aimed at promoting localised creators to a global audience by eliminating the language barrier. Currently, it is being tested with a small group of creators, but it will be expanded to a larger user base in the coming months. While the company mentioned languages such as Spanish, Portuguese, French, and Italian, the full list of supported languages is not known.

Additionally, creators are getting another AI tool that will make it easier for them to respond to the large number of comments. In the Comments tab in the YouTube Studio app, creators will see AI-enhanced reply suggestions which will let them easily respond to their audiences. These replies will be tailored to the creator's style and can be customised.

Further, creators will also get to use AI to brainstorm video ideas, titles, and thumbnails for videos. The Inspiration Tab in YouTube Studio is now getting AI capabilities to suggest video ideas as outlines with bullet points. This feature was first announced in August and was available in beta. It is now available to a wider user base. Notably, the feature is powered by Gemini.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: YouTube, AI, Artificial Intelligence, YouTube Shorts, Google DeepMind, AI Video

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More