Runway’s New Gen-2 AI Model Generates 3-Second Video From Text Description, to Be Available on Discord

The text-to-video model, dubbed Gen-2, will initially be available on Discord via a waitlist on the Runway website.

By Reuters with inputs from Gadgets 360 | Updated: 20 March 2023 19:59 IST

Runway’s New Gen-2 AI Model Generates 3-Second Video From Text Description, to Be Available on Discord

Photo Credit: Runway

Runway hopes that creatives and filmmakers will use the product

Highlights

Runway is not releasing the model widely initially
The Gen-2 AI model will not be open-sourced like Stable Diffusion
Meta, Google have released research papers on text-to-video AI models

Runway, the startup that co-created the popular Stable Diffusion AI image generator, has released an AI model that takes any text description – such as “turtles flying in the sky” – and generates three seconds of matching video footage.

Citing safety and business reasons, Runway is not releasing the model widely to start, nor will it be open-sourced like Stable Diffusion. The text-to-video model, dubbed Gen-2, will initially be available on Discord via a waitlist on the Runway website.

Using AI to generate videos from text inputs is not new. Meta Platforms and Google both released research papers on text-to-video AI models late last year. However, the difference is that Runway's text-to-video AI model is being made available to the general public, said Cristobal Valenzuela, Runway's chief executive.

[Sponsored] Samsung Galaxy S24: The Ultimate Camera Phone With Smarter On-Device AI

Runway hopes that creatives and filmmakers will use the product, Valenzuela said.

Last month, chipmaking giant Qualcomm demonstrated Stable Diffusion 1.5, the AI image generator, running on an Android handset without network access ahead of Mobile World Congress (MWC) 2023. According to Qualcomm, the company's deployment of the AI tool, that typically requires a lot of computing power, is capable of generating images in a few seconds. The company did not reveal details of the smartphone hardware used to optimise the AI tool to run locally on smartphones.

The popular generative AI tool is known to consume a lot of computing power in order to run, which is why several services that rely on it perform these activities on large servers instead of on a user's smartphone or computer.

Getty Images Sues Stability AI; Accuses Stealing of Images to Train AI System

© Thomson Reuters 2023

The iQoo Neo 7 packs a lot of power at an affordable price. But did the company cut the right corners to keep the price low? We discuss this and more on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.