Wayve Lingo-2 AI Model With Autonomous Driving Capabilities, Ability to Take Passenger Instructions Showcased

Wayve’s Lingo-2 is an AI-powered vision-language-action model.

Written by Akash Dutta, Edited by David Delima | Updated: 18 April 2024 19:45 IST

Wayve Lingo-2 AI Model With Autonomous Driving Capabilities, Ability to Take Passenger Instructions Showcased

Photo Credit: Wayve

Wayve’s Lingo-2 is yet to be tested in a real-world environment

Highlights

Wayve’s Lingo-2 was trained on a closed-loop simulator
The AI model can also answer real-time queries on the road
Lingo-2 is the successor of the company’s Lingo-1 AI model

Wayve unveiled its artificial intelligence (AI)-based vision-language-action driving model (VLAM) Lingo-2 on Wednesday. Lingo-2 comes as the successor of the Lingo-1 AI model and has multiple new capabilities. The autonomous driving AI can now offer commentary of its actions while driving as well as adapt its actions based on the passenger's instructions. It can also answer queries about its surroundings which is not directly related to its driving. The AI firm said Lingo-2 was designed as the path to build a trustworthy autonomous driving technology.

Showcasing the capabilities of Lingo-2 in a demo video on X (formerly known as Twitter), the company introduced the new Lingo-2 AI model that is capable of navigating roads while taking instructions from passengers. The post on X also includes a video of a Lingo-2 drive through Central London, where the model drives the car while simultaneously generating real-time driving commentary.

🚙💬Meet Lingo-2, a groundbreaking AI model that navigates roads and narrates its journey. Watch this video taken from a LINGO-2 drive through Central London 🇬🇧 The same deep learning model generates real-time driving commentary and drives the car. pic.twitter.com/eZB8ztDliq
— Wayve (@wayve_ai) April 17, 2024

The AI model combines three different architectures — computer vision, large language model (LLM), and action models — to create a combined VLAM model that can perform various complex tasks together in real time. Based on the demo, Lingo-2 can see what's happening on the road, make decisions on its basis, and inform the passenger about the decision. Additionally, it can also adapt its behaviour based on any instructions given by the passenger, and answer non-driving related queries such as information about the weather.

Wayve says that performing these actions consistently and reliably is an important step towards building autonomous driving technology. “It opens up new possibilities for accelerating learning with natural language by incorporating a description of driving actions and causal reasoning into the model's training.

Natural language interfaces could, even in the future, allow users to engage in conversations with the driving model, making it easier for people to understand these systems and build trust,” the company said on its website.

It is important to note that Lingo-2 does not really drive a vehicle as it is just an AI model and is not integrated with hardware to control a vehicle. It is trained and tested on Wayve's in-house closed-loop simulation called Ghost Gym.

Being a closed-loop simulation, the company can test the realistic reaction of other vehicles and pedestrians based on the control vehicle's behaviour. For the next steps, the AI firm plans to start limited testing of the AI model in a real-world environment to analyse its decision-making in more unpredictable situations.

Is the Samsung Galaxy Z Flip 5 the best foldable phone you can buy in India right now? We discuss the company's new clamshell-style foldable handset on the latest episode of Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.

Affiliate links may be automatically generated - see our ethics statement for details.

Comments

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Further reading: Artificial intelligence, AI, Autonomous cars

Akash Dutta Email Akash Dutta

Akash Dutta is a Senior Sub Editor at Gadgets 360. He is particularly interested in the social impact of technological developments and loves reading about emerging fields such as AI, metaverse, and fediverse. In his free time, he can be seen supporting his favourite football club - Chelsea, watching movies and anime, and sharing passionate opinions on food. More