Nvidia
Nvidia
@nvidia·2.2M subscribers·2.7K videos

End-to-End Autonomous Driving: A Bird’s-Eye View - DRIVE Labs Ep. 35

Posted

June 18, 2024

Views

180,958

Likes

917

Engagement

0.51%

Search the Record

Indexed

Every word spoken in this episode is indexed. Type any phrase to jump straight to the moment it was said.

Type any word or phrase that may have been spoken. Click a result to seek the player to that exact moment.

Try a name, a topic, or a quoted line

Chapters

YouTube Description

as posted by the channel

End-to-end autonomous driving is a holistic approach to AV system development in which the system takes in raw sensor data from cameras, radar, and lidar and directly outputs vehicle controls.

Unlike traditional systems that rely on modular designs with separate components—such as detection, tracking, prediction, planning and control—end-to-end driving aims to streamline the process to avoid the deep and cascaded path from perception to planning.

NVIDIA’s end-to-end driving model—Hydra-MDP—combines the components into a single network with a minimalistic design. The planning input comes directly from a bird’s-eye view feature map generated from sensor data.

The NVIDIA Research team’s progress in this area won the CVPR 2024 Autonomous Grand Challenge in the End-to-End Driving at Scale category.

In addition to the real-world data provided in the competition, the model also generalizes to simulation environments with high-fidelity sensors, such as NVIDIA Omniverse, for further development and testing.

Resources:

CVPR 2024 Leaderboard

HydraMDP paper

NVIDIA blog

NVIDIA tech blog

Watch the full DRIVE Lab series

Learn more about DRIVE Labs

Follow us on social:

#NVIDIADRIVE

Guests & Subjects Covered

DRIVE Labs Ep. 35End-to-End Autonomous DrivingThe NVIDIA ResearchAutonomous Grand ChallengeEnd-to-End DrivingNVIDIA OmniverseThe NVIDIA Hydra-MDPResources CVPR

Sentinel Indexing in Progress

Metadata and chapters are available. Claim extraction for this episode is pending.

All video content is delivered via YouTube embedded players in accordance with the YouTube Terms of Service. Sentinel provides research tools that promote discovery and accountability across political media.