NVIDIA is Offering its Trained Deep Neural Networks to the Industry to Accelerate the Development of Autonomous Vehicles
【Summary】Nvidia announced this week at the company’s GTC technology conference in China that it will provide the transportation industry with access to its NVIDIA DRIVE trained deep neural networks (DNNs) for autonomous vehicle development.
For developers using AI for autonomous driving applications, one of the biggest tasks is training deep neural networks. For self-driving vehicles, neural networks are used for complex tasks such as identifying street signs, detecting pedestrians and navigation.
However training machine learning models for these tasks requires an enormous amount of data and compute power. In addition, collecting and labeling training data it is long and painstaking process, especially for many of the budding startups working on autonomous driving.
Nvidia is making its easier and the company announced this week at the company's GTC technology conference in China that it will provide the transportation industry with access to its NVIDIA DRIVE pre-trained deep neural networks (DNNs) for autonomous vehicle development on the Nvidia GPU Cloud (NGC) container registry.
Using a suite of Nvidia AI tools, developers using the DRIVE ecosystem can freely extend and customize the models to increase the robustness and capabilities of their own self-driving systems.
AI is central to the development of safe, self-driving vehicles — allowing them to perceive and react in real time to their surroundings. A typical self-driving vehicle can use dozens of DNNs to ensuring accurate perception, localization and path planning.
Nvidia said it has spent years developing and training its DNNs designed to run on the NVIDIA DRIVE AGX platform. The DNNs are used to take vast amounts of raw sensor data and turn it into a deep understanding of the environment.
These pre-trained DNNs cover such tasks as traffic-light and road sign detection, object detection (for vehicles, pedestrians, bicycles) and path perception, as well as gaze detection and gesture recognition inside the vehicle which are used in driver monitoring systems.
"NVIDIA leads the world in developing the deepest and broadest suite of DNNs and AI tools for the transportation industry," said Luca De Ambroggi, senior research director of Artificial Intelligence at IHS Markit. "Making these algorithms available to others, along with the tools and workflow infrastructure to customize them, will help enable the deployment of safe autonomous transportation."
Nvidia's NGC (cloud) containers reduce the complexity of setting up software, so developers can focus on the problem solving aspects of their projects. By taking care of most of the work behind the scenes, access to Nvidia's container registry enables users to focus on building better models.
Nvidia is not the only tech company sharing its training data. In August, Waymo, which spun out of Google's early self-driving car project, released the" Waymo Open Dataset" for autonomous vehicle researchers.
The Waymo Open Dataset, which is available for free, covers a wide variety of environments, from dense urban centers to suburban landscapes. It also includes data collected during day and night, at dawn and dusk, in sunshine and rain. Waymo said the data was collected by a fleet of Waymo self-driving vehicles that traveled over 10 million miles in 25 different cities.
In July, Ride-hailing company Lyft released its own "Level 5 Dataset." The data is also what the ride-sharing company calls is the "largest publicly released dataset of its kind." Lyft's dataset includes over 55,000 3D frames of footage that's been captured by human reviewers. It also includes a HD spatial semantic map.
Lyft chose to release its dataset to "help level the playing field for researchers interested in autonomous technology."
"The AI autonomous vehicle is a software-defined vehicle required to operate around the world on a wide variety of datasets," said Jensen Huang, founder and CEO of NVIDIA. "By providing AV developers access to our DNNs and the advanced learning tools to optimize them for multiple datasets, we're enabling shared learning across companies and countries, while maintaining data ownership and privacy. Ultimately, we are accelerating the reality of global autonomous vehicles."
Advanced Learning Tools for AI Development
In addition to providing access to the DNNs, Nvidia announced the availability of a suite of advanced tools so developers can customize and enhance NVIDIA's DNNs using their own datasets and target feature set. These tools allow the training of DNNs using active learning, federated learning and transfer learning.
Over the past several years, Nvidia's DRIVE platform has become the go-to product for developing autonomous vehicles. It's robust processing power and software is used by automakers, tech startups and universities all around the world for autonomous vehicle development.
By providing access to its AI models on NGC and introducing advanced training tools, Nvidia is building up its end-to-end platform for autonomous vehicle development and deployment. With the release of dataset, developers are getting access to the same pre-trained DNNs that Nvidia uses to improve upon its DRIVE autonomous driving ecosystem.
Originally hailing from New Jersey, Eric is a automotive & technology reporter covering the high-tech industry here in Silicon Valley. He has over 15 years of automotive experience and a bachelors degree in computer science. These skills, combined with technical writing and news reporting, allows him to fully understand and identify new and innovative technologies in the auto industry and beyond. He has worked at Uber on self-driving cars and as a technical writer, helping people to understand and work with technology.
Electric Automaker XPeng and Bosch Join the ‘ELISA Project’ to Promote the Use of Linux in Safety-Critical Automotive Applications
China's Tech Giant Baidu Plans to Rollout the World’s Largest Fully Autonomous Ride-Hailing Service by Next Year
Vietnam-based Electric Vehicle Startup VinFast Ships its First Vehicles to the U.S.
Tesla’s Model 3 is Reportedly Getting a Redesign to Make it More Appealing as Competition in the EV Segment Grows
LG Chem is Investing $3.2 Billion to Build a Cathode Manufacturing Facility for Electric Vehicle Batteries in Tennessee
Mercedes-Benz is Offering a Performance Upgrade as a Yearly Subscription on its EQ Electric Vehicles
LG Develops ‘Invisible’ Speaker Sound Technology That Could Revolutionize In-Vehicle Audio
Waymo Reveals its New Robotaxi Built by New Premium Electric Vehicle Brand Zeekr
- Electric Truck Maker Rivian Opens the First Fast Chargers in Colorado for its Nationwide ‘Adventure Network’
- Hyundai Gets Serious About Electric Performance Cars, Shows off Two Concepts
- New Premium Electric Vehicle Brand Zeekr Is Exploring IPO Options in the U.S. or Hong Kong, According to Sources
- BMW i Ventures Invests in Vendia, a Next-Gen Blockchain Company Helping Businesses to Securely Share Data With Third Parties
- Qualcomm Technologies and Renault Group to Jointly Develop a Centralized, Software-Defined Vehicle Architecture for the Automaker’s Future Electric Models
- BorgWarner Invests $500 Million in Wolfspeed Inc, a Developer of Semiconductors and Silicon Carbide Devices for Electric Vehicles
- Baidu CEO Believes That SAE Level-4 Autonomous Driving Systems Will the First to Enter Commercial Use After L2, Skipping Over L3
- Qualcomm Ventures Invests in ThunderX, a Company Developing a Domain Controller-based Intelligent Vehicle Compute Platform
- Amazon Customers in Texas and California Will Begin Receiving Packages via Prime Air Drones Later This Year
- German Court Puts a Sales and Production Ban on Ford's Internet Connected Cars in the Country Due to Patent Dispute