MIT, Microsoft Develop Model to Identify AI's Weak Points
【Summary】In order to bridge the gap between real-world testing and AI-based training methods, MIT and Microsoft have developed a model that reveals possible weak points from virtual testing.
Automakers and companies are having trouble getting approval to publicly test autonomous vehicles, which all but forces them to move to a location where testing is allowed, create a fake city, or utilize a virtual simulator. While simulators give companies the ability to get close to real-world testing, they're not as good as the real thing and could fail to teach autonomous vehicles about every possible situation.
To give companies a better idea of whether their self-driving cars learned everything they needed to in a simulator, researchers from Massachusetts Institute of Technology (MIT) and Microsoft have come up with a solution.
Researchers from the organizations believe their model can be used to improve AI systems by testing the system on whether they're ready for unexpected occurrences that take place in the real world.
MIT gives the example of an ambulance. While we can all tell an ambulance apart on the road, because it's a massive white vehicle with flashing lights that makes a lot of noise, an autonomous vehicle might not know what it is or what the flashing lights mean. This, as MIT claims, could be an issue from the autonomous car's system not being able to tell an ambulance apart from a regular white vehicle.
To recognize an autonomous car's weak points, the researchers relied on human input where a human watched an autonomous car's system interact in the real world. If the human noticed that the autonomous system was about to make a mistake, they provided their feedback. With feedback from a human, researchers paired that with training data and machine-learning techniques to create their model that points out where possible blind spots are.
These "blind spots" are highlighted in a heat map, which breaks areas down from low-to-high probability of being a potential issue. If, for instance, a system detects the ambulance and moves over for the safety vehicle nine out of 10 times, it's classified as a safe situation. If an autonomous system only detects an ambulance once, that is now a blind spot.
"The model helps autonomous systems better know what they don't know," said Ramya Ramakrishnan, a graduate student at MIT. "Many times, when these systems are deployed, their trained simulations don't match the real-world setting [and] they could make mistakes, such as getting into accidents. The idea is to use humans to bridge that gap between simulation and the real world, in a safe way, so we can reduce some of those errors."
While it sounds like the model would work in the real world, as trained drivers would be able to provide immediate feedback when an autonomous vehicle is about to make a mistake, MIT and Microsoft have only tested the model in video games. Here, researchers could create a safe place for things to go wrong.
Vineeth Joel Patel
Joel Patel has been covering all aspects of the automotive industry for four years as an editor and freelance writer for various websites. When it comes to cars, he enjoys covering the merger between technology and cars. In his spare time, Joel likes to watch baseball, work on his car, and try new foods
General Motors Could Replace the Camaro With an Electric-Performance Sedan
Tesla Delays Cybertruck, Semi to Focus on Model Y Production
Honda Ditches Plan for Tackling EVs Alone, Embraces Partnerships
Tesla Full Self Driving Subscription Priced at $199 Per Month
Tesla Plans to Let Other EVs Use its Superchargers
Ford Discontinues Diesel Engine For F-150 Pickup
GM Advises Bolt EV Owners to Park Vehicles Outside Over Fire Risk
Jeep’s Future Includes Electric SUVs, Autonomous Off-Roading, and Drones
- Luxury Electric Vehicle Startup Lucid Motors Hires Key Executives from Waymo, Apple & Ferrari Ahead of its IPO
- Tesla Reports Record Deliveries of 201,250 Vehicles in the Second Quarter of 2021
- A Closer Look at Tesla’s Nvidia-powered Supercomputer for Training Deep Neural Networks
- President Biden Visits Ford Motor Co to Promote His $174 Billion Electric Vehicle Plan, Checks Out the F-150 Lightning Ahead of its Unveiling
- Volvo Cars to Take Full Control of its Chinese Business From Automaker Geely as it Explores a Possible IPO
- Outsight Develops a Edge Computing Device That Can Pre-processes 3D Lidar Data From Sensors Built by Different Manufacturers
- Volvo’s Concept Recharge is a Blueprint For the Brand’s EV Future
- FAW-Volkswagen Begins Deliveries of the Electric ID.6 CROZZ SUV in China
- The Upcoming Lucid Air Sedan Will Ride on High-Tech Pirelli Tires Designed for EVs
- Apple in Talks to Build an EV Battery Factory in the U.S. with Chinese Battery Makers, Reports Say