Toyota and its Partners Are Building Maps for Autonomous Vehicles Using Satellite Images & Dash Cam Footage
【Summary】The Toyota Research Institute demonstrated a proof of concept to create high-definition maps for autonomous vehicles using satellite images and dash cam footage.
Although many drivers feel Google Maps for navigation is indispensable, the maps and technology that human drivers rely on for turn-by-turn directions are simply not accurate enough for a self-driving car to navigate with. Autonomous vehicles require a much higher level of accuracy and detail for localization and navigation.
Instead, developers of autonomous vehicles rely on lane-level, high-definition or "HD maps", that contain much more data, including the location of trees, curbs and road signs, as well as where the painting lane markers are on the road are.
To build these HD maps and continuously keep them updated is a more complicated and time-consuming process, so automakers like Toyota Motor Corp are exploring ways to create HD maps more efficiently and for less cost and the results of a recent collaboration look promising.
The advanced research arm of Toyota, Toyota Research Institute-Advanced Development (TRI-AD), which is tasked with robotics and AI development for the automaker, has successfully completed a proof of concepts ("PoC") for HD map building using satellite images with a relative accuracy of less than 50 centimeters, which is enough accuracy to support autonomous driving.
TRI-AD worked with Maxar Technologies (Maxar) on the project along with Japanese IT services provider NTT Data. Maxar is a Colorado-based company specializing in Earth observation, orbiting satellites, radar and other services. Maxar and TRI-AD collaborated on the PoC and built automated HD maps for automated vehicles using the highest-resolution commercial satellite imagery.
The companies have been collecting the satellite images since April 2019.
Once a satellite image is captured, the map data is extracted. This is done by analyzing, correcting and removing "non-map image pixels" such as vehicles, shadows cast by large buildings, and occlusions due to the inclination of buildings in satellite imagery. What left is a cleaner image of the road which can be used to build HD maps.
The PoC project was able to achieve a relative accuracy of 25 centimeters for key navigation features, representing a significant improvement in accuracy. The maps created were verified to be useful enough for autonomous vehicles to navigate with.
The original satellite image.
The same image with all of the vehicles removed.
TRI-AD is Also Working with CARMERA
TRI_AD is also working with New York City and Seattle-based company CARMERA. The company develops and maintains fully regenerative, production HD maps using crowdsourcing.
CARMERA collects street images from its fleet partners and drivers that agree to share their dash cam data with the company. The data from the street images collected from the vehicles is then used to make HD maps for autonomous vehicles. CARMERA is backed by the venture capital investment arm of Alphabet Inc. Google Ventures.
For the PoC using just dash cam footage, TRI-AD and CARMERA conducted a similar camera-based HD mapping initiative in Tokyo to detect and place key road features―such as lane markings, traffic signals and signs.
While this method is not as accurate as using satellite images, it achieved a relative accuracy of 40 centimeters for key navigation features, which is still a major advance in camera-only detection. TRI-AD found that both methods are effective for HD map building for autonomous vehicles.
CARMERA builds maps using data from inexpensive dash cams. (Photo: CARMERA)
One of the issues with this method of creating maps is being able to keep the maps updated. An autonomous vehicle using a HD map for navigation requires it to be up-to-date at all times. However, simple things like a temporary road closure must be reflected in the map then pushed out to all of the vehicles that will use it for navigation.
This is a painstaking process, which requires a vehicle to be manually driven over the area to be remapped to record the new changes. In the future, this may be able to be done using satellite images.
These methods to create HD maps takes much less time, reducing the cost of mapping the world's roads for autonomous vehicles.
TRI-AD also collaborated with location data and technology platform HERE Technologies to increase accuracy. HERE specializes in HD map building. The company is owned by a consortium of German automakers, BMW, Mercedes Benz and Audi.
HERE assisted TRI-AD by correcting any positional errors in the vehicle data collected. Afterwards, HERE automatically generated HD maps including the lane level information required for automated driving.
In addition to all of the other partners on the various projects, TRI-AD partnered with TomTom, a leader in navigation and mapping services. The companies showed that urban roads, including lane markings, could be successfully created or updated in near real-time using TomTom's cloud-based transactional mapmaking platform, just with data collected from a vehicle's sensors.
Today just 1% of the world's road and lane network is covered by HD maps. That figure is assuming that HD maps available are for the entire highway road network in the US, China, Germany, and Japan.
The roads in the four countries makes up less than 1% of the world's total road network, so there is still much mapping to be done. However, with the research being done by Toyota and its partner companies, mapping roads for autonomous vehicles might be much easier in the future.
Originally hailing from New Jersey, Eric is a automotive & technology reporter covering the high-tech industry here in Silicon Valley. He has over 15 years of automotive experience and a bachelors degree in computer science. These skills, combined with technical writing and news reporting, allows him to fully understand and identify new and innovative technologies in the auto industry and beyond. He has worked at Uber on self-driving cars and as a technical writer, helping people to understand and work with technology.
Ford Motor Co Officially Starts Production of the Rugged New Bronco SUV
GM’s Autonomous Driving Unit Cruise to Tap $5 Billion Credit Line to Mass Produce the Origin Autonomous Shuttle
Lidar Pioneer Velodyne Unveils its Next-Generation Velabit Sensor
CEO, CFO of Electric Truck Startup Lordstown Motors Abruptly Resign
Tesla Challenger NIO Gains Approval to Sell its Electric ES8 SUV in Europe, its First Overseas Market
Sweden-based EV Battery Startup Northvolt, Founded by Former Tesla Execs, Raises $2.75 Billion in New Equity
OneD Battery Sciences Announces Breakthrough Silicon EV Battery Technology called ‘SINANODE’
Xilinx Inc. Raises the Bar for Automotive Edge Computing with the World’s Highest AI Performance-per-Watt Processor
- Tesla Chief Elon Musk Claims the Redesigned Roadster With SpaceX Package Will Hit 60 MPH in 1.1 Second
- First Edition Mach-E Buyers Are Getting a 3D-Printed Pony Sculpture as a Gift From Ford
- Ford Passes 100,000 Reservations for 2022 F-150 Lightning
- Polestar 2 Lineup Expanded to Take on Tesla
- OneD Battery Sciences Announces Breakthrough Silicon EV Battery Technology called ‘SINANODE’
- Ford to Recall Nearly 35,000 Lincoln Aviators to Fix a Problem With the Rear View Camera, it’s the 9th Recall Involving the Luxury SUV
- The CEO of Alphabet’s Autonomous Driving Division Waymo Steps Down From His Role
- General Motors Looks to Make Long-Range EV Batteries With MIT Spinoff SolidEnergy Systems
- Volvo’s Electric-Performance Brand Polestar Launches Mobile Service Program for the U.S.
- The FCC Grants Waiver Requests to Six Developers of Radar-based Vehicle Cabin Monitors, Including Tesla