AdaSky Demonstrates its Thermal Vision Solution for Autonomous Cars at CES
【Summary】AdaSky was among the many companies showing off impressive autonomous driving technology at this year’s CES in Las Vegas, where the company demonstrated its VIPER vision system. AdaSky says it’s a breakthrough sensing solution to enable autonomous driving in any lighting or weather condition.
LAS VEGAS — AdaSky was among the many companies showing off impressive autonomous driving technology at this year's CES in Las Vegas, where the company demonstrated its VIPER vision system. AdaSky says it's a breakthrough sensing solution to enable autonomous driving in any lighting or weather condition.
AdaSky has combined a far infrared (FIR) thermal camera with advanced machine vision algorithms that allows autonomous vehicles see and understand the road in the rain, at night, and in fog. The compact system is 2.6 cm in diameter and 4.3 cm long. The solid state camera has no moving parts and meets ISO 26262 safety standards.
AdaSky's perception solution allows autonomous vehicles to reliably detect, segment, and analyze pedestrians, bicyclists, animals, objects, and road conditions, regardless of weather conditions. The Viper is also passive, which means it does not need to illuminate the road ahead, nor will it cause interference with other vehicle systems.
We drove off in the Cadillac in light rain and fog, unusual weather for normally sunny Las Vegas, but perfect conditions to show off the Viper's thermal detection capabilities.
AdaSky's Viper allows the vehicle to sense and analyze its surroundings by passively collecting FIR signals to detect the thermal energy radiated from objects and their body heat. AdaSky's image processing and computer vision algorithms process the signals collected by the camera to provide accurate object detection and scene analysis, giving the vehicle a new layer of perception information.
AdaSky's Vison FIR camera, mounted on the roof of a Cadillac CTS
I met with Eyal Madar, Vice President of R&D at AdaSky, and Albert Achtenberg, Vice President of Software Engineering, who offered me a demonstration of the company's Viper vision system.
The company installed its camera on the roof of a Cadillac CTS test vehicle to demonstrate the camera's capabilities. We drove off in the Cadillac from the CES event in light rain and fog, unusual weather for normally sunny Las Vegas, but perfect conditions to show off the Viper's thermal detection capabilities.
AdaSky says it uses advanced machine learning algorithms to identify objects within the camera's field of view. The system worked well, it was able to detect and highlight pedestrians from over 150 meters away, well before a human driver could see them. Other sensors used in autonomous development, such as LiDAR and radar have reduced performance under these low-visibility conditions.
During our test drive, pedestrians were automatically detected and labeled, as the system quickly highlighted each person on the display. As we drove down a tree lined road, even birds roosting in the nearby trees to escape the rain were picked up and displayed as white objects on the dash mounted display.
How Thermal Cameras Work
Thermal sensitivity is measured in milliKelvins (mK). Infrared cameras are more sensitive with values at the low end of the scale. For example, cameras with 50 mK are about 4 times as sensitive as a camera with 200 mK of thermal sensitivity. The more sensitive (50 mK) cameras provide a wider temperature difference, resulting in more colors on the thermal display.
AdaSky's FIR camera operates in the 50 mK range, enabling it to pick up cars, living creatures such as dogs, and other man-made objects.
To achieve autonomous driving, vehicles must first have fail-safe vision and perception in dynamic, changing lighting conditions, including direct sunlight.
AdaSky aims to bridge this gap and expedite level 3, 4, and even up to level 5 autonomous driving with its FIR camera, which allows a vehicle to ‘see' up to 200 meters down the road in total darkness and in any lighting or weather conditions.
AdaSky does not intend to replace other sensors on the market today. The Viper is intended as a supplemental system. Viper helps fill in gaps in perception left by other vision cameras, such as radar and LiDAR – and even sensor fusion results from a combination of all three. Automakers can utilize Viper to add an additional layer to the vehicle's perception ability, enabling car manufacturers to realize the goal of producing fully autonomous vehicles.
Originally from New Jersey, Eric is an automotive and technology reporter specializing in the high-tech industry in Silicon Valley. Eric has over fifteen years of automotive experience and a B.A. in computer science. These skills, combined with technical writing and news reporting, allows him to fully understand and identify new and innovative technologies in the automotive industry and beyond. He has worked on self-driving cars and as a technical writer, helping people to understand and work with technology. Outside of work, Eric likes to travel to new places, play guitar, and explore the outdoors.
Volvo & NVIDIA Announce a New Partnership to Develop Autonomous Vehicles
NVIDIA Unveils a 'Supercomputer' to Speed Development of Self-Driving Cars
Self-driving Truck Startup TuSimple Launching ‘Autonomous Vehicle Operations Specialist Program’ with Local College
Tesla Denied Tariff Exemption for Chinese-made CPU in the Model 3
Uber Debuts its New Self-Driving Volvo XC90 SUVs, Designed to Operate Without a Safety Driver
BMW Introduces ‘Smart Glasses’ to Assist Service Technicians at its U.S. Dealerships
Silicon Valley Startup Aurora to Work with Fiat Chrysler on a Self-Driving Platform
Autonomous Delivery Startup Gatik Emerges From Stealth, Announces Partnership with Walmart
- Porsche Fined $598 Million for its Role in the ‘Dieselgate’ Emissions Scandal
- Germany Opens First Electric Highway to Charge Hybrid Semi-Trucks
- Audi Turning to Green Factory to Manufacture EVs
- NVIDIA Unveils a 'Supercomputer' to Speed Development of Self-Driving Cars
- Lyft Users Will Soon Be Able to Summon a Self-Driving Waymo Minivan in Arizona
- The U.S. is About to Face a Battery Shortage in Race to Ramp up EV Production
- Lyft Valued $24.3 Billion Ahead of Tomorrow’s IPO, Becoming the First Ride-Hailing Company to Go Public
- Daimler, Volkswagen & BMW Face Big Fines After Being Charged With Emissions Collusion
- The Next Hyundai Kona Electric is Getting a 11 kW 3-Phase Onboard Charger
- Robotics Startup Nuro & Domino’s to Deliver Pizza Using Unmanned Autonomous Vehicles