AdaSky Demonstrates its Thermal Vision Solution for Autonomous Cars at CES
【Summary】AdaSky was among the many companies showing off impressive autonomous driving technology at this year’s CES in Las Vegas, where the company demonstrated its VIPER vision system. AdaSky says it’s a breakthrough sensing solution to enable autonomous driving in any lighting or weather condition.
LAS VEGAS — AdaSky was among the many companies showing off impressive autonomous driving technology at this year's CES in Las Vegas, where the company demonstrated its VIPER vision system. AdaSky says it's a breakthrough sensing solution to enable autonomous driving in any lighting or weather condition.
AdaSky has combined a far infrared (FIR) thermal camera with advanced machine vision algorithms that allows autonomous vehicles see and understand the road in the rain, at night, and in fog. The compact system is 2.6 cm in diameter and 4.3 cm long. The solid state camera has no moving parts and meets ISO 26262 safety standards.
AdaSky's perception solution allows autonomous vehicles to reliably detect, segment, and analyze pedestrians, bicyclists, animals, objects, and road conditions, regardless of weather conditions. The Viper is also passive, which means it does not need to illuminate the road ahead, nor will it cause interference with other vehicle systems.
We drove off in the Cadillac in light rain and fog, unusual weather for normally sunny Las Vegas, but perfect conditions to show off the Viper's thermal detection capabilities.
AdaSky's Viper allows the vehicle to sense and analyze its surroundings by passively collecting FIR signals to detect the thermal energy radiated from objects and their body heat. AdaSky's image processing and computer vision algorithms process the signals collected by the camera to provide accurate object detection and scene analysis, giving the vehicle a new layer of perception information.
AdaSky's Vison FIR camera, mounted on the roof of a Cadillac CTS
I met with Eyal Madar, Vice President of R&D at AdaSky, and Albert Achtenberg, Vice President of Software Engineering, who offered me a demonstration of the company's Viper vision system.
The company installed its camera on the roof of a Cadillac CTS test vehicle to demonstrate the camera's capabilities. We drove off in the Cadillac from the CES event in light rain and fog, unusual weather for normally sunny Las Vegas, but perfect conditions to show off the Viper's thermal detection capabilities.
AdaSky says it uses advanced machine learning algorithms to identify objects within the camera's field of view. The system worked well, it was able to detect and highlight pedestrians from over 150 meters away, well before a human driver could see them. Other sensors used in autonomous development, such as LiDAR and radar have reduced performance under these low-visibility conditions.
During our test drive, pedestrians were automatically detected and labeled, as the system quickly highlighted each person on the display. As we drove down a tree lined road, even birds roosting in the nearby trees to escape the rain were picked up and displayed as white objects on the dash mounted display.
How Thermal Cameras Work
Thermal sensitivity is measured in milliKelvins (mK). Infrared cameras are more sensitive with values at the low end of the scale. For example, cameras with 50 mK are about 4 times as sensitive as a camera with 200 mK of thermal sensitivity. The more sensitive (50 mK) cameras provide a wider temperature difference, resulting in more colors on the thermal display.
AdaSky's FIR camera operates in the 50 mK range, enabling it to pick up cars, living creatures such as dogs, and other man-made objects.
To achieve autonomous driving, vehicles must first have fail-safe vision and perception in dynamic, changing lighting conditions, including direct sunlight.
AdaSky aims to bridge this gap and expedite level 3, 4, and even up to level 5 autonomous driving with its FIR camera, which allows a vehicle to ‘see' up to 200 meters down the road in total darkness and in any lighting or weather conditions.
AdaSky does not intend to replace other sensors on the market today. The Viper is intended as a supplemental system. Viper helps fill in gaps in perception left by other vision cameras, such as radar and LiDAR – and even sensor fusion results from a combination of all three. Automakers can utilize Viper to add an additional layer to the vehicle's perception ability, enabling car manufacturers to realize the goal of producing fully autonomous vehicles.
Originally hailing from New Jersey, Eric is a automotive & technology reporter covering the high-tech industry here in Silicon Valley. He has over 15 years of automotive experience and a bachelors degree in computer science. These skills, combined with technical writing and news reporting, allows him to fully understand and identify new and innovative technologies in the auto industry and beyond. He has worked at Uber on self-driving cars and as a technical writer, helping people to understand and work with technology.
GM to Invest $2.2 billion in its Detroit-Hamtramck Factory to Build Only Electric Vehicles
Mercedes Benz Scales Back Production of the Electric EQC Due to Battery Shortage
BMW Invests $25 Million in Silicon Valley-based Software Motor Company
Cruise Debuts the 'Origin', an Autonomous Urban Robotaxi Built for Ride-Hailing
Tesla Announces it Will Use Baidu Maps in its China-Made Vehicles
Uber is Testing a New Feature in California Allowing Some Drivers to Set Their Own Fares
The NHTSA Will Review a Petition to Investigate Sudden Acceleration Complaints on Tesla Vehicles
Volvo to Build an Electric Vehicle Battery Plant in the U.S.
- Toyota Confirms a Compact Mass-Market EV, Here's What We Know So Far
- Uber Reports $1.2 Billion Loss in Q3, CEO Says the Company Will Be Profitable by 2021
- BMW Upcoming iX2 Electric Crossover Spied for the First Time
- MIT Study Finds EVs to Cost More Than Regular Cars Until 2030
- Volvo Cars to Use Blockchain to Track the Source of Cobalt for EV Batteries
- Tesla Given Green Light to Start Building Vehicles at its Shanghai Gigafactory
- Ford to Invest $1.45 Billion in Two Michigan Plants to Support Production of the New Bronco and Hybrid & Electric F-150 Pickups
- Lincoln's Upcoming Electric SUV Might Use Rivian's Skateboard EV Platform
- Huawei to Develop Radar for Self-Driving Cars in Push into Auto Industry, Execs Say
- Tesla’s Latest Stock Surge Raises its Market Value Higher Than Rivals GM & Ford Combined