Renesas & StradVision Collaborate on a Deep-Learning Smart Camera for Autonomous Vehicles
【Summary】Renesas Electronics Corporation and vision processing technology provider StradVision have announced the joint development of a deep learning-based object recognition solution for smart cameras for use in advanced driver assistance system (ADAS) and vision systems for the next-generation of autonomous vehicles.
Tokyo-based Renesas Electronics Corporation, a supplier of advanced semiconductor and SoC products, together with vision processing technology provider StradVision, have announced the joint development of a deep learning-based object recognition solution for smart cameras for use in advanced driver assistance system (ADAS) and vision systems for the next-generation of autonomous vehicles.
StradVision is a Korean AI startup and a pioneer in vision processing technology. The company is developing software that allows ADAS in autonomous vehicles to reach a higher level of safety. The company's deep-learning object detection software is designed to detect the most vulnerable road users, including pedestrians and bicyclists.
Future autonomous vehicles will require advanced, high-precision object recognition, especially in urban areas. The challenge for developers is engineering a robust enough camera that consumes very little power and is scalable for the auto industry. The two companies claim their deep-learning object detection system achieves both, and is designed to accelerate the widespread adoption of ADAS in future automated vehicles.
StradVision says its deep learning–based object recognition software delivers high performance for recognizing vehicles, pedestrians, and lane marking. StradVision's SVNet External software enables vehicles to execute ADAS and self-driving functions, such as automatic emergency braking, adaptive cruise control and lane departure warning systems.
StradVision's SVNet is one of the few novel networks in the industry that meets the accuracy and computational requirements for commercial use on automotive embedded hardware, according to the company.
The Renesas R-Car Family of SoCs
In the partnership with Renesas, StrandVision's object recognition software has been optimized for two of Renesas' R-Car automotive system-on-chip (SoC) products, the R-Car V3H and V3M.
The Renesas "R-Car" is a system-on-chip (SoC) family, designed for the next-generation of automotive computing for autonomous vehicles. The V3H includes a pair of Arm multicore blocks. The main processor is a 1-GHz, quad-core, Cortex-A53 MPCore. The real-time processor is a dual, lockstep 800-MHz Cortex-R7.
The Renesas R-Car family of SoC hardware also incorporates a dedicated engine for deep-learning processing called CNN-IP (Convolution Neural Network Intellectual Property), enabling the chips to run StradVision's SVNet automotive deep learning network at high speed using minimal power, making its use suitable for ADAS used in mass-produced vehicles.
"A leader in vision processing technology, StradVision has abundant experience developing ADAS implementations using Renesas' R-Car SoCs, and with this collaboration, we are enabling production-ready solutions that enable safe and accurate mobility in the future," said Naoki Yoshida, Vice President of Renesas' Automotive Technical Customer Engagement Business Division. "This new joint deep learning-based solution optimized for R-Car SoCs will contribute to the widespread adoption of next-generation ADAS implementations and support the escalating vision sensor requirements expected to arrive in the next few years."
The V3H SoC is optimized specifically for computer vision processing.It is designed to work with stereo forward-facing front cameras on a vehicle. Renesas says the V3H achieves five times higher computer vision performance than its predecessor the V3M. The V3H SoC increases the reliability of computer vision-based camera systems while reducing cost.
StradVision's SVNet deep learning software is a powerful AI perception solution for autonomous vehicles. The perception system offers high-precision even in low-light environments. The perception software and can also detect objects that are partially hidden by other objects, offering additional safety for automotive ADAS applications.
"StradVision's world-class team has worked hard to make sure that our SVNet software is respected throughout the industry due to our unique deep learning-based approach," said StradVision CEO Junhwan Kim. "StradVision will have a prominent role in the development of Autonomous Vehicles."
By 2021, StradVision plans to have more than 6 million vehicles on the road using SVNet, which is compliant with strict automotive safety standards, including Euro NCAP and Guobiao (GB) in China.
After 2021, StradVision aims to provide software for Level-4 autonomous vehicles.
For developers wishing to customize the software, StradVision provides support for deep learning-based object recognition, including training through the embedding of software for mass-produced vehicles.
In addition to the CNN-IP dedicated deep learning module, the Renesas R-Car V3H and R-Car V3M feature the company's IMP-X5 image recognition engine, which combines deep learning-based object recognition and highly verifiable image recognition processing, allowing designers to build a robust system to detect objects such as road signs and lane markings.
In addition, the on-chip image signal processor (ISP) is designed to convert sensor signals for image rendering and recognition processing. This makes it possible to configure a system using inexpensive cameras without built-in ISPs, reducing the overall cost of materials.
The basic software package for the Renesas R-Car V3H SoC identifies vehicles, pedestrians and road lanes at a rate of 25 frames per second.
Renesas R-Car SoCs are scheduled to be available to developers by early 2020.
Originally hailing from New Jersey, Eric is a automotive & technology reporter covering the high-tech industry here in Silicon Valley. He has over 15 years of automotive experience and a bachelors degree in computer science. These skills, combined with technical writing and news reporting, allows him to fully understand and identify new and innovative technologies in the auto industry and beyond. He has worked at Uber on self-driving cars and as a technical writer, helping people to understand and work with technology.
Ford Motor Co Officially Starts Production of the Rugged New Bronco SUV
GM’s Autonomous Driving Unit Cruise to Tap $5 Billion Credit Line to Mass Produce the Origin Autonomous Shuttle
Lidar Pioneer Velodyne Unveils its Next-Generation Velabit Sensor
CEO, CFO of Electric Truck Startup Lordstown Motors Abruptly Resign
Tesla Challenger NIO Gains Approval to Sell its Electric ES8 SUV in Europe, its First Overseas Market
Sweden-based EV Battery Startup Northvolt, Founded by Former Tesla Execs, Raises $2.75 Billion in New Equity
OneD Battery Sciences Announces Breakthrough Silicon EV Battery Technology called ‘SINANODE’
Xilinx Inc. Raises the Bar for Automotive Edge Computing with the World’s Highest AI Performance-per-Watt Processor
- Tesla Chief Elon Musk Assures Customers in China That its Vehicle Cameras Are Not Active, Addressing Recent Security Concerns
- Volkswagen’s Updated Electrification Plans Push its Market Cap Towards $150 Billion
- General Motors Announces ‘Ultium Charge 360’ a Nationwide EV Charging Network Designed for Convenience
- Electric Truck Startup Rivian Applies for Zoning Amendment for a 380 Acre Site Near its Illinois Factory for Future Expansion
- China’s Baidu is Building an Entire ‘Mobility as a Service’ Ecosystem Around Autonomous Vehicles
- First Edition Mach-E Buyers Are Getting a 3D-Printed Pony Sculpture as a Gift From Ford
- China’s Baidu Announces ‘Apollo Air’ Which Supports Self-driving Vehicles Using Real-time Data From 5G-Connected Roadside Units
- EV Startup Canoo Wants to Get in on Electric Pickup War With its New Concept
- WaveSense Announces a $15 Million Funding Round to Accelerate Autonomous Driving Using Ground Penetrating Radar
- Ride-Sharing Startup Revel is Launching a Transportation Service in New York City Using Only Company-owned Tesla Model Ys