With advancements in artificial intelligence (AI) and 5G network connectivity, smart-road infrastructure technology offers the promise of being added to many different roads, bridges, and other transit systems across the U.S.

Understanding The Opportunities for AI-Cameras and LiDARs for Smart Road Infrastructure
Understanding The Opportunities for AI-Cameras and LiDARs for Smart Road Infrastructure

Dr. Georges Aoude is the co-founder | Derq

As the Consumer Electronics Show (CES) in January sparked a new wave of autonomous vehicles (AVs) coming to the automotive market in the next few years, much focus as of late has been on the technology of these vehicles themselves. However, the technology embedded in road infrastructure is also beginning to see more conversation between service providers and municipalities.

With advancements in artificial intelligence (AI) and 5G network connectivity, smart-road infrastructure technology offers the promise of being added to many different roads, bridges, and other transit systems across the U.S. in hopes of improving real-time traffic analytics and tackling the most challenging road safety and traffic management problems. One technology at the center of this discussion is on the present-day use of AI-enhanced cameras and tomorrow’s promise of LiDAR technology.

 

Artificial Intelligence Will Enhance Camera Sensing Performance

Today there are hundreds of thousands of traffic cameras deployed in the U.S. alone, and even millions more when CCTV cameras are considered. They are mainly used for road monitoring and basic traffic management applications (e.g., loop emulation). However, bringing the latest advancements of AI to these assets can immediately improve basic application performance and unlock more advanced software applications and use-cases.

AI and Machine Learning deliver superior sensing performance over traditional computer vision techniques found in legacy cameras. They enable more robust, flexible, and accurate detection, tracking and classification of all road users with algorithms that can automatically adapt to various lighting and weather conditions. In addition, they allow for predictive capabilities to better model road user movements and behaviors, and improve road safety. Agencies can immediately benefit from AI-enhanced cameras with applications such as road conflict detection and analysis, pedestrian crossing prediction and infrastructure sensing for AV deployments.

 

LiDAR Technology Cannot Fully Replace Cameras

LiDARs can provide complementary and sometimes overlapping value with cameras, however there are still several safety critical edge cases where LiDAR’s technology does not perform well (e.g., heavy rain and snow, granular classification), and where cameras have been proven to handle better. Moreover, today’s LiDARs technology remains expensive to deploy at scale due to its high unit price and limited field of view. As an example, it would take multiple LiDARs at a hefty investment to be deployed in a single intersection, where just one 360-degree AI-camera can be a more cost-effective solution.

For many budget-focused communities, AI-cameras remain the proven technology of choice today. Over time, as the cost of LiDAR technology moderates, communities should evaluate augmenting their infrastructure with such sensors.

 

Eventually, Sensor Fusion Will Drive Strong Results

When the cost of LiDAR technology eventually sees an anticipated reduction it will be viewed as a strong and viable addition to the AI-enhanced cameras that are being installed today. Similar to autonomous vehicles, sensor fusion would be the go-to approach for smart infrastructure solutions and would allow to maximize the benefits of both technologies.

 

Relative Performance Comparison of Camera vs. LiDARs Today

Feature

Legacy Camera

AI-powered Camera 1
 

LiDARs

AI-powered Camera and LiDARs Fusion 

Challenging lighting (low light, glare) 

Low

Medium

High

High

Adverse weather conditions (snow, rain, fog)

Low

High

Medium

High

Localization

Low

Medium

High

High

Classification

Low

High

Medium

High

Affordability

High

Medium

Low2

Low2

  1. Assumes presence of IR or good low-light sensor
  2. Expected to improve with time

 

The use of a cost-effective and performing AI-powered camera today, combined with the great potential of LiDARs in the coming years could help communities and municipalities achieve a win-win scenario today and tomorrow.

 

At the end of the day, the goal is clear in improving overall traffic flow and diminishing vehicle crashes and fatalities, but the technology and implementation strategy has to be right in doing so. The technology monitoring our roads needs to change too, thus calling for the consideration of AI-powered cameras today with the promise of LiDARs tomorrow.

 

 

About Dr. Georges Aoude

Dr. Georges Aoude is the co-founder of Derq, an MIT spinoff powering the future of connected and autonomous roads, making cities smarter and safer for all road users, and enabling the deployment of autonomous vehicles at scale. Derq provides cities and fleets with an award-winning and patented smart infrastructure Platform powered by AI that helps them tackle the most challenging road safety and traffic management problems.

 
The content & opinions in this article are the author’s and do not necessarily represent the views of RoboticsTomorrow

Comments (0)

This post does not have any comments. Be the first to leave a comment below.


Post A Comment

You must be logged in before you can post a comment. Login now.

Featured Product

BitFlow Introduces 6th Generation Camera Link Frame Grabber: The Axion

BitFlow Introduces 6th Generation Camera Link Frame Grabber: The Axion

BitFlow has offered a Camera Link frame grabbers for almost 15 years. This latest offering, our 6th generation combines the power of CoaXPress with the requirements of Camera Link 2.0. Enabling a single or two camera system to operate at up to 850 MB/S per camera, the Axion-CL family is the best choice for CL frame grabber. Like the Cyton-CXP frame grabber, the Axion-CL leverages features such as the new StreamSync system, a highly optimized DMA engine, and expanded I/O capabilities that provide unprecedented flexibility in routing. There are two options available; Axion 1xE & Axion 2xE. The Axion 1xE is compatible with one base, medium, full or 80-bit camera offering PoCL, Power over Camera Link, on both connectors. The Axion 2xE is compatible with two base, medium, full or 80-bit cameras offering PoCL on both connectors for both cameras. The Axion-CL is a culmination of the continuous improvements and updates BitFlow has made to Camera Link frame grabbers.