<html><head></head><body><p id="isPasted">Autonomous vehicles (AVs) have shown to&nbsp;<a href="https://www.wbur.org/hereandnow/2021/01/04/waymo-driverless-car" target="_blank">work well</a> in ideal weather conditions with clear skies, well-marked roads, and predicable routes. However, creating a system that can handle all types of weather and environmental conditions is significantly more challenging. Those issues become more pronounced in the development of autonomous and unmanned vehicles and other ground-based systems designed for off-road use, especially for vital industrial functions that power the global economy including resource extraction, agriculture, and construction. One of the key hurdles to overcoming harsh environments is accounting for particulate matter in the air, especially dust.</p><p>Existing sensor technologies found on vehicles equipped with advanced driver assistance systems (ADAS) and AVs today are degraded in dusty environments by reduced visibility and range of visible (RGB) cameras. Radar can effectively penetrate adverse conditions, including dust, but can only capture a partial picture of scene—it can’t classify objects nor distinguish between a living thing (the thing drivers least want to hit) and an inanimate object, a critical aspect to improving workplace safety as it relates to transportation. Radar also suffers from high false positive rate which limits its ability to operate independently without fusion with other sensors, typically mono cameras.</p><h2><strong>Perception Through Dust with</strong> <strong>Thermal Imaging</strong></h2><p>Through testing conducted by&nbsp;<a href="https://www.designnews.com/electronics/can-you-see-through-fog-you-better-be-sure-your-autonomous-vehicle-can" target="_blank">Teledyne FLIR</a> and other&nbsp;<a href="https://link.springer.com/chapter/10.1007/978-3-319-99762-9_1" target="_blank">government-funded programs</a>, long-wave infrared imaging (LWIR), which detects electromagnetic light in the 8 μm to 14 μm spectrum band, has proven to be effective at detecting objects where particulate matter suspended in the atmosphere reduces visibility. Thermal imaging is especially effective for pedestrian detection in comparison with RGB, near-infrared and short-wave infrared camera systems at night.</p><h2><strong>Improving Perception with Stereoscopic Thermal Imaging</strong></h2><p>To further improve the perception accuracy of thermal imaging cameras, pairing two together stereoscopically adds a third dimension to the data captured. Stereo paired thermal cameras can provide crucial depth perception through dust, including the ability to measure distances by triangulating the cameras with objects in the field of view.</p><p>That comprehension, combined with a convolutional neural network, enables the system to both identify objects and their respective distances to make the most appropriate decisions for the situation, in conjunction with the other sensor modalities mentioned above.</p><p>Furthermore, stereoscopic thermal imaging has recently become significantly more effective thanks to automotive vision systems innovator Foresight Automotive, part of the Thermal by FLIR® program. Its industry-first, patent-pending <a href="https://www.foresightauto.com/auto-calibration/" target="_blank">automatic calibration system</a>, is designed to ensure that stereo cameras remain calibrated regardless of their configuration or position, in order to create accurate and continuous depth perception..</p></body></html>

Stereoscopic Long-Wave Infrared Imaging Shows Promise for Industrial Autonomous Vehicles Navigating Low-Visibility Conditions

Thermal Stereo Solutions for Seeing Through Dust in Rugged Environments

autonomous vehicles

Deep learning has developed rapidly over the past ten years with the introduction of open-source neural networks and the availability of large, annotated datasets both made possible by the efforts of academics and large technology platforms.

Overcoming the Challenges of Bringing AI to the Edge

Sailors may not need to look out for bicyclists or pedestrians while on the open ocean, but that doesn’t mean there aren’t plenty of collision risks for boats to encounter.

Automatic Collision Avoidance System, "OSCAR," Brings Peace of Mind to Sailors

Power plants, enterprise data centers and airports are all critical infrastructure sites that demand a heightened level of protection.

What Are the Optimal Applications for the Elara-DX Series?

Vision is the cornerstone of every border surveillance platform. Pushing the boundaries of what we can see—from high ground and binoculars to electro-optics and infrared sensors—is the determining factor of a system’s efficacy.

Resolving Border Security Threats with Integrated Solutions

Bush fires have become a common phenomenon during Australia’s summer season. Usually, these fires destroy many acres of valuable land and they have a devastating impact on wildlife. Firefighters often risk their lives to stop fires from spreading.

TELEDYNE FLIR supports frontline responders in fighting Australian bush fires

Thermal Stereo Solutions for Seeing Through Dust in Rugged Environments

More by FLIR

Overcoming the Challenges of Bringing AI to the Edge

Automatic Collision Avoidance System, "OSCAR," Brings Peace of Mind to Sail...

What Are the Optimal Applications for the Elara-DX Series?