Optical sensor systems consisting of light detection and ranging sensors (LiDAR) and stereo or mono cameras in combination with radio detection and ranging sensors (RADAR) are frequently used in advanced driver-assistance systems (ADAS). The sensor data from these systems are the basis for environmental perceptions and, therefore, the basis for decision-making.
Since the different sensors use various measurement principles and rely on dissimilar physical properties, these sensors react individually to various environmental influences.
For this reason, multimodal sensor data fusion based on sensor-specific properties will be introduced in this thesis. This is intended to improve environmental perception, which can be used as input information for the highly automated driving (HAD) function. It is part of the research work investigating the transferability to other applications such as people flow tracking.
For this purpose, the relevant environmental impacts are to be extracted from the sensors' data, which are used for environmental perception. Therefore, environmental influences such as rain, fog, or motion distortion are to be detected and quantified with the use of Neural Networks.
Considering these environmental conditions and their influence on the sensor system, an adaptive sensor data fusion method will be realized. Machine- or Deep Learning shall be used to find the optimal parameters for fusing the data based on the derived environmental conditions. This is to achieve an optimized environmental perception by the system.
Adaptive Multimodal Sensor Data Fusion for Environmental Perception (tbc)
MITGLIED IM KOLLEG
seit
Prof. Dr.-Ing. Thomas Zeh
Forschungsschwerpunkte:
- Sensorik zur Umfelderfassung / Sensors for Environmental Perception
- Modellierung von Sensoren in Virtueller Umgebung / Sensors Modelling in Virtual Environment
- Zuverlässige Elektronik für Raumfahrtanwendungen / Reliable Electronics for Space Applications
Betreute Projekte:
Prof. Dr.-Ing. habil. Dr. h.c. Alexander W. Koch
Forschungsschwerpunkte:
Optomechatronische Messsysteme
Lasermesstechnik
Holographische Speckle-Interferometrie
Betreute Projekte: