Introspection of dnn-based perception functions in automated driving systems: State-of-the-art and open research challenges

HY Yatbaz, M Dianati… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Automated driving systems (ADSs) aim to improve the safety, efficiency and comfort of future
vehicles. To achieve this, ADSs use sensors to collect raw data from their environment. This …

Fsnet: A failure detection framework for semantic segmentation

QM Rahman, N Sünderhauf, P Corke… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
Semantic segmentation is an important task that helps autonomous vehicles understand
their surroundings and navigate safely. However, during deployment, even the most mature …

Measuring driver situation awareness using region-of-interest prediction and eye tracking

M Hofbauer, CB Kuhn, L Püttner… - … on Multimedia (ISM), 2020 - ieeexplore.ieee.org
With increasing progress in autonomous driving, the human does not have to be in control of
the vehicle for the entire drive. A human driver obtains the control of the vehicle in case of an …

Introspective failure prediction for autonomous driving using late fusion of state and camera information

CB Kuhn, M Hofbauer, G Petrovic… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
We present an introspective failure prediction approach for autonomous vehicles. In
autonomous driving, complex or unknown scenarios can cause a disengagement of the self …

Trajectory-based failure prediction for autonomous driving

CB Kuhn, M Hofbauer, G Petrovic… - 2021 IEEE Intelligent …, 2021 - ieeexplore.ieee.org
In autonomous driving, complex traffic scenarios can cause situations that require human
supervision to resolve safely. Instead of only reacting to such events, it is desirable to predict …

Pixel-wise failure prediction for semantic video segmentation

CB Kuhn, M Hofbauer, Z Xu, G Petrovic… - … on Image Processing …, 2021 - ieeexplore.ieee.org
We propose a pixel-accurate failure prediction approach for semantic video segmentation.
The proposed scheme improves previously proposed failure prediction methods which so …

” Where Does the Devil Lie?”: Multimodal Multitask Collaborative Revision Network for Trusted Road Segmentation

G Hua, D Zheng, S Tian, W Zou… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Road segmentation is an essential component of navigation systems. Although recent
advancements in road segmentation, the occurrence of failure segmentations remains …

Learning from learned network: an introspective model for arthroscopic scene segmentation

S Ali, F Dayoub, AK Pandey - Proceedings of International Conference on …, 2023 - Springer
The knee joint, due to its complex, confined, and dynamic nature, poses several challenges
in visualizing anatomical details for diagnostic and minimally invasive surgical procedures …

Reverse error modeling for improved semantic segmentation

CB Kuhn, M Hofbauer, G Petrovic… - … Conference on Image …, 2022 - ieeexplore.ieee.org
We propose the concept of error-reversing autoencoders (ERA) for correcting pixel-wise
errors made by an arbitrary semantic segmentation model. For this, we reframe the …

Better look twice-improving visual scene perception using a two-stage approach

CB Kuhn, M Hofbauer, G Petrovic… - … on Multimedia (ISM), 2020 - ieeexplore.ieee.org
Accurate visual scene perception plays an important role in fields such as medical imaging
or autonomous driving. Recent advances in computer vision allow for accurate image …