Reverse error modeling for improved semantic segmentation

CB Kuhn, M Hofbauer, G Petrovic… - … Conference on Image …, 2022 - ieeexplore.ieee.org
2022 IEEE International Conference on Image Processing (ICIP), 2022ieeexplore.ieee.org
We propose the concept of error-reversing autoencoders (ERA) for correcting pixel-wise
errors made by an arbitrary semantic segmentation model. For this, we reframe the
segmentation model as an error function applied to the ground truth labels. Then, we train
an autoencoder to reverse this error function. During testing, the autoencoder reverses the
approximated error function to correct the classification errors. We consider two sources of
errors. First, we target the errors made by a model despite having being trained with clean …
We propose the concept of error-reversing autoencoders (ERA) for correcting pixel-wise errors made by an arbitrary semantic segmentation model. For this, we reframe the segmentation model as an error function applied to the ground truth labels. Then, we train an autoencoder to reverse this error function. During testing, the autoencoder reverses the approximated error function to correct the classification errors. We consider two sources of errors. First, we target the errors made by a model despite having being trained with clean, accurately labeled images. In this case, our proposed approach achieves an improvement of around 1% on the Cityscapes data set with the state-of-the-art DeepLabV3+ model. Second, we target errors introduced by compromised images. With JPEG-compressed images as input, our approach improves the segmentation performance by over 70% for high levels of compression. The proposed architecture is simple to implement, fast to train and can be applied to any semantic segmentation model as a post-processing step.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果