CARE: Counterfactual-based Algorithmic Recourse for Explainable Pose Correction

B Dittakavi, B Callepalli, A Vardhan… - Proceedings of the …, 2024 - openaccess.thecvf.com
Proceedings of the IEEE/CVF Winter Conference on Applications …, 2024openaccess.thecvf.com
With increasing popularity of home-based fitness regimen post-pandemic, there has been a
growing interest in fitness monitoring solutions. Owing to this, human pose monitoring has
gained significant commercial importance in the field of computer vision. Most efforts in the
past focused on the task of human pose classification for various applications. In this work,
we instead focus on a critical aspect of human pose monitoring that naturally follows from
basic pose classification ie, pose analysis and correction. Specifically, we study human pose …
Abstract
With increasing popularity of home-based fitness regimen post-pandemic, there has been a growing interest in fitness monitoring solutions. Owing to this, human pose monitoring has gained significant commercial importance in the field of computer vision. Most efforts in the past focused on the task of human pose classification for various applications. In this work, we instead focus on a critical aspect of human pose monitoring that naturally follows from basic pose classification ie, pose analysis and correction. Specifically, we study human pose correction through the lens of algorithmic recourse. Algorithmic recourse involves a model providing explanations on a how a model arrived at a decision, along with possible actions to drive the model to output a favorable decision. To this end, we develop CARE (Counterfactuals based Algorithmic Recourse for Explainable pose correction), a novel method that uses counterfactual explanations to provide recourse for incorrect human poses, thereby helping a user correct their pose. Experiments on three diverse datasets, including two fitness datasets and one hand gestures dataset, demonstrate the effectiveness and applicability of CARE.
openaccess.thecvf.com
以上显示的是最相近的搜索结果。 查看全部搜索结果