The Fundamental Limits of Least-Privilege Learning

T Stadler, B Kulynych, N Papernot, M Gastpar… - arXiv preprint arXiv …, 2024 - arxiv.org
The promise of least-privilege learning--to find feature representations that are useful for a
learning task but prevent inference of any sensitive information unrelated to this task--is …

Learning to transfer privileged information

V Sharmanska, N Quadrianto, CH Lampert - arXiv preprint arXiv …, 2014 - arxiv.org
We introduce a learning framework called learning using privileged information (LUPI) to the
computer vision field. We focus on the prototypical computer vision problem of teaching …

Fundamental limits and tradeoffs in invariant representation learning

H Zhao, C Dan, B Aragam, TS Jaakkola… - Journal of machine …, 2022 - jmlr.org
A wide range of machine learning applications such as privacy-preserving learning,
algorithmic fairness, and domain adaptation/generalization among others, involve learning …

Learning with privileged and sensitive information: a gradient-boosting approach

S Yan, P Odom, R Pasunuri, K Kersting… - Frontiers in Artificial …, 2023 - frontiersin.org
We consider the problem of learning with sensitive features under the privileged information
setting where the goal is to learn a classifier that uses features not available (or too sensitive …

On the Capacity Limits of Privileged ERM

M Sharoni, S Sabato - International Conference on Artificial …, 2023 - proceedings.mlr.press
We study the supervised learning paradigm called Learning Using Privileged Information,
first suggested by Vapnik and Vashist (2009). In this paradigm, in addition to the examples …

On characterizing the trade-off in invariant representation learning

B Sadeghi, S Dehdashtian, V Boddeti - arXiv preprint arXiv:2109.03386, 2021 - arxiv.org
Many applications of representation learning, such as privacy preservation, algorithmic
fairness, and domain adaptation, desire explicit control over semantic information being …

Overlearning reveals sensitive attributes

C Song, V Shmatikov - arXiv preprint arXiv:1905.11742, 2019 - arxiv.org
" Overlearning" means that a model trained for a seemingly simple objective implicitly learns
to recognize attributes and concepts that are (1) not part of the learning objective, and (2) …

Exploring some practical issues of SVM+: Is really privileged information that helps?

C Serra-Toro, VJ Traver, F Pla - Pattern Recognition Letters, 2014 - Elsevier
Learning using privileged information (LUPI) is a machine learning paradigm which aims at
improving classification by taking advantage of information that is only available at training …

Trustworthy representation learning across domains

R Zhu, D Guo, D Qi, Z Chu, X Yu, S Li - arXiv preprint arXiv:2308.12315, 2023 - arxiv.org
As AI systems have obtained significant performance to be deployed widely in our daily live
and human society, people both enjoy the benefits brought by these technologies and suffer …

Studying the interplay between information loss and operation loss in representations for classification

JF Silva, F Tobar, M Vicuña, F Cordova - arXiv preprint arXiv:2112.15238, 2021 - arxiv.org
Information-theoretic measures have been widely adopted in the design of features for
learning and decision problems. Inspired by this, we look at the relationship between i) a …