Efficient continuous pareto exploration in multi-task learning

P Ma, T Du, W Matusik - International Conference on …, 2020 - proceedings.mlr.press
Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a
result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced …

Multi-task learning as multi-objective optimization

O Sener, V Koltun - Advances in neural information …, 2018 - proceedings.neurips.cc
In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them.
Multi-task learning is inherently a multi-objective problem because different tasks may …

Pareto multi-task learning

X Lin, HL Zhen, Z Li, QF Zhang… - Advances in neural …, 2019 - proceedings.neurips.cc
Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously.
However, it is often impossible to find one single solution to optimize all the tasks, since …

Multi-task learning with user preferences: Gradient descent with controlled ascent in pareto optimization

D Mahapatra, V Rajan - International Conference on …, 2020 - proceedings.mlr.press
Abstract Multi-Task Learning (MTL) is a well established paradigm for jointly learning
models for multiple correlated tasks. Often the tasks conflict, requiring trade-offs between …

Revisiting scalarization in multi-task learning: A theoretical perspective

Y Hu, R Xian, Q Wu, Q Fan, L Yin… - Advances in Neural …, 2024 - proceedings.neurips.cc
Linear scalarization, ie, combining all loss functions by a weighted sum, has been the
default choice in the literature of multi-task learning (MTL) since its inception. In recent years …

Pareto-based multiobjective machine learning: An overview and case studies

Y Jin, B Sendhoff - IEEE Transactions on Systems, Man, and …, 2008 - ieeexplore.ieee.org
Machine learning is inherently a multiobjective task. Traditionally, however, either only one
of the objectives is adopted as the cost function or multiple objectives are aggregated to a …

Pareto set learning for expensive multi-objective optimization

X Lin, Z Yang, X Zhang… - Advances in neural …, 2022 - proceedings.neurips.cc
Expensive multi-objective optimization problems can be found in many real-world
applications, where their objective function evaluations involve expensive computations or …

A multi-objective/multi-task learning framework induced by pareto stationarity

M Momma, C Dong, J Liu - International Conference on …, 2022 - proceedings.mlr.press
Multi-objective optimization (MOO) and multi-task learning (MTL) have gained much
popularity with prevalent use cases such as production model development of regression …

Hypervolume maximization: A geometric view of pareto set learning

X Zhang, X Lin, B Xue, Y Chen… - Advances in Neural …, 2023 - proceedings.neurips.cc
This paper presents a novel approach to multiobjective algorithms aimed at modeling the
Pareto set using neural networks. Whereas previous methods mainly focused on identifying …

Controllable pareto multi-task learning

X Lin, Z Yang, Q Zhang, S Kwong - 2020 - openreview.net
A multi-task learning (MTL) system aims at solving multiple related tasks at the same time.
With a fixed model capacity, the tasks would be conflicted with each other, and the system …