Online learning: A comprehensive survey

SCH Hoi, D Sahoo, J Lu, P Zhao - Neurocomputing, 2021 - Elsevier
Online learning represents a family of machine learning methods, where a learner attempts
to tackle some predictive (or any type of decision-making) task by learning from a sequence …

An overview of multi-task learning

Y Zhang, Q Yang - National Science Review, 2018 - academic.oup.com
As a promising area in machine learning, multi-task learning (MTL) aims to improve the
performance of multiple related learning tasks by leveraging useful information among them …

Efficiently identifying task groupings for multi-task learning

C Fifty, E Amid, Z Zhao, T Yu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Multi-task learning can leverage information learned by one task to benefit the training of
other tasks. Despite this capacity, naively training all tasks together in one model often …

Multi-task learning with deep neural networks: A survey

M Crawshaw - arXiv preprint arXiv:2009.09796, 2020 - arxiv.org
Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are
simultaneously learned by a shared model. Such approaches offer advantages like …

Multi-task learning for dense prediction tasks: A survey

S Vandenhende, S Georgoulis… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
With the advent of deep learning, many dense prediction tasks, ie, tasks that produce pixel-
level predictions, have seen significant performance improvements. The typical approach is …

Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints

F Sattler, KR Müller, W Samek - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Federated learning (FL) is currently the most widely adopted framework for collaborative
training of (deep) machine learning models under privacy constraints. Albeit its popularity, it …

Leaf: A benchmark for federated settings

S Caldas, SMK Duddu, P Wu, T Li, J Konečný… - arXiv preprint arXiv …, 2018 - arxiv.org
Modern federated networks, such as those comprised of wearable devices, mobile phones,
or autonomous vehicles, generate massive amounts of data each day. This wealth of data …

Forget-free continual learning with winning subnetworks

H Kang, RJL Mina, SRH Madjid… - International …, 2022 - proceedings.mlr.press
Abstract Inspired by Lottery Ticket Hypothesis that competitive subnetworks exist within a
dense network, we propose a continual learning method referred to as Winning …

End-to-end multi-task learning with attention

S Liu, E Johns, AJ Davison - … of the IEEE/CVF conference on …, 2019 - openaccess.thecvf.com
We propose a novel multi-task learning architecture, which allows learning of task-specific
feature-level attention. Our design, the Multi-Task Attention Network (MTAN), consists of a …

Spottune: transfer learning through adaptive fine-tuning

Y Guo, H Shi, A Kumar, K Grauman… - Proceedings of the …, 2019 - openaccess.thecvf.com
Transfer learning, which allows a source task to affect the inductive bias of the target task, is
widely used in computer vision. The typical way of conducting transfer learning with deep …