Self-supervised learning for recommender systems: A survey

J Yu, H Yin, X Xia, T Chen, J Li… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In recent years, neural architecture-based recommender systems have achieved
tremendous success, but they still fall short of expectation when dealing with highly sparse …

A survey of graph neural networks for recommender systems: Challenges, methods, and directions

C Gao, Y Zheng, N Li, Y Li, Y Qin, J Piao… - ACM Transactions on …, 2023 - dl.acm.org
Recommender system is one of the most important information services on today's Internet.
Recently, graph neural networks have become the new state-of-the-art approach to …

Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

Multimodal contrastive learning with limoe: the language-image mixture of experts

B Mustafa, C Riquelme, J Puigcerver… - Advances in …, 2022 - proceedings.neurips.cc
Large sparsely-activated models have obtained excellent performance in multiple domains.
However, such models are typically trained on a single modality at a time. We present the …

Multi-task learning with deep neural networks: A survey

M Crawshaw - arXiv preprint arXiv:2009.09796, 2020 - arxiv.org
Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are
simultaneously learned by a shared model. Such approaches offer advantages like …

Progressive layered extraction (ple): A novel multi-task learning (mtl) model for personalized recommendations

H Tang, J Liu, M Zhao, X Gong - … of the 14th ACM Conference on …, 2020 - dl.acm.org
Multi-task learning (MTL) has been successfully applied to many recommendation
applications. However, MTL models often suffer from performance degeneration with …

Dcn v2: Improved deep & cross network and practical lessons for web-scale learning to rank systems

R Wang, R Shivanna, D Cheng, S Jain, D Lin… - Proceedings of the web …, 2021 - dl.acm.org
Learning effective feature crosses is the key behind building recommender systems.
However, the sparse and large feature space requires exhaustive search to identify effective …

Multi-task learning for dense prediction tasks: A survey

S Vandenhende, S Georgoulis… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
With the advent of deep learning, many dense prediction tasks, ie, tasks that produce pixel-
level predictions, have seen significant performance improvements. The typical approach is …

A review of sparse expert models in deep learning

W Fedus, J Dean, B Zoph - arXiv preprint arXiv:2209.01667, 2022 - arxiv.org
Sparse expert models are a thirty-year old concept re-emerging as a popular architecture in
deep learning. This class of architecture encompasses Mixture-of-Experts, Switch …

Health status assessment and remaining useful life prediction of aero-engine based on BiGRU and MMoE

Y Zhang, Y Xin, Z Liu, M Chi, G Ma - Reliability Engineering & System …, 2022 - Elsevier
Prognostics and health management (PHM) is a critical work to ensure the reliable operation
of industrial equipment, in which health status (HS) assessment and remaining useful life …