A survey of deep active learning

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM computing …, 2021 - dl.acm.org
Active learning (AL) attempts to maximize a model's performance gain while annotating the
fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount …

Beyond neural scaling laws: beating power law scaling via data pruning

B Sorscher, R Geirhos, S Shekhar… - Advances in …, 2022 - proceedings.neurips.cc
Widely observed neural scaling laws, in which error falls off as a power of the training set
size, model size, or both, have driven substantial performance improvements in deep …

Transfuser: Imitation with transformer-based sensor fusion for autonomous driving

K Chitta, A Prakash, B Jaeger, Z Yu… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
How should we integrate representations from complementary sensors for autonomous
driving? Geometry-based fusion has shown promise for perception (eg, object detection …

D4: Improving llm pretraining via document de-duplication and diversification

K Tirumala, D Simig, A Aghajanyan… - Advances in Neural …, 2024 - proceedings.neurips.cc
Over recent years, an increasing amount of compute and data has been poured into training
large language models (LLMs), usually by doing one-pass learning on as many tokens as …

Active learning for deep object detection via probabilistic modeling

J Choi, I Elezi, HJ Lee, C Farabet… - Proceedings of the …, 2021 - openaccess.thecvf.com
Active learning aims to reduce labeling costs by selecting only the most informative samples
on a dataset. Few existing works have addressed active learning for object detection. Most …

[HTML][HTML] Efficient visual recognition: A survey on recent advances and brain-inspired methodologies

Y Wu, DH Wang, XT Lu, F Yang, M Yao… - Machine Intelligence …, 2022 - Springer
Visual recognition is currently one of the most important and active research areas in
computer vision, pattern recognition, and even the general field of artificial intelligence. It …

Scalable active learning for object detection

E Haussmann, M Fenzi, K Chitta… - 2020 IEEE intelligent …, 2020 - ieeexplore.ieee.org
Deep Neural Networks trained in a fully supervised fashion are the dominant technology in
perception-based autonomous driving systems. While collecting large amounts of unlabeled …

[PDF][PDF] Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities.

BR Bartoldson, B Kailkhura, D Blalock - J. Mach. Learn. Res., 2023 - jmlr.org
Although deep learning has made great progress in recent years, the exploding economic
and environmental costs of training neural networks are becoming unsustainable. To …

Active self-supervised learning: A few low-cost relationships are all you need

V Cabannes, L Bottou, Y Lecun… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Self-Supervised Learning (SSL) has emerged as the solution of choice to learn
transferable representations from unlabeled data. However, SSL requires to build samples …

Real-time safety assessment for dynamic systems with limited memory and annotations

Z Liu, X He - IEEE Transactions on Intelligent Transportation …, 2023 - ieeexplore.ieee.org
Real-time safety assessment of dynamic systems has recently received increasing attention.
However, the performance of existing advanced approaches is often negatively affected by …