Transfer learning capabilities of untrained neural networks for MIMO CSI recreation

BV Boas, W Zirwas, M Haardt - ICC 2022-IEEE International …, 2022 - ieeexplore.ieee.org
… channel measurements and we exploit their learned prior to provide higher channel estimation
… Our results show that transfer learning techniques are effective in accessing the learned

What is being transferred in transfer learning?

B Neyshabur, H Sedghi… - Advances in neural …, 2020 - proceedings.neurips.cc
… Modern convolutional neural networks trained on large scale … feature reuse plays a
very important role in transfer learning, … of the data, utility of untrained representations, pre-training …

Transfer learning effects on image steganalysis with pre-trained deep residual neural network model

S Ozcan, AF Mustacoglu - … Conference on Big Data (Big Data), 2018 - ieeexplore.ieee.org
… In Transfer Learning, an untrained model benefits from a previously trained model and its
dataset… We thought that model would start gaining the ability to distinguish even the smallest bit …

Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning

P Cao, S Zhang, J Tang - Ieee Access, 2018 - ieeexplore.ieee.org
transfer learning architecture consists of two parts; the first part is constructed with a pretrained
deep neural network that serves to extract the features … , an untrained neural network B, …

A review of deep transfer learning and recent advancements

M Iman, HR Arabnia, K Rasheed - Technologies, 2023 - mdpi.com
Neural Network (CNN) layers have improved deep learning … An untrained DL uses a random
initializing weight for nodes, … feature reuse plays a very important role in transfer learning, …

Transfer learning for Latin and Chinese characters with deep neural networks

DC Cireşan, U Meier… - … on neural networks  …, 2012 - ieeexplore.ieee.org
… extractor that maps an input into a fixed dimensional featurefeature extractor, transferring
knowledge from an already … rapidly with the number of untrained layers, reaching more than 20…

Transfer learning of graph neural networks with ego-graph information maximization

Q Zhu, C Yang, Y Xu, H Wang… - Advances in Neural …, 2021 - proceedings.neurips.cc
features instead of graph structures, which we deem more essential in graph transfer
learning … (through comparison against the untrained GIN encoders). The recently proposed …

How transferable are features in deep neural networks?

J Yosinski, J Clune, Y Bengio… - Advances in neural …, 2014 - proceedings.neurips.cc
… that features within a network are general, we will be able to use them for transfer learning
(… We also compare to random, untrained weights because Jarrett et al. (2009) showed — …

Transfer learning for deep neural network-based partial differential equations solving

X Chen, C Gong, Q Wan, L Deng, Y Wan, Y Liu… - Advances in …, 2021 - Springer
… Compared to random, untrained weights, PINN achieves an average performance … transfer
learning approach to neural network-based surrogate models to investigate the transfer ability

[PDF][PDF] Transferability of Learned Knowledge in Neural Networks: Impact of Trained Weights on Untrained Networks

A Tulsyan - J. Electrical Systems, 2024 - researchgate.net
transfer learning, this study delves into the manual initialization of untrained neural networks
… process of visual learning and “mirroring” seen in humans; the ability to mimic something …