Distribution identification and information loss in a measurement uncertainty network

PM Duncan, DS Whittaker - Metrologia, 2021 - iopscience.iop.org
… method, however, where the first and second distribution moments at each stage are … is
undermined by aggregated information loss from layer to layer. This information loss can affect …

[PDF][PDF] Random Shifting for CNN: a Solution to Reduce Information Loss in Down-Sampling Layers.

G Zhao, J Wang, Z Zhang - IJCAI, 2017 - researchgate.net
information effectively because it only adopts a fixed stride strategy, which may result in poor
generalization ability and information loss… in the down-sampling layers during the training …

Exploring the encoding layer and loss function in end-to-end speaker and language recognition system

W Cai, J Chen, M Li - arXiv preprint arXiv:1804.05160, 2018 - arxiv.org
… They are problems in that we are trying to retrieve information about an entire utterance
rather than … describing the distribution of the given input data sequence with variable-length. …

Packet loss characterization using cross layer information and hmm for wi-fi networks

CAG da Silva, CM Pedroso - Sensors, 2022 - mdpi.com
… and also a heavy-tailed distribution (GE + heavy-tailed) to model the losses is able to present
… using another probability distribution, as we propose in this new packet loss model, which …

Rethinking feature distribution for loss functions in image classification

W Wan, Y Zhong, T Li, J Chen - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
… In this paper we propose a Gaussian Mixture loss (GM loss) … a Gaussian Mixture (GM)
distribution, with each component … with 6 convolution layers and a fully connected layer with a …

Disturblabel: Regularizing cnn on the loss layer

L Xie, J Wang, Z Wei, M Wang… - Proceedings of the IEEE …, 2016 - openaccess.thecvf.com
… In the case that DisturbLabel provides strong regularization, eg, in the case of ImageNet
training where the wrong label is distributed over all the 1000 categories, we will slightly …

Degeneration in vae: in the light of fisher information loss

H Zheng, J Yao, Y Zhang, IW Tsang - arXiv preprint arXiv:1802.06677, 2018 - arxiv.org
Information measure for the layer-wise analysis. With such measure, we demonstrate that
information loss is … of hidden layers as a parametric implicit distribution, we propose a Fisher …

IM-loss: information maximization loss for spiking neural networks

Y Guo, Y Chen, L Zhang, X Liu… - … Neural Information …, 2022 - proceedings.neurips.cc
… same layer need to be evaluated before passing information to … distribution loss is introduced
for calculating the information … to design our method for handling information loss in SNNs. …

Improving supervised phase identification through the theory of information losses

B Foggo, N Yu - IEEE Transactions on Smart Grid, 2019 - ieeexplore.ieee.org
… We assume that H(X) > 0 and suppose we have a class of conditional distributions Q from
which to search for a variable U meant to approximate X (eg, the hidden layer in our neural …

Mac-layer packet loss models for wi-fi networks: A survey

CAG Da Silva, CM Pedroso - IEEE Access, 2019 - ieeexplore.ieee.org
loss only considered errors in the physical layer. At the physical layer, the main causes of
packet loss … Russ and Haghani [141] presented a distribution of consecutive packet losses as a …