Mathematical analysis and performance evaluation of the gelu activation function in deep learning

M Lee - Journal of Mathematics, 2023 - Wiley Online Library
Selecting the most suitable activation function is a critical factor in the effectiveness of deep
learning models, as it influences their learning capacity, stability, and computational …

Damage detection and localization at the jacket support of an offshore wind turbine using transformer models

H Triviño, C Feijóo, H Lugmania… - Structural Control and …, 2023 - Wiley Online Library
Early detection of damage in the support structure (submerged part) of an offshore wind
turbine is crucial as it can help to prevent emergency shutdowns and extend the lifespan of …

Accurate multiclassification and segmentation of gastric cancer based on a hybrid cascaded deep learning model with a vision transformer from endoscopic images

EU Haq, Q Yong, Z Yuan, H Jianjun, RU Haq, X Qin - Information Sciences, 2024 - Elsevier
Compared with other forms of cancer, gastric cancer has high mortality and incidence rates,
making it a major cause of death worldwide. Accurate diagnosis is crucial in the treatment of …

[HTML][HTML] Deep learning-based restoration of multi-degraded finger-vein image by non-uniform illumination and noise

JS Hong, SG Kim, JS Kim, KR Park - Engineering Applications of Artificial …, 2024 - Elsevier
The recognition performance deteriorates if degradation factors including blur, noise, and
non-uniform illumination exist in the image when acquiring a finger-vein image. Especially …

[PDF][PDF] How Does a Deep Learning Model Architecture Impact Its Privacy? A Comprehensive Study of Privacy Attacks on CNNs and Transformers

G Zhang, B Liu, H Tian, T Zhu, M Ding… - arXiv preprint arXiv …, 2023 - usenix.org
As a booming research area in the past decade, deep learning technologies have been
driven by big data collected and processed on an unprecedented scale. However, privacy …

Music-evoked emotions classification using vision transformer in EEG signals

D Wang, J Lian, H Cheng, Y Zhou - Frontiers in Psychology, 2024 - frontiersin.org
Introduction The field of electroencephalogram (EEG)-based emotion identification has
received significant attention and has been widely utilized in both human-computer …

Multi-label classification of retinal disease via a novel vision transformer model

D Wang, J Lian, W Jiao - Frontiers in Neuroscience, 2024 - frontiersin.org
Introduction The precise identification of retinal disorders is of utmost importance in the
prevention of both temporary and permanent visual impairment. Prior research has yielded …

Sequence-to-sequence stacked gate recurrent unit networks for approximating the forward problem of partial differential equations

Z Zhang, Q Wang - IEEE Access, 2024 - ieeexplore.ieee.org
We proposed an optimisation algorithm based on the sequence-to-sequence (Seq2Seq)
stacking of the gate recurrent unit (GRU) model to characterise and approximate the forward …

CoNO: Complex Neural Operator for Continuous Dynamical Systems

K Tiwari, NM Krishnan - arXiv preprint arXiv:2310.02094, 2023 - arxiv.org
Neural operators extend data-driven models to map between infinite-dimensional functional
spaces. These models have successfully solved continuous dynamical systems represented …

Transformer-Based Multivariate Time Series Forecasting

MK Bharti, R Wadhvani… - 2024 IEEE …, 2024 - ieeexplore.ieee.org
This study explores multivariate time series forecasting, centering on the transformer model.
It examines the shortcomings of other predictive models like Recurrent Neural Networks …