[HTML][HTML] An Introduction to Machine and Deep Learning Methods for Cloud Masking Applications

A Anzalone, A Pagliaro, A Tutone - Applied Sciences, 2024 - mdpi.com
Cloud cover assessment is crucial for meteorology, Earth observation, and environmental
monitoring, providing valuable data for weather forecasting, climate modeling, and remote …

From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers

B Runwal, T Pedapati, PY Chen - arXiv preprint arXiv:2402.01911, 2024 - arxiv.org
Pretrained Language Models (PLMs) have become the de facto starting point for fine-tuning
on downstream tasks. However, as model sizes continue to increase, traditional fine-tuning …

-zero: Gradient-based Optimization of -norm Adversarial Examples

AE Cinà, F Villani, M Pintor, L Schönherr… - arXiv preprint arXiv …, 2024 - arxiv.org
Evaluating the adversarial robustness of deep networks to gradient-based attacks is
challenging. While most attacks consider $\ell_2 $-and $\ell_\infty $-norm constraints to craft …

[PDF][PDF] Parameter Efficient Finetuning for Reducing Activation Density in Transformers

B Runwal, T Pedapati, PY Chen - Annual Conference …, 2023 - neurips2023-enlsp.github.io
Abstract Pretrained Language Models (PLMs) have become the de facto starting point for
fine-tuning on downstream tasks. However, as model sizes continue to increase, traditional …

Greenlight: Highlighting TensorFlow APIs Energy Footprint

S Rajput, M Kechagia, F Sarro… - 2024 IEEE/ACM 21st …, 2024 - ieeexplore.ieee.org
Deep learning (dl) models are being widely deployed in real-world applications, but their
usage remains computationally intensive and energy-hungry. While prior work has …

[PDF][PDF] IT for Future? Resource Consumption of Information Technology and Measures of Green IT

R Bitterling - 2024 - pub.h-brs.de
The Information and Communication Technology (ICT) sector is a significant global industry,
and addressing climate change is of critical importance. This paper aims to assess the …