Physics-informed machine learning

GE Karniadakis, IG Kevrekidis, L Lu… - Nature Reviews …, 2021 - nature.com
Despite great progress in simulating multiphysics problems using the numerical
discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate …

Machine learning for climate physics and simulations

CY Lai, P Hassanzadeh, A Sheshadri… - Annual Review of …, 2024 - annualreviews.org
We discuss the emerging advances and opportunities at the intersection of machine
learning (ML) and climate physics, highlighting the use of ML techniques, including …

Freeu: Free lunch in diffusion u-net

C Si, Z Huang, Y Jiang, Z Liu - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
In this paper we uncover the untapped potential of diffusion U-Net which serves as a" free
lunch" that substantially improves the generation quality on the fly. We initially investigate …

Diffusion probabilistic model made slim

X Yang, D Zhou, J Feng… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Despite the visually-pleasing results achieved, the massive computational cost has been a
long-standing flaw for diffusion probabilistic models (DPMs), which, in turn, greatly limits …

When and why PINNs fail to train: A neural tangent kernel perspective

S Wang, X Yu, P Perdikaris - Journal of Computational Physics, 2022 - Elsevier
Physics-informed neural networks (PINNs) have lately received great attention thanks to
their flexibility in tackling a wide range of forward and inverse problems involving partial …

Hdnet: High-resolution dual-domain learning for spectral compressive imaging

X Hu, Y Cai, J Lin, H Wang, X Yuan… - Proceedings of the …, 2022 - openaccess.thecvf.com
The rapid development of deep learning provides a better solution for the end-to-end
reconstruction of hyperspectral image (HSI). However, existing learning-based methods …

Focal frequency loss for image reconstruction and synthesis

L Jiang, B Dai, W Wu, CC Loy - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Image reconstruction and synthesis have witnessed remarkable progress thanks to the
development of generative models. Nonetheless, gaps could still exist between the real and …

DeepXDE: A deep learning library for solving differential equations

L Lu, X Meng, Z Mao, GE Karniadakis - SIAM review, 2021 - SIAM
Deep learning has achieved remarkable success in diverse applications; however, its use in
solving partial differential equations (PDEs) has emerged only recently. Here, we present an …

Gradient starvation: A learning proclivity in neural networks

M Pezeshki, O Kaba, Y Bengio… - Advances in …, 2021 - proceedings.neurips.cc
We identify and formalize a fundamental gradient descent phenomenon resulting in a
learning proclivity in over-parameterized neural networks. Gradient Starvation arises when …

An expert's guide to training physics-informed neural networks

S Wang, S Sankaran, H Wang, P Perdikaris - arXiv preprint arXiv …, 2023 - arxiv.org
Physics-informed neural networks (PINNs) have been popularized as a deep learning
framework that can seamlessly synthesize observational data and partial differential …