Three ways to solve partial differential equations with neural networks—A review

J Blechschmidt, OG Ernst - GAMM‐Mitteilungen, 2021 - Wiley Online Library
Neural networks are increasingly used to construct numerical solution methods for partial
differential equations. In this expository review, we introduce and contrast three important …

Overview frequency principle/spectral bias in deep learning

ZQJ Xu, Y Zhang, T Luo - Communications on Applied Mathematics and …, 2024 - Springer
Understanding deep learning is increasingly emergent as it penetrates more and more into
industry and science. In recent years, a research line from Fourier analysis sheds light on …

On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks

S Wang, H Wang, P Perdikaris - Computer Methods in Applied Mechanics …, 2021 - Elsevier
Physics-informed neural networks (PINNs) are demonstrating remarkable promise in
integrating physical models with gappy and noisy observational data, but they still struggle …

Deep nitsche method: Deep ritz method with essential boundary conditions

Y Liao, P Ming - arXiv preprint arXiv:1912.01309, 2019 - arxiv.org
We propose a new method to deal with the essential boundary conditions encountered in
the deep learning-based numerical solvers for partial differential equations. The trial …

Theory of the frequency principle for general deep neural networks

T Luo, Z Ma, ZQJ Xu, Y Zhang - arXiv preprint arXiv:1906.09235, 2019 - arxiv.org
Along with fruitful applications of Deep Neural Networks (DNNs) to realistic problems,
recently, some empirical studies of DNNs reported a universal phenomenon of Frequency …

Adaptive multi-scale neural network with resnet blocks for solving partial differential equations

M Chen, R Niu, W Zheng - Nonlinear Dynamics, 2023 - Springer
In this paper, an adaptive multi-scale neural network with Resnet blocks (adaptive-MS-
Resnet) architecture is constructed for solving the Poisson equation, Helmholtz equation …

Mitigating spectral bias for the multiscale operator learning

X Liu, B Xu, S Cao, L Zhang - Journal of Computational Physics, 2024 - Elsevier
Neural operators have emerged as a powerful tool for learning the mapping between infinite-
dimensional parameter and solution spaces of partial differential equations (PDEs). In this …

A deep domain decomposition method based on Fourier features

S Li, Y Xia, Y Liu, Q Liao - Journal of Computational and Applied …, 2023 - Elsevier
In this paper we present a Fourier feature based deep domain decomposition method (F-
D3M) for partial differential equations (PDEs). Currently, deep neural network based …

Learning a single neuron for non-monotonic activation functions

L Wu - International Conference on Artificial Intelligence and …, 2022 - proceedings.mlr.press
We study the problem of learning a single neuron $\mathbf {x}\mapsto\sigma (\mathbf {w}^
T\mathbf {x}) $ with gradient descent (GD). All the existing positive results are limited to the …

General-Kindred physics-informed neural network to the solutions of singularly perturbed differential equations

S Wang, P Zhao, Q Ma, T Song - Physics of Fluids, 2024 - pubs.aip.org
Physics-informed neural networks (PINNs) have become a promising research direction in
the field of solving partial differential equations (PDEs). Dealing with singular perturbation …