Scalable transformer for pde surrogate modeling

Z Li, D Shu, A Barati Farimani - Advances in Neural …, 2024 - proceedings.neurips.cc
Transformer has shown state-of-the-art performance on various applications and has
recently emerged as a promising tool for surrogate modeling of partial differential equations …

Transformers as neural operators for solutions of differential equations with finite regularity

B Shih, A Peyvan, Z Zhang, GE Karniadakis - Computer Methods in Applied …, 2025 - Elsevier
Neural operator learning models have emerged as very effective surrogates in data-driven
methods for partial differential equations (PDEs) across different applications from …

Ditto: Diffusion-inspired temporal transformer operator

O Ovadia, E Turkel, A Kahana… - arXiv preprint arXiv …, 2023 - arxiv.org
Solving partial differential equations (PDEs) using a data-driven approach has become
increasingly common. The recent development of the operator learning paradigm has …

3D elastic wave propagation with a factorized Fourier neural operator (F-FNO)

F Lehmann, F Gatti, M Bertin, D Clouteau - Computer Methods in Applied …, 2024 - Elsevier
Numerical simulations are computationally demanding in three-dimensional (3D) settings
but they are often required to accurately represent physical phenomena. Neural operators …

MyCrunchGPT: A chatGPT assisted framework for scientific machine learning

V Kumar, L Gleyzer, A Kahana, K Shukla… - arXiv preprint arXiv …, 2023 - arxiv.org
Scientific Machine Learning (SciML) has advanced recently across many different areas in
computational science and engineering. The objective is to integrate data and physics …

Mycrunchgpt: A llm assisted framework for scientific machine learning

V Kumar, L Gleyzer, A Kahana, K Shukla… - Journal of Machine …, 2023 - dl.begellhouse.com
Scientific machine learning (SciML) has advanced recently across many different areas in
computational science and engineering. The objective is to integrate data and physics …

Mitigating spectral bias for the multiscale operator learning

X Liu, B Xu, S Cao, L Zhang - Journal of Computational Physics, 2024 - Elsevier
Neural operators have emerged as a powerful tool for learning the mapping between infinite-
dimensional parameter and solution spaces of partial differential equations (PDEs). In this …

[HTML][HTML] Multi-scale time-stepping of Partial Differential Equations with transformers

AP Hemmasian, AB Farimani - Computer Methods in Applied Mechanics …, 2024 - Elsevier
Developing fast surrogates for Partial Differential Equations (PDEs) will accelerate design
and optimization in almost all scientific and engineering applications. Neural networks have …

[HTML][HTML] Latent Neural PDE Solver: a reduced-order modelling framework for partial differential equations

Z Li, S Patil, F Ogoke, D Shu, W Zhen… - Journal of …, 2025 - Elsevier
Neural networks have shown promising potential in accelerating the numerical simulation of
systems governed by partial differential equations (PDEs). Different from many existing …

Improved operator learning by orthogonal attention

Z Xiao, Z Hao, B Lin, Z Deng, H Su - arXiv preprint arXiv:2310.12487, 2023 - arxiv.org
Neural operators, as an efficient surrogate model for learning the solutions of PDEs, have
received extensive attention in the field of scientific machine learning. Among them, attention …