β-Variational autoencoders and transformers for reduced-order modelling of fluid flows

A Solera-Rico, C Sanmiguel Vila… - Nature …, 2024 - nature.com
Variational autoencoder architectures have the potential to develop reduced-order models
for chaotic fluid flows. We propose a method for learning compact and near-orthogonal …

[HTML][HTML] Towards optimal β-variational autoencoders combined with transformers for reduced-order modelling of turbulent flows

Y Wang, A Solera-Rico, CS Vila, R Vinuesa - International Journal of Heat …, 2024 - Elsevier
Variational autoencoders (VAEs) have shown promising potential as artificial neural
networks (NN) for developing reduced-order models (ROMs) in the context of turbulent …

[HTML][HTML] Fractal Self-Similarity in Semantic Convergence: Gradient of Embedding Similarity across Transformer Layers

M Lee - Fractal and Fractional, 2024 - mdpi.com
This paper presents a mathematical analysis of semantic convergence in transformer-based
language models, drawing inspiration from the concept of fractal self-similarity. We introduce …

Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and quality

J Jeon, J Rabault, J Vasanth, F Alcántara-Ávila… - arXiv preprint arXiv …, 2024 - arxiv.org
Flow control is key to maximize energy efficiency in a wide range of applications. However,
traditional flow-control methods face significant challenges in addressing non-linear systems …

[PDF][PDF] Operator is the model

I Mezic - arXiv preprint arXiv:2310.18516, 2023 - researchgate.net
Modeling of physical processes using dynamic evolution equations started in earnest with
Isaac Newton. Ordinary differential equations (ODE's) came first and Newton wrote to …

On Deep-Learning-Based Closures for Algebraic Surrogate Models of Turbulent Flows

B Eiximeno, M Sanchís-Agudo, A Miró… - arXiv preprint arXiv …, 2024 - arxiv.org
A deep-learning-based closure model to address energy loss in low-dimensional surrogate
models based on proper-orthogonal-decomposition (POD) modes is introduced. Using a …

KEDformer: Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

Z Qin, B Wei, C Gao, J Ni - arXiv preprint arXiv:2412.05421, 2024 - arxiv.org
Time series forecasting is a critical task in domains such as energy, finance, and
meteorology, where accurate long-term predictions are essential. While Transformer-based …

Operator is the Model

I Mezić - arXiv preprint arXiv:2310.18516, 2023 - arxiv.org
Koopman operator based models emerged as the leading methodology for machine
learning of dynamical systems. But their scope is much larger. In fact they present a new …

Structure-Preserving Deep Learning

QM Hernández Laín, E Cueto Prendes… - zaguan.unizar.es
Las tecnologías de simulación se han convertido en una herramienta útil para modelizar
muchos sistemas en una amplia variedad de disciplinas, desde las ciencias sociales a las …