Industrial data science–a review of machine learning applications for chemical and process industries

M Mowbray, M Vallerio, C Perez-Galvan… - Reaction Chemistry & …, 2022 - pubs.rsc.org
In the literature, machine learning (ML) and artificial intelligence (AI) applications tend to
start with examples that are irrelevant to process engineers (eg classification of images …

Toward the end-to-end optimization of particle physics instruments with differentiable programming

T Dorigo, A Giammanco, P Vischia, M Aehle, M Bawaj… - Reviews in Physics, 2023 - Elsevier
The full optimization of the design and operation of instruments whose functioning relies on
the interaction of radiation with matter is a super-human task, due to the large dimensionality …

Universal differential equations for scientific machine learning

C Rackauckas, Y Ma, J Martensen, C Warner… - arXiv preprint arXiv …, 2020 - arxiv.org
In the context of science, the well-known adage" a picture is worth a thousand words" might
well be" a model is worth a thousand datasets." In this manuscript we introduce the SciML …

Self-adaptive physics-informed neural networks using a soft attention mechanism

L McClenny, U Braga-Neto - arXiv preprint arXiv:2009.04544, 2020 - arxiv.org
Physics-Informed Neural Networks (PINNs) have emerged recently as a promising
application of deep neural networks to the numerical solution of nonlinear partial differential …

Investigating bi-level optimization for learning and vision from a unified perspective: A survey and beyond

R Liu, J Gao, J Zhang, D Meng… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Bi-Level Optimization (BLO) is originated from the area of economic game theory and then
introduced into the optimization community. BLO is able to handle problems with a …

Self-adaptive physics-informed neural networks

LD McClenny, UM Braga-Neto - Journal of Computational Physics, 2023 - Elsevier
Abstract Physics-Informed Neural Networks (PINNs) have emerged recently as a promising
application of deep neural networks to the numerical solution of nonlinear partial differential …

Automatic differentiation in machine learning: a survey

AG Baydin, BA Pearlmutter, AA Radul… - Journal of machine …, 2018 - jmlr.org
Derivatives, mostly in the form of gradients and Hessians, are ubiquitous in machine
learning. Automatic differentiation (AD), also called algorithmic differentiation or simply" auto …

JuMP: A modeling language for mathematical optimization

I Dunning, J Huchette, M Lubin - SIAM review, 2017 - SIAM
JuMP is an open-source modeling language that allows users to express a wide range of
optimization problems (linear, mixed-integer, quadratic, conic-quadratic, semidefinite, and …

Stiff neural ordinary differential equations

S Kim, W Ji, S Deng, Y Ma… - Chaos: An Interdisciplinary …, 2021 - pubs.aip.org
ABSTRACT Neural Ordinary Differential Equations (ODEs) are a promising approach to
learn dynamical models from time-series data in science and engineering applications. This …

A graph-based methodology for constructing computational models that automates adjoint-based sensitivity analysis

V Gandarillas, AJ Joshy, MZ Sperry, AK Ivanov… - Structural and …, 2024 - Springer
The adjoint method provides an efficient way to compute sensitivities for system models with
a large number of inputs. However, implementing the adjoint method requires significant …