On the correctness of automatic differentiation for neural networks with machine-representable parameters

W Lee, S Park, A Aiken - International Conference on …, 2023 - proceedings.mlr.press
Recent work has shown that forward-and reverse-mode automatic differentiation (AD) over
the reals is almost always correct in a mathematically precise sense. However, actual …

Automatic differentiation for ML-family languages: Correctness via logical relations

FL Nunes, M Vákár - Mathematical Structures in Computer Science, 2024 - cambridge.org
We give a simple, direct, and reusable logical relations technique for languages with term
and type recursion and partially defined differentiable functions. We demonstrate it by …

The Semantics of Effects: Centrality, Quantum Control and Reversible Recursion

L Lemonnier - arXiv preprint arXiv:2406.07216, 2024 - arxiv.org
This thesis revolves around an area of computer science called" semantics". We work with
operational semantics, equational theories, and denotational semantics. The first …

A Cartesian Closed Category for Random Variables

P Di Gianantonio, A Edalat - arXiv preprint arXiv:2402.11727, 2024 - arxiv.org
We present a novel, yet rather simple construction within the traditional framework of Scott
domains to provide semantics to probabilistic programming, thus obtaining a solution to a …

What does automatic differentiation compute for neural networks?

S Park, S Chun, W Lee - The Twelfth International Conference on Learning … - openreview.net
Forward-or reverse-mode automatic differentiation (AD) is a popular algorithm for computing
the derivative of a function expressed by a program. AD always outputs the correct derivative …

Structural foundations for differentiable programming

M Huot - 2022 - ora.ox.ac.uk
This dissertation supports the broader thesis that categorical semantics is a powerful tool to
study and design programming languages. It focuses on the foundational aspects of …

Reasoning About Floating Point in Real-World Systems

W Lee - 2023 - search.proquest.com
Continuous computations, which involve continuous data and operations on them, are
ubiquitous in diverse areas such as machine learning and scientific computing. In theoretical …

Fast and correct variational inference for probabilistic programming: Differentiability, reparameterisation and smoothing

D Wagner - 2023 - ora.ox.ac.uk
Probabilistic programming is an innovative programming paradigm for posing and
automatically solving Bayesian inference problems. In this thesis, we study the foundations …