End-to-end constrained optimization learning: A survey

J Kotary, F Fioretto, P Van Hentenryck… - arXiv preprint arXiv …, 2021 - arxiv.org
This paper surveys the recent attempts at leveraging machine learning to solve constrained
optimization problems. It focuses on surveying the work on integrating combinatorial solvers …

[HTML][HTML] Integrating machine learning with human knowledge

C Deng, X Ji, C Rainey, J Zhang, W Lu - Iscience, 2020 - cell.com
Machine learning has been heavily researched and widely used in many disciplines.
However, achieving high accuracy requires a large amount of data that is sometimes …

Transformers learn in-context by gradient descent

J Von Oswald, E Niklasson… - International …, 2023 - proceedings.mlr.press
At present, the mechanisms of in-context learning in Transformers are not well understood
and remain mostly an intuition. In this paper, we suggest that training Transformers on auto …

Joint distribution matters: Deep brownian distance covariance for few-shot classification

J Xie, F Long, J Lv, Q Wang… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Few-shot classification is a challenging problem as only very few training examples are
given for each new task. One of the effective research lines to address this challenge …

On neural differential equations

P Kidger - arXiv preprint arXiv:2202.02435, 2022 - arxiv.org
The conjoining of dynamical systems and deep learning has become a topic of great
interest. In particular, neural differential equations (NDEs) demonstrate that neural networks …

Implicit behavioral cloning

P Florence, C Lynch, A Zeng… - … on Robot Learning, 2022 - proceedings.mlr.press
We find that across a wide range of robot policy learning scenarios, treating supervised
policy learning with an implicit model generally performs better, on average, than commonly …

Raft: Recurrent all-pairs field transforms for optical flow

Z Teed, J Deng - Computer Vision–ECCV 2020: 16th European …, 2020 - Springer
Abstract We introduce Recurrent All-Pairs Field Transforms (RAFT), a new deep network
architecture for optical flow. RAFT extracts per-pixel features, builds multi-scale 4D …

Theseus: A library for differentiable nonlinear optimization

L Pineda, T Fan, M Monge… - Advances in …, 2022 - proceedings.neurips.cc
We present Theseus, an efficient application-agnostic open source library for differentiable
nonlinear least squares (DNLS) optimization built on PyTorch, providing a common …

Deepemd: Few-shot image classification with differentiable earth mover's distance and structured classifiers

C Zhang, Y Cai, G Lin, C Shen - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
In this paper, we address the few-shot classification task from a new perspective of optimal
matching between image regions. We adopt the Earth Mover's Distance (EMD) as a metric to …

Efficient and modular implicit differentiation

M Blondel, Q Berthet, M Cuturi… - Advances in neural …, 2022 - proceedings.neurips.cc
Automatic differentiation (autodiff) has revolutionized machine learning. Itallows to express
complex computations by composing elementary ones in creativeways and removes the …