Physical deep learning with biologically inspired training method: gradient-free approach for physical hardware

M Nakajima, K Inoue, K Tanaka, Y Kuniyoshi… - Nature …, 2022 - nature.com
Ever-growing demand for artificial intelligence has motivated research on unconventional
computation based on physical devices. While such computation devices mimic brain …

Linear optical random projections without holography

R Ohana, D Hesslow, D Brunner, S Gigan, K Müller - Optics Express, 2023 - opg.optica.org
We introduce what we believe to be a novel method to perform linear optical random
projections without the need for holography. Our method consists of a computationally trivial …

Only-train-electrical-to-optical-conversion (OTEOC): simple diffractive neural networks with optical readout

L Wu, Z Zhang - Optics Express, 2022 - opg.optica.org
Machine learning hardware based on optical diffraction is emerging as a new computing
platform with high throughput and low latency. The current all-optical diffractive deep neural …

Benchmarking the accuracy and robustness of feedback alignment algorithms

AJ Sanfiz, M Akrout - arXiv preprint arXiv:2108.13446, 2021 - arxiv.org
Backpropagation is the default algorithm for training deep neural networks due to its
simplicity, efficiency and high convergence rate. However, its requirements make it …

Optical training of large-scale Transformers and deep neural networks with direct feedback alignment

Z Wang, K Müller, M Filipovich, J Launay… - arXiv preprint arXiv …, 2024 - arxiv.org
Modern machine learning relies nearly exclusively on dedicated electronic hardware
accelerators. Photonic approaches, with low consumption and high operation speed, are …

Scaling Laws Beyond Backpropagation

MJ Filipovich, A Cappelli, D Hesslow… - arXiv preprint arXiv …, 2022 - arxiv.org
Alternatives to backpropagation have long been studied to better understand how biological
brains may learn. Recently, they have also garnered interest as a way to train neural …

The Role of Architecture, Data Structure and Algorithm in Machine Learning: a Statistical Physics Approach

M Refinetti - 2022 - theses.hal.science
Over the last decades, machine learning revolutionised our daily lives from recommendation
systems to image recognition, medical data analysis, text completion and translation, self …