Equiformer: Equivariant graph attention transformer for 3d atomistic graphs

YL Liao, T Smidt - arXiv preprint arXiv:2206.11990, 2022 - arxiv.org
Despite their widespread success in various domains, Transformer networks have yet to
perform well across datasets in the domain of 3D atomistic graphs such as molecules even …

Finding neurons in a haystack: Case studies with sparse probing

W Gurnee, N Nanda, M Pauly, K Harvey… - arXiv preprint arXiv …, 2023 - arxiv.org
Despite rapid adoption and deployment of large language models (LLMs), the internal
computations of these models remain opaque and poorly understood. In this work, we seek …

Odd dynamics of living chiral crystals

TH Tan, A Mietke, J Li, Y Chen, H Higinbotham… - Nature, 2022 - nature.com
Active crystals are highly ordered structures that emerge from the self-organization of motile
objects, and have been widely studied in synthetic, and bacterial, active matter. Whether …

Raising the cost of malicious ai-powered image editing

H Salman, A Khaddaj, G Leclerc, A Ilyas… - arXiv preprint arXiv …, 2023 - arxiv.org
We present an approach to mitigating the risks of malicious image editing posed by large
diffusion models. The key idea is to immunize images so as to make them resistant to …

OSQP: An operator splitting solver for quadratic programs

B Stellato, G Banjac, P Goulart, A Bemporad… - Mathematical …, 2020 - Springer
We present a general-purpose solver for convex quadratic programs based on the
alternating direction method of multipliers, employing a novel operator splitting technique …

Equivariant contrastive learning

R Dangovski, L Jing, C Loh, S Han… - arXiv preprint arXiv …, 2021 - arxiv.org
In state-of-the-art self-supervised learning (SSL) pre-training produces semantically good
representations by encouraging them to be invariant under meaningful transformations …

Three-dimensional flat bands in pyrochlore metal CaNi2

JP Wakefield, M Kang, PM Neves, D Oh, S Fang… - Nature, 2023 - nature.com
Electronic flat-band materials host quantum states characterized by a quenched kinetic
energy. These flat bands are often conducive to enhanced electron correlation effects and …

Equiformerv2: Improved equivariant transformer for scaling to higher-degree representations

YL Liao, B Wood, A Das, T Smidt - arXiv preprint arXiv:2306.12059, 2023 - arxiv.org
Equivariant Transformers such as Equiformer have demonstrated the efficacy of applying
Transformers to the domain of 3D atomistic systems. However, they are still limited to small …

When Do Quantum Mechanical Descriptors Help Graph Neural Networks to Predict Chemical Properties?

SC Li, H Wu, A Menon, KA Spiekermann… - Journal of the …, 2024 - ACS Publications
Deep graph neural networks are extensively utilized to predict chemical reactivity and
molecular properties. However, because of the complexity of chemical space, such models …

Benchmarking the performance of Bayesian optimization across multiple experimental materials science domains

Q Liang, AE Gongora, Z Ren, A Tiihonen… - npj Computational …, 2021 - nature.com
Bayesian optimization (BO) has been leveraged for guiding autonomous and high-
throughput experiments in materials science. However, few have evaluated the efficiency of …