From pretraining data to language models to downstream tasks: Tracking the trails of political biases leading to unfair NLP models

S Feng, CY Park, Y Liu, Y Tsvetkov - arXiv preprint arXiv:2305.08283, 2023 - arxiv.org
Language models (LMs) are pretrained on diverse data sources, including news, discussion
forums, books, and online encyclopedias. A significant portion of this data includes opinions …

Unifying molecular and textual representations via multi-task language modelling

D Christofidellis, G Giannone, J Born… - International …, 2023 - proceedings.mlr.press
The recent advances in neural language models have also been successfully applied to the
field of chemistry, offering generative solutions for classical problems in molecular design …

ClinicaDL: An open-source deep learning software for reproducible neuroimaging processing

E Thibeau-Sutre, M Diaz, R Hassanaly… - Computer Methods and …, 2022 - Elsevier
Abstract Background and Objective: As deep learning faces a reproducibility crisis and
studies on deep learning applied to neuroimaging are contaminated by methodological …

Scalable spatiotemporal graph neural networks

A Cini, I Marisca, FM Bianchi, C Alippi - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Neural forecasting of spatiotemporal time series drives both research and industrial
innovation in several relevant application domains. Graph neural networks (GNNs) are often …

Factkb: Generalizable factuality evaluation using language models enhanced with factual knowledge

S Feng, V Balachandran, Y Bai, Y Tsvetkov - arXiv preprint arXiv …, 2023 - arxiv.org
Evaluating the factual consistency of automatically generated summaries is essential for the
progress and adoption of reliable summarization systems. Despite recent advances, existing …

Unirex: A unified learning framework for language model rationale extraction

A Chan, M Sanjabi, L Mathias, L Tan… - International …, 2022 - proceedings.mlr.press
An extractive rationale explains a language model's (LM's) prediction on a given task
instance by highlighting the text inputs that most influenced the prediction. Ideally, rationale …

Free-form flows: Make any architecture a normalizing flow

F Draxler, P Sorrenson… - International …, 2024 - proceedings.mlr.press
Normalizing Flows are generative models that directly maximize the likelihood. Previously,
the design of normalizing flows was largely constrained by the need for analytical …

Predicting the impact of treatments over time with uncertainty aware neural differential equations.

E De Brouwer, J Gonzalez… - … Conference on Artificial …, 2022 - proceedings.mlr.press
Predicting the impact of treatments from ob-servational data only still represents a major
challenge despite recent significant advances in time series modeling. Treatment …

Towards foundation models for materials science: The open matsci ml toolkit

KLK Lee, C Gonzales, M Spellings, M Galkin… - Proceedings of the SC' …, 2023 - dl.acm.org
Artificial intelligence and machine learning have shown great promise in their ability to
accelerate novel materials discovery. As researchers and domain scientists seek to unify …

[PDF][PDF] Zoobot: Adaptable Deep Learning Models for GalaxyMorphology

M Walmsley, C Allen, B Aussel, M Bowles… - Journal of Open Source …, 2023 - par.nsf.gov
Zoobot is a Python package for measuring the detailed appearance of galaxies in telescope
images using deep learning. Zoobot is aimed at astronomers who want to solve a galaxy …