The unreasonable effectiveness of easy training data for hard tasks

P Hase, M Bansal, P Clark, S Wiegreffe - arXiv preprint arXiv:2401.06751, 2024 - arxiv.org
How can we train models to perform well on hard test data when hard training data is by
definition difficult to label correctly? This question has been termed the scalable oversight …

[HTML][HTML] A Machine Learning and Deep Learning-Based Account Code Classification Model for Sustainable Accounting Practices

D Koç, F Koç - Sustainability, 2024 - mdpi.com
Accounting account codes are created within a specific logic framework to systematically
and accurately record a company's financial transactions. Currently, accounting reports are …

Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings

Y Jiang, X Zhou, M Bansal - arXiv preprint arXiv:2402.06492, 2024 - arxiv.org
Transformers generalize to novel compositions of structures and entities after being trained
on a complex dataset, but easily overfit on datasets of insufficient complexity. We observe …

Attribute Diversity Determines the Systematicity Gap in VQA

I Berlot-Attwell, KK Agrawal, AM Carrell… - arXiv preprint arXiv …, 2023 - arxiv.org
Although modern neural networks often generalize to new combinations of familiar
concepts, the conditions that enable such compositionality have long been an open …

Inducing and Interpreting Compositionality in Neural NLP Models

Y Jiang - 2024 - search.proquest.com
Human intelligence demonstrates compositionality, the algebraic capacity that enables us to
understand and produce a potentially infinite number of novel combinations of known …

[PDF][PDF] Improving Object Recognition and Diagnostics with Advanced Learning Techniques

D Bansal, A Verma, A Sharma, I Kapoor, V Reddy… - researchgate.net
Advanced learning techniques have revolutionized the fields of object recognition and
diagnostics, driving significant enhancements in accuracy and efficiency. Our proposed …