Ordered neurons: Integrating tree structures into recurrent neural networks

Y Shen, S Tan, A Sordoni, A Courville - arXiv preprint arXiv:1810.09536, 2018 - arxiv.org
Natural language is hierarchically structured: smaller units (eg, phrases) are nested within
larger units (eg, clauses). When a larger constituent ends, all of the smaller constituents that …

Phrase dependency relational graph attention network for aspect-based sentiment analysis

H Wu, Z Zhang, S Shi, Q Wu, H Song - Knowledge-Based Systems, 2022 - Elsevier
Abstract Aspect-based Sentiment Analysis (ABSA) is a subclass of sentiment analysis, which
aims to identify the sentiment polarity such as positive, negative, or neutral for specific …

Perturbed masking: Parameter-free probing for analyzing and interpreting BERT

Z Wu, Y Chen, B Kao, Q Liu - arXiv preprint arXiv:2004.14786, 2020 - arxiv.org
By introducing a small set of additional parameters, a probe learns to solve specific linguistic
tasks (eg, dependency parsing) in a supervised manner using feature representations (eg …

Unsupervised recurrent neural network grammars

Y Kim, AM Rush, L Yu, A Kuncoro, C Dyer… - arXiv preprint arXiv …, 2019 - arxiv.org
Recurrent neural network grammars (RNNG) are generative models of language which
jointly model syntax and surface structure by incrementally generating a syntax tree and …

Sequence-level mixed sample data augmentation

D Guo, Y Kim, AM Rush - arXiv preprint arXiv:2011.09039, 2020 - arxiv.org
Despite their empirical success, neural networks still have difficulty capturing compositional
aspects of natural language. This work proposes a simple data augmentation approach to …

Reinforcement-learning-guided source code summarization using hierarchical attention

W Wang, Y Zhang, Y Sui, Y Wan, Z Zhao… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Code summarization (aka comment generation) provides a high-level natural language
description of the function performed by code, which can benefit the software maintenance …

Recursion in recursion: Two-level nested recursion for length generalization with scalability

J Ray Chowdhury, C Caragea - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Binary Balanced Tree Recursive Neural Networks (BBT-RvNNs) enforce sequence
composition according to a preset balanced binary tree structure. Thus, their non-linear …

Visually grounded neural syntax acquisition

H Shi, J Mao, K Gimpel, K Livescu - arXiv preprint arXiv:1906.02890, 2019 - arxiv.org
We present the Visually Grounded Neural Syntax Learner (VG-NSL), an approach for
learning syntactic representations and structures without any explicit supervision. The model …

TreeMix: Compositional constituency-based data augmentation for natural language understanding

L Zhang, Z Yang, D Yang - arXiv preprint arXiv:2205.06153, 2022 - arxiv.org
Data augmentation is an effective approach to tackle over-fitting. Many previous works have
proposed different data augmentations strategies for NLP, such as noise injection, word …

Incorporating rich syntax information in Grammatical Error Correction

Z Li, K Parnow, H Zhao - Information Processing & Management, 2022 - Elsevier
Abstract Syntax parse trees are a method of representing sentence structure and are often
used to provide models with syntax information and enhance downstream task performance …