Neuro-symbolic language modeling with automaton-augmented retrieval

U Alon, F Xu, J He, S Sengupta… - International …, 2022 - proceedings.mlr.press
Retrieval-based language models (R-LM) model the probability of natural language text by
combining a standard language model (LM) with examples retrieved from an external …

Goodtriever: Adaptive toxicity mitigation with retrieval-augmented models

L Pozzobon, B Ermis, P Lewis, S Hooker - arXiv preprint arXiv:2310.07589, 2023 - arxiv.org
Considerable effort has been dedicated to mitigating toxicity, but existing methods often
require drastic modifications to model parameters or the use of computationally intensive …

Efficient cluster-based k-nearest-neighbor machine translation

D Wang, K Fan, B Chen, D Xiong - arXiv preprint arXiv:2204.06175, 2022 - arxiv.org
k-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-
parametric solution for domain adaptation in neural machine translation (NMT). It aims to …

Efficient machine translation domain adaptation

PH Martins, Z Marinho, AFT Martins - arXiv preprint arXiv:2204.12608, 2022 - arxiv.org
Machine translation models struggle when translating out-of-domain text, which makes
domain adaptation a topic of critical importance. However, most domain adaptation methods …

Chunk-based nearest neighbor machine translation

PH Martins, Z Marinho, AFT Martins - arXiv preprint arXiv:2205.12230, 2022 - arxiv.org
Semi-parametric models, which augment generation with retrieval, have led to impressive
results in language modeling and machine translation, due to their ability to retrieve fine …

Towards robust k-nearest-neighbor machine translation

H Jiang, Z Lu, F Meng, C Zhou, J Zhou… - arXiv preprint arXiv …, 2022 - arxiv.org
k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research
direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an …

Analogical math word problems solving with enhanced problem-solution association

Z Liang, J Zhang, X Zhang - arXiv preprint arXiv:2212.00837, 2022 - arxiv.org
Math word problem (MWP) solving is an important task in question answering which
requires human-like reasoning ability. Analogical reasoning has long been used in …

Simple and scalable nearest neighbor machine translation

Y Dai, Z Zhang, Q Liu, Q Cui, W Li, Y Du… - arXiv preprint arXiv …, 2023 - arxiv.org
$ k $ NN-MT is a straightforward yet powerful approach for fast domain adaptation, which
directly plugs pre-trained neural machine translation (NMT) models with domain-specific …

kNN-TL: k-nearest-neighbor transfer learning for low-resource neural machine translation

S Liu, X Liu, DF Wong, Z Li, W Jiao… - Proceedings of the …, 2023 - aclanthology.org
Transfer learning has been shown to be an effective technique for enhancing the
performance of low-resource neural machine translation (NMT). This is typically achieved …

Bridging the domain gaps in context representations for k-nearest neighbor neural machine translation

Z Cao, B Yang, H Lin, S Wu, X Wei, D Liu, J Xie… - arXiv preprint arXiv …, 2023 - arxiv.org
$ k $-Nearest neighbor machine translation ($ k $ NN-MT) has attracted increasing attention
due to its ability to non-parametrically adapt to new translation domains. By using an …