D Cheng,
S Huang,
F Wei - The Twelfth International Conference on …, 2023 - openreview.net
We explore how continued pre-training on domain-specific corpora influences large
language models, revealing that training on the raw corpora endows the model with domain …