Pre-trained language models in biomedical domain: A systematic survey

B Wang, Q Xie, J Pei, Z Chen, P Tiwari, Z Li… - ACM Computing …, 2023 - dl.acm.org
Pre-trained language models (PLMs) have been the de facto paradigm for most natural
language processing tasks. This also benefits the biomedical domain: researchers from …

[HTML][HTML] AMMU: a survey of transformer-based biomedical pretrained language models

KS Kalyan, A Rajasekharan, S Sangeetha - Journal of biomedical …, 2022 - Elsevier
Transformer-based pretrained language models (PLMs) have started a new era in modern
natural language processing (NLP). These models combine the power of transformers …

A large language model for electronic health records

X Yang, A Chen, N PourNejatian, HC Shin… - NPJ digital …, 2022 - nature.com
There is an increasing interest in developing artificial intelligence (AI) systems to process
and interpret electronic health records (EHRs). Natural language processing (NLP) powered …

Structured prompt interrogation and recursive extraction of semantics (SPIRES): A method for populating knowledge bases using zero-shot learning

JH Caufield, H Hegde, V Emonet, NL Harris… - …, 2024 - academic.oup.com
Motivation Creating knowledge bases and ontologies is a time consuming task that relies on
manual curation. AI/NLP approaches can assist expert curators in populating these …

A survey of large language models for healthcare: from data, technology, and applications to accountability and ethics

K He, R Mao, Q Lin, Y Ruan, X Lan, M Feng… - arXiv preprint arXiv …, 2023 - arxiv.org
The utilization of large language models (LLMs) in the Healthcare domain has generated
both excitement and concern due to their ability to effectively respond to freetext queries with …

BioELECTRA: pretrained biomedical text encoder using discriminators

KR Kanakarajan, B Kundumani… - Proceedings of the …, 2021 - aclanthology.org
Recent advancements in pretraining strategies in NLP have shown a significant
improvement in the performance of models on various text mining tasks. We apply 'replaced …

Information extraction from electronic medical documents: state of the art and future research directions

MY Landolsi, L Hlaoua, L Ben Romdhane - Knowledge and Information …, 2023 - Springer
In the medical field, a doctor must have a comprehensive knowledge by reading and writing
narrative documents, and he is responsible for every decision he takes for patients …

Gatortron: A large clinical language model to unlock patient information from unstructured electronic health records

X Yang, A Chen, N PourNejatian, HC Shin… - arXiv preprint arXiv …, 2022 - arxiv.org
There is an increasing interest in developing artificial intelligence (AI) systems to process
and interpret electronic health records (EHRs). Natural language processing (NLP) powered …

A systematic review of transformer-based pre-trained language models through self-supervised learning

E Kotei, R Thirunavukarasu - Information, 2023 - mdpi.com
Transfer learning is a technique utilized in deep learning applications to transmit learned
inference to a different target domain. The approach is mainly to solve the problem of a few …

Several categories of large language models (llms): A short survey

S Pahune, M Chandrasekharan - arXiv preprint arXiv:2307.10188, 2023 - arxiv.org
Large Language Models (LLMs) have become effective tools for natural language
processing and have been used in many different fields. This essay offers a succinct …