Embodiments described herein provide a system and method for extracting factual
information. The system transforms a query into a natural language prompt in a format of a
query subject and a queried relation. The system encodes, via an embedding layer of a pre-
trained language model, the natural language prompt into a first embedding. The system
encodes, via the adapter model, the first embedding into a second embedding based on a
probability that the second embedding returns the factual information when the second …