Artificial Intelligence

Retrieval-augmented generation

Also written: RAG

Definition

Fetching relevant documents at question time and putting them in front of the model, rather than training the facts in.

Facts change; model weights do not, cheaply. Retrieval keeps the knowledge in a store you can update, audit and cite, and leaves the model doing what it is good at — reading and phrasing. It also gives you somewhere to point when an answer is wrong.

Hi! Need help? Chat with NSTC ✨