問題文
Underwriting policy documents change every few weeks, and answers must cite the current policy. A vendor proposes fine-tuning a model on the policy corpus instead of building retrieval. Which consideration decides the case?
選択肢
- Retrieval-augmented generation retrieves additional data from external sources at answer time, so changed policies take effect without retraining the model.
- Retrieval is only appropriate for structured data, so policy documents must be fine-tuned.
- Neither is needed, because the number of tokens a request carries affects the response time and the throughput, so a model with a large context window can simply be given the whole corpus in every request.
- Fine-tuning is preferable because the model then holds the policies internally and never needs a retrieval step.