問題文
A monitor reports that the distribution of one input feature has moved substantially compared with the baseline. The team has not yet received the outcomes for the recent predictions. What can be concluded, and what should happen next?
選択肢
- Accuracy has degraded, because a shift in the input distribution means the model is no longer valid.
- The input has changed, which is a reason to investigate, but the effect on accuracy for the recent predictions is unknown until outcomes arrive later or the change is shown to matter for the model.
- The model should be retrained immediately on the most recent rows, because retraining is the standard response to any shift that a monitor reports, whatever its cause turns out to be.
- Nothing can be concluded and no action is warranted, because only outcome-based metrics carry information.